Nov 06 17:39:02 devstack cinder-volume[76058]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 06 17:39:02 devstack cinder-volume[76058]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 06 17:39:02 devstack cinder-volume[76058]: we strongly recommend against using it for new projects. Nov 06 17:39:02 devstack cinder-volume[76058]: If you are already using Eventlet, we recommend migrating to a different Nov 06 17:39:02 devstack cinder-volume[76058]: framework. For more detail see Nov 06 17:39:02 devstack cinder-volume[76058]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 06 17:39:02 devstack cinder-volume[76058]: import eventlet # noqa Nov 06 17:39:05 devstack cinder-volume[76058]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76058) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 17:39:05 devstack cinder-volume[76058]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76058) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 17:39:05 devstack cinder-volume[76058]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76058) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 17:39:05 devstack cinder-volume[76058]: INFO dbcounter [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] Registered counter for database cinder Nov 06 17:39:06 devstack cinder-volume[76058]: DEBUG oslo_db.sqlalchemy.engines [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76058) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 17:39:06 devstack cinder-volume[76058]: DEBUG dbcounter [-] [76058] Writer thread running {{(pid=76058) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 17:39:06 devstack cinder-volume[76058]: INFO cinder.rpc [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 06 17:39:06 devstack cinder-volume[76058]: INFO cinder.rpc [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 06 17:39:06 devstack cinder-volume[76058]: DEBUG oslo_db.sqlalchemy.engines [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76058) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 17:39:06 devstack cinder-volume[76058]: INFO cinder.volume.manager [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] Determined volume DB was empty at startup. Nov 06 17:39:06 devstack cinder-volume[76058]: DEBUG cinder.volume.manager [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76058) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 06 17:39:06 devstack cinder-volume[76058]: INFO cinder.volume.manager [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 06 17:39:06 devstack cinder-volume[76058]: WARNING stevedore.named [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 17:39:06 devstack cinder-volume[76058]: WARNING castellan.key_manager [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 17:39:06 devstack cinder-volume[76058]: WARNING cinder.keymgr.conf_key_mgr [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 17:39:06 devstack cinder-volume[76058]: DEBUG cinder.volume.drivers.lvm [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76058) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Nov 06 17:39:06 devstack cinder-volume[76058]: DEBUG oslo_concurrency.processutils [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76058) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_concurrency.processutils [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] CMD "cinder-rtstool verify" returned: 0 in 0.432s {{(pid=76058) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_db.sqlalchemy.engines [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76058) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 17:39:07 devstack cinder-volume[76058]: INFO cinder.rpc [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 06 17:39:07 devstack cinder-volume[76058]: INFO cinder.rpc [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Nov 06 17:39:07 devstack cinder-volume[76058]: WARNING stevedore.named [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 17:39:07 devstack cinder-volume[76058]: WARNING castellan.key_manager [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 17:39:07 devstack cinder-volume[76058]: INFO cinder.volume.manager [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_db.sqlalchemy.engines [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76058) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 17:39:07 devstack cinder-volume[76058]: INFO oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] Starting 1 workers Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] Started child 76197 {{(pid=76058) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] Full set of CONF: {{(pid=76058) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] ******************************************************************************** {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] Configuration options gathered from: {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] ================================================================================ {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] allow_availability_zone_fallback = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] allow_compression_on_image_upload = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] allowed_direct_url_schemes = [] {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] api_rate_limit = True {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] auth_strategy = keystone {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76197]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] az_cache_duration = 3600 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_availability_zone = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_host = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_name = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_stats_polling_interval = 60 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backup_api_class = cinder.backup.api.API {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backup_name_template = backup-%s {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backup_use_same_host = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backup_use_temp_snapshot = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] chap_password = **** {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] chap_username = {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] cinder_internal_tenant_project_id = d6b19e64c69247f0a7abe61b0152cd4c {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] cinder_internal_tenant_user_id = d952e618bde04ca0aeb163831b6b09e3 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] cloned_volume_same_az = True {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] cluster = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] compression_format = gzip {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] compute_api_class = cinder.compute.nova.API {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] config_dir = [] {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] config_source = [] {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] control_exchange = openstack {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] debug = True {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] default_availability_zone = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] default_group_type = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] default_volume_type = lvmdriver-1 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] disk_geometry = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] driver_client_cert = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] driver_client_cert_key = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] driver_data_namespace = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] driver_ssl_cert_path = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] driver_ssl_cert_verify = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] driver_use_ssl = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] enable_force_upload = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] enable_new_services = True {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] enable_unsupported_driver = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] enforce_multipath_for_image_xfer = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] filter_function = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] glance_api_insecure = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] glance_api_servers = ['http://192.168.122.117/image'] {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] glance_api_ssl_compression = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] glance_ca_certificates_file = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] glance_catalog_info = image:glance:publicURL {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] glance_certfile = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] glance_keyfile = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] glance_num_retries = 3 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] glance_request_timeout = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] goodness_function = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] graceful_shutdown_timeout = 5 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] group_api_class = cinder.group.api.API {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] host = devstack {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] image_compress_on_upload = True {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] image_conversion_address_space_limit = 1 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] image_conversion_cpu_limit = 60 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] image_conversion_disable = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] image_introspection_address_space_limit = 1 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] image_introspection_cpu_limit = 60 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] image_upload_use_cinder_backend = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] image_upload_use_internal_tenant = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] image_volume_cache_enabled = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] image_volume_cache_max_count = 0 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] image_volume_cache_max_size_gb = 0 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] init_host_max_objects_retrieval = 0 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] instance_format = [instance: %(uuid)s] {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] iscsi_target_flags = {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] iscsi_write_cache = on {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] iser_helper = tgtadm {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] iser_ip_address = 192.168.122.117 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] iser_port = 3260 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] log_color = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] log_config_append = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] log_dir = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] log_file = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] log_options = True {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] log_rotate_interval = 1 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] log_rotate_interval_type = days {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] log_rotation_type = none {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] max_age = 0 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] max_logfile_count = 30 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] max_logfile_size_mb = 200 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] max_over_subscription_ratio = 20.0 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] message_reap_interval = 86400 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] message_ttl = 2592000 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] migration_create_volume_timeout_secs = 300 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] monkey_patch = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] monkey_patch_modules = [] {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] my_ip = 192.168.122.117 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] no_snapshot_gb_quota = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] num_iser_scan_tries = 3 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] num_shell_tries = 3 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] num_volume_device_scan_tries = 3 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] nvmeof_conn_info_version = 1 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] nvmet_ns_id = 10 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] nvmet_port_id = 1 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] osapi_max_limit = 1000 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] osapi_volume_ext_list = [] {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] osapi_volume_listen_port = 8776 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] osapi_volume_use_ssl = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] osapi_volume_workers = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] per_volume_size_limit = -1 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] periodic_fuzzy_delay = 60 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] periodic_interval = 60 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] public_endpoint = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] publish_errors = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] quota_backup_gigabytes = 1000 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] quota_backups = 10 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] quota_gigabytes = 1000 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] quota_groups = 10 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] quota_snapshots = 10 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] quota_volumes = 10 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] rate_limit_burst = 0 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] rate_limit_except_level = CRITICAL {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] rate_limit_interval = 0 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] reinit_driver_count = 3 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] replication_device = **** {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] report_discard_supported = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] report_interval = 120 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] reservation_clean_interval = 86400 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] reservation_expire = 86400 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] reserved_image_namespaces = [] {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] reserved_percentage = 0 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] rpc_response_timeout = 120 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] run_external_periodic_tasks = True {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] scst_target_driver = iscsi {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] scst_target_iqn_name = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] service_down_time = 720 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] shell_completion = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] snapshot_name_template = snapshot-%s {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] snapshot_same_host = True {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] split_loggers = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] state_path = /opt/stack/data/cinder {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] storage_availability_zone = nova {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76197]: INFO cinder.volume.manager [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] Starting volume driver LVMVolumeDriver (3.0.0) Nov 06 17:39:07 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] storage_protocol = iSCSI {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] syslog_log_facility = LOG_USER {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] target_helper = lioadm {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] target_ip_address = 192.168.122.117 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] target_port = 3260 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] target_protocol = iscsi {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] target_secondary_ip_addresses = [] {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] trace_flags = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] transport_url = **** {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] until_refresh = 0 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] use_chap_auth = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] use_default_quota_class = True {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] use_journal = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] use_json = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] use_multipath_for_image_xfer = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] use_stderr = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] use_syslog = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] verify_glance_signatures = enabled {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] volume_api_class = cinder.volume.api.API {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] volume_backend_name = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] volume_clear = zero {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] volume_clear_ionice = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] volume_clear_size = 0 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] volume_copy_bps_limit = 0 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] volume_dd_blocksize = 1M {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] volume_name_template = volume-%s {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] volume_service_inithost_offload = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] volume_usage_audit_period = month {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] zoning_mode = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_concurrency.disable_process_locking = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] keystone_authtoken.auth_section = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] keystone_authtoken.auth_type = password {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] keystone_authtoken.auth_version = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] keystone_authtoken.cache = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] keystone_authtoken.certfile = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] keystone_authtoken.include_service_catalog = True {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] keystone_authtoken.insecure = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] keystone_authtoken.interface = public {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] keystone_authtoken.keyfile = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] keystone_authtoken.memcache_password = **** {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] keystone_authtoken.memcache_username = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] keystone_authtoken.region_name = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] keystone_authtoken.service_type = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.117/identity {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] cache.backend = dogpile.cache.null {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] cache.backend_argument = **** {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] cache.backend_expiration_time = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] cache.config_prefix = cache.oslo {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] cache.debug_cache_backend = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] cache.enable_retry_client = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] cache.enable_socket_keepalive = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] cache.enabled = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] cache.expiration_time = 600 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] cache.hashclient_retry_attempts = 2 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] cache.memcache_dead_retry = 300 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] cache.memcache_pool_maxsize = 10 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] cache.memcache_sasl_enabled = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] cache.password = **** {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] cache.proxies = [] {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] cache.redis_db = 0 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] cache.redis_server = localhost:6379 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] cache.retry_attempts = 2 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] cache.retry_delay = 0.0 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] cache.socket_keepalive_count = 1 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] cache.socket_keepalive_idle = 1 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] cache.socket_keepalive_interval = 1 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] cache.socket_timeout = 1.0 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] cache.tls_allowed_ciphers = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] cache.tls_cafile = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] cache.tls_certfile = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] cache.tls_enabled = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] cache.tls_keyfile = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] cache.username = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] coordination.backend_url = **** {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] database.asyncio_connection = **** {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] database.asyncio_slave_connection = **** {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] database.backend = sqlalchemy {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] database.connection = **** {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] database.connection_debug = 0 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] database.connection_parameters = {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] database.connection_recycle_time = 3600 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] database.connection_trace = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] database.db_inc_retry_interval = True {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] database.db_max_retries = 20 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] database.db_max_retry_interval = 10 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] database.db_retry_interval = 1 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] database.max_overflow = 50 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] database.max_pool_size = 5 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] database.max_retries = 10 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] database.mysql_wsrep_sync_wait = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack sudo[76201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Nov 06 17:39:07 devstack sudo[76201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] database.pool_timeout = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] database.retry_interval = 10 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] database.slave_connection = **** {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] database.sqlite_synchronous = True {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] database.synchronous_reader = True {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] database.use_db_reconnect = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_messaging_tracing.insecure = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] profiler.connection_string = messaging:// {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] profiler.enabled = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] profiler.es_doc_type = notification {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] profiler.es_scroll_size = 10000 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] profiler.es_scroll_time = 2m {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] profiler.filter_error_trace = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] profiler.hmac_keys = **** {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] profiler.sentinel_service_name = mymaster {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] profiler.socket_timeout = 0.1 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] profiler.trace_requests = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] profiler.trace_sqlalchemy = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] profiler_jaeger.process_tags = {} {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] profiler_jaeger.service_name_prefix = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] profiler_otlp.service_name_prefix = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_policy.enforce_new_defaults = True {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_policy.policy_default_rule = default {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_policy.policy_file = policy.yaml {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] privsep_osbrick.group = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] privsep_osbrick.helper_command = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] privsep_osbrick.user = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] cinder_sys_admin.group = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] cinder_sys_admin.helper_command = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] cinder_sys_admin.user = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] service_user.auth_section = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] service_user.auth_type = password {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] service_user.cafile = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] service_user.certfile = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] service_user.collect_timing = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] service_user.insecure = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] service_user.keyfile = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] service_user.send_service_user_token = True {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] service_user.split_loggers = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] service_user.timeout = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] service_user.tls_ciphers = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] service_user.tls_min_version = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] glance.auth_section = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] glance.auth_type = password {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] glance.certfile = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] glance.collect_timing = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] glance.insecure = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] glance.keyfile = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] glance.region_name = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] glance.split_loggers = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] glance.timeout = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] glance.tls_ciphers = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] glance.tls_min_version = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.backend_availability_zone = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.chap_password = **** {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.chap_username = {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.disk_geometry = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.driver_client_cert = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.driver_client_cert_key = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.driver_data_namespace = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.driver_use_ssl = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.extra_capabilities = {} {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.filter_function = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.goodness_function = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.iscsi_target_flags = {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.iscsi_write_cache = on {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.iser_helper = tgtadm {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.iser_ip_address = 192.168.122.117 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.iser_port = 3260 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.lvm_share_target = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.lvm_type = auto {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.num_shell_tries = 3 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.replication_device = **** {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.report_discard_supported = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.reserved_percentage = 0 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.target_helper = tgtadm {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.target_ip_address = 192.168.122.117 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.target_port = 3260 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.target_protocol = iscsi {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.trace_flags = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.unique_fqdn_network = True {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.use_chap_auth = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.volume_backend_name = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.volume_clear = zero {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.volume_clear_ionice = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.volume_clear_size = 0 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_reports.file_event_handler = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_reports.log_dir = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.backend_host = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.chap_password = **** {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.chap_username = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.disk_geometry = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.driver_client_cert = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.extra_capabilities = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.filter_function = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.goodness_function = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.iser_helper = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.iser_ip_address = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.iser_port = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.lvm_share_target = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.lvm_type = auto {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.num_shell_tries = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.replication_device = **** {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.report_discard_supported = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.reserved_percentage = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.scst_target_driver = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.storage_protocol = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.target_helper = lioadm {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.target_ip_address = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.target_port = 3260 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.trace_flags = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.use_chap_auth = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.volume_clear = zero {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.volume_clear_size = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] lvmdriver-1.volumes_dir = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_messaging_rabbit.ssl = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_messaging_notifications.driver = [] {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_messaging_notifications.retry = -1 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] key_manager.fixed_key = **** {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] barbican.barbican_api_version = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] barbican.barbican_endpoint = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] barbican.barbican_endpoint_type = public {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] barbican.barbican_region_name = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] barbican.cafile = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] barbican.certfile = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] barbican.collect_timing = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] barbican.insecure = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] barbican.keyfile = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] barbican.number_of_retries = 60 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] barbican.retry_delay = 1 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] barbican.send_service_user_token = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] barbican.split_loggers = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] barbican.timeout = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] barbican.tls_ciphers = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] barbican.tls_min_version = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] barbican.verify_ssl = True {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] barbican.verify_ssl_path = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] barbican_service_user.auth_section = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] barbican_service_user.auth_type = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] barbican_service_user.cafile = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] barbican_service_user.certfile = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] barbican_service_user.collect_timing = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] barbican_service_user.insecure = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] barbican_service_user.keyfile = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] barbican_service_user.split_loggers = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] barbican_service_user.timeout = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] barbican_service_user.tls_ciphers = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] barbican_service_user.tls_min_version = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] vault.approle_role_id = **** {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] vault.approle_secret_id = **** {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] vault.auth_method = approle {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] vault.auth_path = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] vault.kv_mountpoint = secret {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] vault.kv_path = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] vault.kv_version = 2 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] vault.namespace = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] vault.root_token_id = **** {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] vault.ssl_ca_crt_file = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] vault.timeout = 60.0 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] vault.token_file = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] vault.token_role = None {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] vault.use_ssl = False {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:39:07 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] ******************************************************************************** {{(pid=76058) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 06 17:39:07 devstack sudo[76201]: pam_unix(sudo:session): session closed for user root Nov 06 17:39:07 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.293s {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:39:07 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:39:07 devstack sudo[76293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 17:39:07 devstack sudo[76293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:39:07 devstack sudo[76293]: pam_unix(sudo:session): session closed for user root Nov 06 17:39:07 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.253s {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:39:07 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 17:39:07 devstack cinder-volume[76197]: INFO cinder.brick.local_dev.lvm [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Nov 06 17:39:07 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:39:07 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:39:07 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:39:08 devstack sudo[76397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 17:39:08 devstack sudo[76397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:39:08 devstack sudo[76397]: pam_unix(sudo:session): session closed for user root Nov 06 17:39:08 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:39:08 devstack cinder-volume[76197]: DEBUG cinder.brick.local_dev.lvm [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76197) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Nov 06 17:39:08 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:39:08 devstack sudo[76480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 17:39:08 devstack sudo[76480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:39:08 devstack sudo[76480]: pam_unix(sudo:session): session closed for user root Nov 06 17:39:08 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.524s {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:39:08 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:39:08 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:39:08 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:39:08 devstack sudo[76677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 17:39:08 devstack sudo[76677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:39:09 devstack sudo[76677]: pam_unix(sudo:session): session closed for user root Nov 06 17:39:09 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:39:09 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:39:09 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:39:09 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:39:09 devstack sudo[76780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Nov 06 17:39:09 devstack sudo[76780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:39:09 devstack sudo[76780]: pam_unix(sudo:session): session closed for user root Nov 06 17:39:09 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.282s {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:39:09 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:39:09 devstack sudo[76812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 17:39:09 devstack sudo[76812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:39:09 devstack sudo[76812]: pam_unix(sudo:session): session closed for user root Nov 06 17:39:09 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:39:09 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:39:09 devstack sudo[76822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 17:39:09 devstack sudo[76822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:39:09 devstack sudo[76822]: pam_unix(sudo:session): session closed for user root Nov 06 17:39:09 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.295s {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:39:09 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:39:09 devstack sudo[76901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 17:39:09 devstack sudo[76901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:39:10 devstack sudo[76901]: pam_unix(sudo:session): session closed for user root Nov 06 17:39:10 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:39:10 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:39:10 devstack sudo[76910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 17:39:10 devstack sudo[76910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:39:10 devstack sudo[76910]: pam_unix(sudo:session): session closed for user root Nov 06 17:39:10 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.327s {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:39:10 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:39:10 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:39:10 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:39:10 devstack sudo[76994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 17:39:10 devstack sudo[76994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:39:10 devstack sudo[76994]: pam_unix(sudo:session): session closed for user root Nov 06 17:39:10 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.268s {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:39:10 devstack cinder-volume[76197]: INFO cinder.volume.drivers.lvm [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] Enabling LVM thin provisioning by default because a thin pool exists. Nov 06 17:39:10 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:39:10 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:39:10 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:39:10 devstack sudo[76998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 17:39:10 devstack sudo[76998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:39:11 devstack sudo[76998]: pam_unix(sudo:session): session closed for user root Nov 06 17:39:11 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.245s {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:39:11 devstack cinder-volume[76197]: DEBUG cinder.volume.drivers.lvm [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] Updating volume stats {{(pid=76197) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 17:39:11 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:39:11 devstack sudo[77007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 17:39:11 devstack sudo[77007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:39:11 devstack sudo[77007]: pam_unix(sudo:session): session closed for user root Nov 06 17:39:11 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:39:11 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:39:11 devstack sudo[77010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 17:39:11 devstack sudo[77010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:39:11 devstack sudo[77010]: pam_unix(sudo:session): session closed for user root Nov 06 17:39:11 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:39:11 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:39:11 devstack sudo[77013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 17:39:11 devstack sudo[77013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:39:11 devstack sudo[77013]: pam_unix(sudo:session): session closed for user root Nov 06 17:39:11 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:39:11 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:39:11 devstack sudo[77017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 17:39:11 devstack sudo[77017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:39:12 devstack sudo[77017]: pam_unix(sudo:session): session closed for user root Nov 06 17:39:12 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:39:12 devstack cinder-volume[76197]: INFO cinder.volume.driver [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] Driver hasn't implemented _init_vendor_properties() Nov 06 17:39:12 devstack cinder-volume[76197]: DEBUG cinder.volume.driver [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76197) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 06 17:39:12 devstack cinder-volume[76197]: DEBUG oslo_db.sqlalchemy.engines [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76197) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 17:39:12 devstack cinder-volume[76197]: DEBUG dbcounter [-] [76197] Writer thread running {{(pid=76197) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 17:39:12 devstack cinder-volume[76197]: DEBUG cinder.db.api [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] Building query based on filter {{(pid=76197) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}} Nov 06 17:39:12 devstack cinder-volume[76197]: DEBUG cinder.image.image_utils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76197) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 06 17:39:12 devstack cinder-volume[76197]: INFO cinder.keymgr.migration [None req-be403dd7-d825-4e80-894f-29c2f5955d20 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 06 17:39:12 devstack cinder-volume[76197]: DEBUG cinder.volume.drivers.lvm [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] Updating volume stats {{(pid=76197) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 17:39:12 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:39:12 devstack sudo[77020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 17:39:12 devstack sudo[77020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:39:12 devstack sudo[77020]: pam_unix(sudo:session): session closed for user root Nov 06 17:39:12 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:39:12 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:39:12 devstack sudo[77024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 17:39:12 devstack sudo[77024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:39:12 devstack sudo[77024]: pam_unix(sudo:session): session closed for user root Nov 06 17:39:12 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:39:12 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:39:12 devstack sudo[77028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 17:39:12 devstack sudo[77028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:39:13 devstack sudo[77028]: pam_unix(sudo:session): session closed for user root Nov 06 17:39:13 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:39:13 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:39:13 devstack sudo[77031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 17:39:13 devstack sudo[77031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:39:13 devstack sudo[77031]: pam_unix(sudo:session): session closed for user root Nov 06 17:39:13 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:39:13 devstack cinder-volume[76197]: DEBUG cinder.manager [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] Notifying Schedulers of capabilities ... {{(pid=76197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:39:13 devstack cinder-volume[76197]: INFO cinder.volume.manager [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] Driver initialization completed successfully. Nov 06 17:39:13 devstack cinder-volume[76197]: INFO cinder.manager [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] Initiating service 2 cleanup Nov 06 17:39:13 devstack cinder-volume[76197]: INFO cinder.manager [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] Service 2 cleanup completed. Nov 06 17:39:13 devstack cinder-volume[76197]: DEBUG cinder.service [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] Creating RPC server for service cinder-volume {{(pid=76197) start /opt/stack/cinder/cinder/service.py:231}} Nov 06 17:39:13 devstack cinder-volume[76197]: DEBUG cinder.service [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76197) start /opt/stack/cinder/cinder/service.py:237}} Nov 06 17:39:13 devstack cinder-volume[76197]: INFO cinder.volume.manager [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Nov 06 17:39:13 devstack cinder-volume[76197]: DEBUG cinder.volume.drivers.lvm [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] Updating volume stats {{(pid=76197) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 17:39:13 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:39:13 devstack sudo[77034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 17:39:13 devstack sudo[77034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:39:13 devstack sudo[77034]: pam_unix(sudo:session): session closed for user root Nov 06 17:39:13 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:39:13 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:39:13 devstack sudo[77038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 17:39:13 devstack sudo[77038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:39:14 devstack sudo[77038]: pam_unix(sudo:session): session closed for user root Nov 06 17:39:14 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:39:14 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:39:14 devstack sudo[77042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 17:39:14 devstack sudo[77042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:39:14 devstack sudo[77042]: pam_unix(sudo:session): session closed for user root Nov 06 17:39:14 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:39:14 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:39:14 devstack sudo[77048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 17:39:14 devstack sudo[77048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:39:14 devstack sudo[77048]: pam_unix(sudo:session): session closed for user root Nov 06 17:39:14 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:39:14 devstack cinder-volume[76197]: INFO cinder.volume.manager [None req-32412be8-fe13-4e27-8655-c6115e302816 None None] Driver post RPC initialization completed successfully. Nov 06 17:39:17 devstack cinder-volume[76058]: DEBUG dbcounter [-] [76058] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76058) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 17:39:24 devstack cinder-volume[76197]: DEBUG dbcounter [-] [76197] Writing DB stats cinder:SELECT=2 {{(pid=76197) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 17:39:24 devstack cinder-volume[76197]: DEBUG dbcounter [-] [76197] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76197) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 17:39:26 devstack cinder-volume[76197]: DEBUG oslo_service.periodic_task [None req-fce709f1-5d06-45b5-bc89-428f31d7bdb9 None None] Running periodic task VolumeManager._thread_info {{(pid=76197) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 17:39:26 devstack cinder-volume[76197]: DEBUG cinder.volume.manager [None req-fce709f1-5d06-45b5-bc89-428f31d7bdb9 None None] thread count: 6 {{(pid=76197) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 17:39:26 devstack cinder-volume[76197]: DEBUG cinder.volume.manager [None req-fce709f1-5d06-45b5-bc89-428f31d7bdb9 None None] thread info: [<_MainThread(MainThread, started 134053445701760)>, , , , , ] {{(pid=76197) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 17:40:26 devstack cinder-volume[76197]: DEBUG oslo_service.periodic_task [None req-fce709f1-5d06-45b5-bc89-428f31d7bdb9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76197) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 17:40:26 devstack cinder-volume[76197]: DEBUG cinder.volume.drivers.lvm [None req-fce709f1-5d06-45b5-bc89-428f31d7bdb9 None None] Updating volume stats {{(pid=76197) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 17:40:26 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-fce709f1-5d06-45b5-bc89-428f31d7bdb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:40:26 devstack sudo[79535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 17:40:26 devstack sudo[79535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:40:26 devstack sudo[79535]: pam_unix(sudo:session): session closed for user root Nov 06 17:40:26 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-fce709f1-5d06-45b5-bc89-428f31d7bdb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.241s {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:40:26 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-fce709f1-5d06-45b5-bc89-428f31d7bdb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:40:26 devstack sudo[79538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 17:40:26 devstack sudo[79538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:40:27 devstack sudo[79538]: pam_unix(sudo:session): session closed for user root Nov 06 17:40:27 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-fce709f1-5d06-45b5-bc89-428f31d7bdb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:40:27 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-fce709f1-5d06-45b5-bc89-428f31d7bdb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:40:27 devstack sudo[79541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 17:40:27 devstack sudo[79541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:40:27 devstack sudo[79541]: pam_unix(sudo:session): session closed for user root Nov 06 17:40:27 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-fce709f1-5d06-45b5-bc89-428f31d7bdb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:40:27 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-fce709f1-5d06-45b5-bc89-428f31d7bdb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:40:27 devstack sudo[79544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 17:40:27 devstack sudo[79544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:40:27 devstack sudo[79544]: pam_unix(sudo:session): session closed for user root Nov 06 17:40:27 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-fce709f1-5d06-45b5-bc89-428f31d7bdb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:40:27 devstack cinder-volume[76197]: DEBUG cinder.manager [None req-fce709f1-5d06-45b5-bc89-428f31d7bdb9 None None] Notifying Schedulers of capabilities ... {{(pid=76197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:40:27 devstack cinder-volume[76197]: DEBUG oslo_service.periodic_task [None req-fce709f1-5d06-45b5-bc89-428f31d7bdb9 None None] Running periodic task VolumeManager._thread_info {{(pid=76197) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 17:40:27 devstack cinder-volume[76197]: DEBUG cinder.volume.manager [None req-fce709f1-5d06-45b5-bc89-428f31d7bdb9 None None] thread count: 6 {{(pid=76197) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 17:40:27 devstack cinder-volume[76197]: DEBUG cinder.volume.manager [None req-fce709f1-5d06-45b5-bc89-428f31d7bdb9 None None] thread info: [<_MainThread(MainThread, started 134053445701760)>, , , , , ] {{(pid=76197) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 17:41:24 devstack cinder-volume[76197]: DEBUG dbcounter [-] [76197] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76197) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 17:41:26 devstack cinder-volume[76197]: DEBUG oslo_service.periodic_task [None req-fce709f1-5d06-45b5-bc89-428f31d7bdb9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76197) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 17:41:26 devstack cinder-volume[76197]: DEBUG cinder.volume.drivers.lvm [None req-fce709f1-5d06-45b5-bc89-428f31d7bdb9 None None] Updating volume stats {{(pid=76197) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 17:41:26 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-fce709f1-5d06-45b5-bc89-428f31d7bdb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:41:26 devstack sudo[82569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 17:41:26 devstack sudo[82569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:41:26 devstack sudo[82569]: pam_unix(sudo:session): session closed for user root Nov 06 17:41:26 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-fce709f1-5d06-45b5-bc89-428f31d7bdb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:41:26 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-fce709f1-5d06-45b5-bc89-428f31d7bdb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:41:26 devstack sudo[82577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 17:41:26 devstack sudo[82577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:41:27 devstack sudo[82577]: pam_unix(sudo:session): session closed for user root Nov 06 17:41:27 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-fce709f1-5d06-45b5-bc89-428f31d7bdb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:41:27 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-fce709f1-5d06-45b5-bc89-428f31d7bdb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:41:27 devstack sudo[82587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 17:41:27 devstack sudo[82587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:41:27 devstack sudo[82587]: pam_unix(sudo:session): session closed for user root Nov 06 17:41:27 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-fce709f1-5d06-45b5-bc89-428f31d7bdb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.244s {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:41:27 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-fce709f1-5d06-45b5-bc89-428f31d7bdb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:41:27 devstack sudo[82591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 17:41:27 devstack sudo[82591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:41:27 devstack sudo[82591]: pam_unix(sudo:session): session closed for user root Nov 06 17:41:27 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-fce709f1-5d06-45b5-bc89-428f31d7bdb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:41:27 devstack cinder-volume[76197]: DEBUG cinder.manager [None req-fce709f1-5d06-45b5-bc89-428f31d7bdb9 None None] Notifying Schedulers of capabilities ... {{(pid=76197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:41:27 devstack cinder-volume[76197]: DEBUG oslo_service.periodic_task [None req-fce709f1-5d06-45b5-bc89-428f31d7bdb9 None None] Running periodic task VolumeManager._thread_info {{(pid=76197) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 17:41:27 devstack cinder-volume[76197]: DEBUG cinder.volume.manager [None req-fce709f1-5d06-45b5-bc89-428f31d7bdb9 None None] thread count: 6 {{(pid=76197) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 17:41:27 devstack cinder-volume[76197]: DEBUG cinder.volume.manager [None req-fce709f1-5d06-45b5-bc89-428f31d7bdb9 None None] thread info: [<_MainThread(MainThread, started 134053445701760)>, , , , , ] {{(pid=76197) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 17:42:26 devstack cinder-volume[76197]: DEBUG oslo_service.periodic_task [None req-fce709f1-5d06-45b5-bc89-428f31d7bdb9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76197) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 17:42:26 devstack cinder-volume[76197]: DEBUG cinder.volume.drivers.lvm [None req-fce709f1-5d06-45b5-bc89-428f31d7bdb9 None None] Updating volume stats {{(pid=76197) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 17:42:26 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-fce709f1-5d06-45b5-bc89-428f31d7bdb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:42:26 devstack sudo[84801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 17:42:26 devstack sudo[84801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:42:26 devstack sudo[84801]: pam_unix(sudo:session): session closed for user root Nov 06 17:42:26 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-fce709f1-5d06-45b5-bc89-428f31d7bdb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:42:26 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-fce709f1-5d06-45b5-bc89-428f31d7bdb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:42:26 devstack sudo[84829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 17:42:26 devstack sudo[84829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:42:27 devstack sudo[84829]: pam_unix(sudo:session): session closed for user root Nov 06 17:42:27 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-fce709f1-5d06-45b5-bc89-428f31d7bdb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:42:27 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-fce709f1-5d06-45b5-bc89-428f31d7bdb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:42:27 devstack sudo[84866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 17:42:27 devstack sudo[84866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:42:27 devstack sudo[84866]: pam_unix(sudo:session): session closed for user root Nov 06 17:42:27 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-fce709f1-5d06-45b5-bc89-428f31d7bdb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:42:27 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-fce709f1-5d06-45b5-bc89-428f31d7bdb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:42:27 devstack sudo[84904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 17:42:27 devstack sudo[84904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:42:27 devstack sudo[84904]: pam_unix(sudo:session): session closed for user root Nov 06 17:42:27 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-fce709f1-5d06-45b5-bc89-428f31d7bdb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:42:27 devstack cinder-volume[76197]: DEBUG cinder.manager [None req-fce709f1-5d06-45b5-bc89-428f31d7bdb9 None None] Notifying Schedulers of capabilities ... {{(pid=76197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:42:27 devstack cinder-volume[76197]: DEBUG oslo_service.periodic_task [None req-fce709f1-5d06-45b5-bc89-428f31d7bdb9 None None] Running periodic task VolumeManager._thread_info {{(pid=76197) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 17:42:27 devstack cinder-volume[76197]: DEBUG cinder.volume.manager [None req-fce709f1-5d06-45b5-bc89-428f31d7bdb9 None None] thread count: 6 {{(pid=76197) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 17:42:27 devstack cinder-volume[76197]: DEBUG cinder.volume.manager [None req-fce709f1-5d06-45b5-bc89-428f31d7bdb9 None None] thread info: [<_MainThread(MainThread, started 134053445701760)>, , , , , ] {{(pid=76197) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 17:43:24 devstack cinder-volume[76197]: DEBUG dbcounter [-] [76197] Writing DB stats cinder:SELECT=1 {{(pid=76197) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 17:43:24 devstack cinder-volume[76197]: DEBUG dbcounter [-] [76197] Writing DB stats cinder:UPDATE=1 {{(pid=76197) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 17:43:26 devstack cinder-volume[76197]: DEBUG oslo_service.periodic_task [None req-fce709f1-5d06-45b5-bc89-428f31d7bdb9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76197) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 17:43:26 devstack cinder-volume[76197]: DEBUG cinder.volume.drivers.lvm [None req-fce709f1-5d06-45b5-bc89-428f31d7bdb9 None None] Updating volume stats {{(pid=76197) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 17:43:26 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-fce709f1-5d06-45b5-bc89-428f31d7bdb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:43:26 devstack sudo[86055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 17:43:26 devstack sudo[86055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:43:26 devstack sudo[86055]: pam_unix(sudo:session): session closed for user root Nov 06 17:43:26 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-fce709f1-5d06-45b5-bc89-428f31d7bdb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:43:26 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-fce709f1-5d06-45b5-bc89-428f31d7bdb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:43:26 devstack sudo[86064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 17:43:26 devstack sudo[86064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:43:27 devstack sudo[86064]: pam_unix(sudo:session): session closed for user root Nov 06 17:43:27 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-fce709f1-5d06-45b5-bc89-428f31d7bdb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:43:27 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-fce709f1-5d06-45b5-bc89-428f31d7bdb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:43:27 devstack sudo[86084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 17:43:27 devstack sudo[86084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:43:27 devstack sudo[86084]: pam_unix(sudo:session): session closed for user root Nov 06 17:43:27 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-fce709f1-5d06-45b5-bc89-428f31d7bdb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.268s {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:43:27 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-fce709f1-5d06-45b5-bc89-428f31d7bdb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:43:27 devstack sudo[86091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 17:43:27 devstack sudo[86091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:43:27 devstack sudo[86091]: pam_unix(sudo:session): session closed for user root Nov 06 17:43:27 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-fce709f1-5d06-45b5-bc89-428f31d7bdb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:43:27 devstack cinder-volume[76197]: DEBUG cinder.manager [None req-fce709f1-5d06-45b5-bc89-428f31d7bdb9 None None] Notifying Schedulers of capabilities ... {{(pid=76197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:43:29 devstack cinder-volume[76058]: INFO oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] Caught SIGTERM, stopping children Nov 06 17:43:29 devstack cinder-volume[76058]: DEBUG oslo_concurrency.lockutils [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] Acquiring lock "singleton_lock" {{(pid=76058) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 17:43:29 devstack cinder-volume[76058]: DEBUG oslo_concurrency.lockutils [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] Acquired lock "singleton_lock" {{(pid=76058) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 17:43:29 devstack cinder-volume[76058]: DEBUG oslo_concurrency.lockutils [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] Releasing lock "singleton_lock" {{(pid=76058) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 17:43:29 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] Stop services. {{(pid=76058) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 06 17:43:29 devstack cinder-volume[76058]: DEBUG oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] Killing children. {{(pid=76058) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 06 17:43:29 devstack cinder-volume[76058]: INFO oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] Waiting on 1 children to exit Nov 06 17:43:33 devstack cinder-volume[76197]: DEBUG oslo_concurrency.lockutils [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] Acquiring lock "singleton_lock" {{(pid=76197) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 17:43:33 devstack cinder-volume[76197]: DEBUG oslo_concurrency.lockutils [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] Acquired lock "singleton_lock" {{(pid=76197) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 17:43:33 devstack cinder-volume[76197]: DEBUG oslo_concurrency.lockutils [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] Releasing lock "singleton_lock" {{(pid=76197) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 17:43:33 devstack cinder-volume[76197]: WARNING amqp [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 06 17:43:33 devstack cinder-volume[76197]: WARNING amqp [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 06 17:43:33 devstack cinder-volume[76058]: INFO oslo_service.backend._eventlet.service [None req-a1308196-8562-4bde-91d6-39f575a67253 None None] Child 76197 exited with status 0 Nov 06 17:43:33 devstack cinder-volume[86246]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 06 17:43:33 devstack cinder-volume[86246]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 06 17:43:33 devstack cinder-volume[86246]: we strongly recommend against using it for new projects. Nov 06 17:43:33 devstack cinder-volume[86246]: If you are already using Eventlet, we recommend migrating to a different Nov 06 17:43:33 devstack cinder-volume[86246]: framework. For more detail see Nov 06 17:43:33 devstack cinder-volume[86246]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 06 17:43:33 devstack cinder-volume[86246]: import eventlet # noqa Nov 06 17:43:35 devstack cinder-volume[86246]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86246) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 17:43:35 devstack cinder-volume[86246]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86246) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 17:43:35 devstack cinder-volume[86246]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86246) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 17:43:36 devstack cinder-volume[86246]: INFO dbcounter [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] Registered counter for database cinder Nov 06 17:43:36 devstack cinder-volume[86246]: DEBUG oslo_db.sqlalchemy.engines [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86246) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 17:43:36 devstack cinder-volume[86246]: DEBUG dbcounter [-] [86246] Writer thread running {{(pid=86246) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 17:43:36 devstack cinder-volume[86246]: INFO cinder.rpc [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 06 17:43:36 devstack cinder-volume[86246]: INFO cinder.rpc [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_db.sqlalchemy.engines [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86246) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 17:43:37 devstack cinder-volume[86246]: INFO cinder.volume.manager [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] Determined volume DB was empty at startup. Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG cinder.volume.manager [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86246) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 06 17:43:37 devstack cinder-volume[86246]: INFO cinder.volume.manager [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 06 17:43:37 devstack cinder-volume[86246]: WARNING stevedore.named [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 17:43:37 devstack cinder-volume[86246]: WARNING castellan.key_manager [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 17:43:37 devstack cinder-volume[86246]: WARNING cinder.keymgr.conf_key_mgr [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 17:43:37 devstack cinder-volume[86246]: INFO cinder.volume.manager [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_db.sqlalchemy.engines [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86246) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 17:43:37 devstack cinder-volume[86246]: INFO oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] Starting 1 workers Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] Started child 86463 {{(pid=86246) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] Full set of CONF: {{(pid=86246) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] ******************************************************************************** {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] Configuration options gathered from: {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] ================================================================================ {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] allow_availability_zone_fallback = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] allow_compression_on_image_upload = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] allowed_direct_url_schemes = [] {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] api_rate_limit = True {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] auth_strategy = keystone {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_availability_zone = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86463]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_host = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_name = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_stats_polling_interval = 60 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backup_api_class = cinder.backup.api.API {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backup_name_template = backup-%s {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backup_use_same_host = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backup_use_temp_snapshot = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] chap_password = **** {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] chap_username = {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] cinder_internal_tenant_project_id = d6b19e64c69247f0a7abe61b0152cd4c {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] cinder_internal_tenant_user_id = d952e618bde04ca0aeb163831b6b09e3 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] cluster = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] compression_format = gzip {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] compute_api_class = cinder.compute.nova.API {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] config_dir = [] {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] config_source = [] {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] control_exchange = openstack {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] debug = True {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] default_availability_zone = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] default_group_type = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] default_volume_type = QuobyteHD {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] disk_geometry = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] driver_client_cert = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] driver_client_cert_key = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] driver_data_namespace = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] driver_ssl_cert_path = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] driver_ssl_cert_verify = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] driver_use_ssl = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] enable_new_services = True {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] enable_unsupported_driver = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] enabled_backends = ['QuobyteHD'] {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] enforce_multipath_for_image_xfer = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] filter_function = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] glance_api_insecure = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] glance_api_servers = ['http://192.168.122.117/image'] {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] glance_api_ssl_compression = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] glance_ca_certificates_file = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] glance_catalog_info = image:glance:publicURL {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] glance_certfile = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] glance_keyfile = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] glance_num_retries = 3 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] glance_request_timeout = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] goodness_function = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] graceful_shutdown_timeout = 5 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] group_api_class = cinder.group.api.API {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] host = devstack {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] image_compress_on_upload = True {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] image_conversion_address_space_limit = 1 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] image_conversion_cpu_limit = 60 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] image_conversion_disable = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] image_introspection_address_space_limit = 1 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] image_introspection_cpu_limit = 60 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] image_upload_use_cinder_backend = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] image_upload_use_internal_tenant = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] image_volume_cache_enabled = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] image_volume_cache_max_count = 0 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] image_volume_cache_max_size_gb = 0 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] init_host_max_objects_retrieval = 0 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] instance_format = [instance: %(uuid)s] {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] iscsi_target_flags = {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] iscsi_write_cache = on {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] iser_helper = tgtadm {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] iser_ip_address = 192.168.122.117 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] iser_port = 3260 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] log_color = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] log_config_append = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] log_dir = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] log_file = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] log_options = True {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] log_rotate_interval = 1 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] log_rotate_interval_type = days {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] log_rotation_type = none {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] max_age = 0 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] max_logfile_count = 30 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] max_logfile_size_mb = 200 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] max_over_subscription_ratio = 20.0 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86463]: INFO cinder.volume.manager [None req-d974d5f8-33b3-4e71-b775-6bc73a3b1cce None None] Starting volume driver QuobyteDriver (1.2.1) Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] message_reap_interval = 86400 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] message_ttl = 2592000 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] migration_create_volume_timeout_secs = 300 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] monkey_patch = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] monkey_patch_modules = [] {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] my_ip = 192.168.122.117 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86463]: DEBUG cinder.volume.drivers.remotefs [None req-d974d5f8-33b3-4e71-b775-6bc73a3b1cce None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86463) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] no_snapshot_gb_quota = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] num_iser_scan_tries = 3 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] num_shell_tries = 3 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] num_volume_device_scan_tries = 3 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] nvmeof_conn_info_version = 1 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] nvmet_ns_id = 10 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] nvmet_port_id = 1 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] osapi_max_limit = 1000 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] osapi_volume_ext_list = [] {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] osapi_volume_listen = 0.0.0.0 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] osapi_volume_listen_port = 8776 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] osapi_volume_use_ssl = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] osapi_volume_workers = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] per_volume_size_limit = -1 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] periodic_fuzzy_delay = 60 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] periodic_interval = 60 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] project_id_regex = [0-9a-f\-]+ {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] public_endpoint = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] publish_errors = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] quota_backup_gigabytes = 1000 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] quota_backups = 10 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] quota_gigabytes = 1000 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] quota_groups = 10 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] quota_snapshots = 10 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] quota_volumes = 10 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] rate_limit_burst = 0 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] rate_limit_except_level = CRITICAL {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] rate_limit_interval = 0 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] reinit_driver_count = 3 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] replication_device = **** {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] report_discard_supported = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] report_interval = 120 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] reservation_clean_interval = 86400 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] reservation_expire = 86400 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] reserved_image_namespaces = [] {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] reserved_percentage = 0 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] rpc_response_timeout = 120 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] run_external_periodic_tasks = True {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] scst_target_driver = iscsi {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] scst_target_iqn_name = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] service_down_time = 720 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] shell_completion = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] snapshot_name_template = snapshot-%s {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] split_loggers = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] state_path = /opt/stack/data/cinder {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] storage_availability_zone = nova {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] storage_protocol = iSCSI {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] syslog_log_facility = LOG_USER {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] target_helper = lioadm {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] target_ip_address = 192.168.122.117 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] target_port = 3260 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] target_protocol = iscsi {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] target_secondary_ip_addresses = [] {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] trace_flags = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] transfer_api_class = cinder.transfer.api.API {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] transport_url = **** {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] until_refresh = 0 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] use_chap_auth = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] use_default_quota_class = True {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] use_journal = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] use_json = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] use_multipath_for_image_xfer = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] use_stderr = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] use_syslog = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] verify_glance_signatures = enabled {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] volume_api_class = cinder.volume.api.API {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] volume_backend_name = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] volume_clear = zero {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] volume_clear_ionice = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] volume_clear_size = 0 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] volume_copy_bps_limit = 0 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] volume_dd_blocksize = 1M {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] volume_name_template = volume-%s {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] volume_service_inithost_offload = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] volume_usage_audit_period = month {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] zoning_mode = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_concurrency.disable_process_locking = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] keystone_authtoken.auth_section = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] keystone_authtoken.auth_type = password {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] keystone_authtoken.auth_version = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] keystone_authtoken.cache = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] keystone_authtoken.certfile = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] keystone_authtoken.delay_auth_decision = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] keystone_authtoken.http_connect_timeout = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] keystone_authtoken.include_service_catalog = True {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] keystone_authtoken.insecure = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] keystone_authtoken.interface = public {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] keystone_authtoken.keyfile = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] keystone_authtoken.memcache_password = **** {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] keystone_authtoken.memcache_username = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] keystone_authtoken.region_name = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] keystone_authtoken.service_token_roles_required = True {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] keystone_authtoken.service_type = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] keystone_authtoken.token_cache_time = 300 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.117/identity {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] cache.backend = dogpile.cache.null {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] cache.backend_argument = **** {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] cache.backend_expiration_time = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] cache.config_prefix = cache.oslo {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] cache.debug_cache_backend = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] cache.enable_retry_client = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] cache.enable_socket_keepalive = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] cache.enabled = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] cache.expiration_time = 600 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] cache.hashclient_retry_attempts = 2 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] cache.memcache_dead_retry = 300 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] cache.memcache_pool_maxsize = 10 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] cache.memcache_sasl_enabled = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] cache.password = **** {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] cache.proxies = [] {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] cache.redis_db = 0 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] cache.redis_sentinel_service_name = mymaster {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] cache.redis_server = localhost:6379 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] cache.retry_attempts = 2 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] cache.retry_delay = 0.0 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] cache.socket_keepalive_count = 1 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] cache.socket_keepalive_idle = 1 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] cache.socket_keepalive_interval = 1 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] cache.socket_timeout = 1.0 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] cache.tls_allowed_ciphers = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] cache.tls_cafile = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] cache.tls_certfile = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] cache.tls_enabled = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] cache.tls_keyfile = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] cache.username = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86463]: DEBUG cinder.volume.drivers.quobyte [None req-d974d5f8-33b3-4e71-b775-6bc73a3b1cce None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86463) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 06 17:43:37 devstack cinder-volume[86463]: WARNING cinder.volume.drivers.quobyte [None req-d974d5f8-33b3-4e71-b775-6bc73a3b1cce None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 06 17:43:37 devstack cinder-volume[86463]: WARNING cinder.volume.drivers.quobyte [None req-d974d5f8-33b3-4e71-b775-6bc73a3b1cce None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] coordination.backend_url = **** {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] database.asyncio_connection = **** {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] database.asyncio_slave_connection = **** {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] database.backend = sqlalchemy {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] database.connection = **** {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] database.connection_debug = 0 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] database.connection_parameters = {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] database.connection_recycle_time = 3600 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] database.connection_trace = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] database.db_inc_retry_interval = True {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] database.db_max_retries = 20 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86463]: DEBUG oslo_concurrency.processutils [None req-d974d5f8-33b3-4e71-b775-6bc73a3b1cce None None] Running cmd (subprocess): mount.quobyte {{(pid=86463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] database.db_max_retry_interval = 10 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] database.db_retry_interval = 1 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] database.max_overflow = 50 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] database.max_pool_size = 5 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] database.max_retries = 10 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] database.mysql_wsrep_sync_wait = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] database.pool_timeout = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] database.retry_interval = 10 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] database.slave_connection = **** {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] database.sqlite_synchronous = True {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] database.synchronous_reader = True {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] database.use_db_reconnect = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_messaging_tracing.insecure = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] profiler.connection_string = messaging:// {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] profiler.enabled = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] profiler.es_doc_type = notification {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] profiler.es_scroll_size = 10000 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] profiler.es_scroll_time = 2m {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] profiler.filter_error_trace = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] profiler.hmac_keys = **** {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] profiler.sentinel_service_name = mymaster {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] profiler.socket_timeout = 0.1 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] profiler.trace_requests = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] profiler.trace_sqlalchemy = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] profiler_jaeger.process_tags = {} {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] profiler_jaeger.service_name_prefix = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] profiler_otlp.service_name_prefix = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_policy.enforce_new_defaults = True {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_policy.policy_default_rule = default {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_policy.policy_file = policy.yaml {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_policy.remote_timeout = 60.0 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] privsep_osbrick.group = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] privsep_osbrick.helper_command = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] privsep_osbrick.user = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] cinder_sys_admin.group = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] cinder_sys_admin.helper_command = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] cinder_sys_admin.user = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] service_user.auth_section = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] service_user.auth_type = password {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] service_user.cafile = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] service_user.certfile = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] service_user.collect_timing = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] service_user.insecure = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] service_user.keyfile = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] service_user.send_service_user_token = True {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] service_user.split_loggers = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] service_user.timeout = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] service_user.tls_ciphers = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] service_user.tls_min_version = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] glance.auth_section = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] glance.auth_type = password {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] glance.certfile = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] glance.collect_timing = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] glance.insecure = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] glance.keyfile = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] glance.region_name = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] glance.split_loggers = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] glance.timeout = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] glance.tls_ciphers = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] glance.tls_min_version = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.backend_availability_zone = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.chap_password = **** {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.chap_username = {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.disk_geometry = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.driver_client_cert = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.driver_client_cert_key = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.driver_data_namespace = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.driver_use_ssl = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.enable_unsupported_driver = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.extra_capabilities = {} {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.filter_function = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.goodness_function = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.iscsi_target_flags = {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.iscsi_write_cache = on {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.iser_helper = tgtadm {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.iser_ip_address = 192.168.122.117 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.iser_port = 3260 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.nas_host = {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.nas_login = admin {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.nas_mount_options = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.nas_password = **** {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.nas_private_key = {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.nas_share_path = {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.nas_ssh_port = 22 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.num_shell_tries = 3 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.nvmet_port_id = 1 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.quobyte_client_cfg = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.quobyte_volume_url = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.replication_device = **** {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.report_discard_supported = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.reserved_percentage = 0 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.scst_target_driver = iscsi {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.scst_target_iqn_name = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.storage_protocol = iSCSI {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.target_helper = tgtadm {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.target_ip_address = 192.168.122.117 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.target_port = 3260 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.target_protocol = iscsi {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.trace_flags = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.unique_fqdn_network = True {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.use_chap_auth = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.volume_backend_name = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.volume_clear = zero {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.volume_clear_ionice = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.volume_clear_size = 0 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_reports.file_event_handler = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_reports.log_dir = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.backend_availability_zone = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.backend_host = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.chap_password = **** {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.chap_username = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.chiscsi_conf = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.disk_geometry = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.driver_client_cert = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.driver_client_cert_key = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.driver_data_namespace = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.driver_use_ssl = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.extra_capabilities = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.filter_function = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.goodness_function = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.iscsi_target_flags = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.iscsi_write_cache = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.iser_helper = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.iser_ip_address = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.iser_port = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.iser_target_prefix = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.nas_host = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.nas_login = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.nas_mount_options = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.nas_password = **** {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.nas_private_key = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.nas_share_path = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.nas_ssh_port = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.num_shell_tries = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.nvmet_ns_id = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.nvmet_port_id = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.replication_device = **** {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.report_discard_supported = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.reserved_percentage = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.scst_target_driver = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.storage_protocol = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.target_helper = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.target_ip_address = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.target_port = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.target_prefix = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.target_protocol = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.trace_flags = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.unique_fqdn_network = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.use_chap_auth = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.volume_clear = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.volume_clear_ionice = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.volume_clear_size = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] QuobyteHD.volumes_dir = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_messaging_rabbit.ssl = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_messaging_rabbit.ssl_version = {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_messaging_notifications.driver = [] {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_messaging_notifications.retry = -1 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] oslo_messaging_notifications.transport_url = **** {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] key_manager.fixed_key = **** {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] barbican.barbican_api_version = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] barbican.barbican_endpoint = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] barbican.barbican_endpoint_type = public {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] barbican.barbican_region_name = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] barbican.cafile = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] barbican.certfile = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] barbican.collect_timing = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] barbican.insecure = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] barbican.keyfile = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] barbican.number_of_retries = 60 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] barbican.retry_delay = 1 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] barbican.send_service_user_token = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] barbican.split_loggers = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] barbican.timeout = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] barbican.tls_ciphers = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] barbican.tls_min_version = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] barbican.verify_ssl = True {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] barbican.verify_ssl_path = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] barbican_service_user.auth_section = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] barbican_service_user.auth_type = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] barbican_service_user.cafile = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] barbican_service_user.certfile = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] barbican_service_user.collect_timing = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] barbican_service_user.insecure = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] barbican_service_user.keyfile = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] barbican_service_user.split_loggers = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] barbican_service_user.timeout = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] barbican_service_user.tls_ciphers = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] barbican_service_user.tls_min_version = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] vault.approle_role_id = **** {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] vault.approle_secret_id = **** {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] vault.auth_method = approle {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] vault.auth_path = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] vault.kv_mountpoint = secret {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] vault.kv_path = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] vault.kv_version = 2 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] vault.namespace = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack quobyte-client[86468]: Reading configuration file: /etc/quobyte/client.cfg Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] vault.root_token_id = **** {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] vault.ssl_ca_crt_file = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] vault.timeout = 60.0 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] vault.token_file = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] vault.token_role = None {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] vault.use_ssl = False {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack quobyte-client[86468]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:37 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] ******************************************************************************** {{(pid=86246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 06 17:43:37 devstack cinder-volume[86463]: DEBUG oslo_concurrency.processutils [None req-d974d5f8-33b3-4e71-b775-6bc73a3b1cce None None] CMD "mount.quobyte" returned: 1 in 0.147s {{(pid=86463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:43:37 devstack cinder-volume[86463]: DEBUG oslo_concurrency.lockutils [None req-d974d5f8-33b3-4e71-b775-6bc73a3b1cce None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:43:37 devstack cinder-volume[86463]: DEBUG oslo_concurrency.lockutils [None req-d974d5f8-33b3-4e71-b775-6bc73a3b1cce None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:43:37 devstack cinder-volume[86463]: DEBUG cinder.volume.drivers.quobyte [None req-d974d5f8-33b3-4e71-b775-6bc73a3b1cce None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=86463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:43:37 devstack cinder-volume[86463]: INFO cinder.volume.drivers.quobyte [None req-d974d5f8-33b3-4e71-b775-6bc73a3b1cce None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 ... Nov 06 17:43:37 devstack cinder-volume[86463]: DEBUG oslo_concurrency.processutils [None req-d974d5f8-33b3-4e71-b775-6bc73a3b1cce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 -c /etc/quobyte/client-cinder.cfg {{(pid=86463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:43:37 devstack sudo[86469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 -c /etc/quobyte/client-cinder.cfg Nov 06 17:43:37 devstack sudo[86469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:43:38 devstack sudo[86469]: pam_unix(sudo:session): session closed for user root Nov 06 17:43:38 devstack cinder-volume[86463]: DEBUG oslo_concurrency.processutils [None req-d974d5f8-33b3-4e71-b775-6bc73a3b1cce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.419s {{(pid=86463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:43:38 devstack cinder-volume[86463]: INFO cinder.volume.drivers.quobyte [None req-d974d5f8-33b3-4e71-b775-6bc73a3b1cce None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 succeeded Nov 06 17:43:38 devstack cinder-volume[86463]: DEBUG cinder.volume.drivers.quobyte [None req-d974d5f8-33b3-4e71-b775-6bc73a3b1cce None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=86463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:43:38 devstack cinder-volume[86463]: DEBUG oslo_concurrency.lockutils [None req-d974d5f8-33b3-4e71-b775-6bc73a3b1cce None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.432s {{(pid=86463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:43:38 devstack cinder-volume[86463]: DEBUG oslo_concurrency.processutils [None req-d974d5f8-33b3-4e71-b775-6bc73a3b1cce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=86463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:43:38 devstack sudo[86571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:43:38 devstack sudo[86571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:43:38 devstack sudo[86571]: pam_unix(sudo:session): session closed for user root Nov 06 17:43:38 devstack cinder-volume[86463]: DEBUG oslo_concurrency.processutils [None req-d974d5f8-33b3-4e71-b775-6bc73a3b1cce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.239s {{(pid=86463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:43:38 devstack cinder-volume[86463]: INFO cinder.volume.driver [None req-d974d5f8-33b3-4e71-b775-6bc73a3b1cce None None] Driver hasn't implemented _init_vendor_properties() Nov 06 17:43:38 devstack cinder-volume[86463]: DEBUG cinder.volume.driver [None req-d974d5f8-33b3-4e71-b775-6bc73a3b1cce None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8181610107422, 'free_capacity_gb': 1773.8181610107422, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86463) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 06 17:43:38 devstack cinder-volume[86463]: DEBUG oslo_db.sqlalchemy.engines [None req-d974d5f8-33b3-4e71-b775-6bc73a3b1cce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86463) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 17:43:38 devstack cinder-volume[86463]: DEBUG dbcounter [-] [86463] Writer thread running {{(pid=86463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 17:43:38 devstack cinder-volume[86463]: DEBUG cinder.db.api [None req-d974d5f8-33b3-4e71-b775-6bc73a3b1cce None None] Building query based on filter {{(pid=86463) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}} Nov 06 17:43:38 devstack cinder-volume[86463]: DEBUG cinder.image.image_utils [None req-d974d5f8-33b3-4e71-b775-6bc73a3b1cce None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86463) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 06 17:43:38 devstack cinder-volume[86463]: INFO cinder.keymgr.migration [None req-17995195-958d-4980-9e81-9549b4c79f7b None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 06 17:43:38 devstack cinder-volume[86463]: DEBUG oslo_concurrency.lockutils [None req-d974d5f8-33b3-4e71-b775-6bc73a3b1cce None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:43:38 devstack cinder-volume[86463]: DEBUG oslo_concurrency.lockutils [None req-d974d5f8-33b3-4e71-b775-6bc73a3b1cce None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:43:38 devstack cinder-volume[86463]: DEBUG cinder.volume.drivers.quobyte [None req-d974d5f8-33b3-4e71-b775-6bc73a3b1cce None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=86463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:43:38 devstack cinder-volume[86463]: DEBUG cinder.volume.drivers.quobyte [None req-d974d5f8-33b3-4e71-b775-6bc73a3b1cce None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=86463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:43:38 devstack cinder-volume[86463]: DEBUG oslo_concurrency.lockutils [None req-d974d5f8-33b3-4e71-b775-6bc73a3b1cce None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:43:38 devstack cinder-volume[86463]: DEBUG oslo_concurrency.processutils [None req-d974d5f8-33b3-4e71-b775-6bc73a3b1cce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=86463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:43:38 devstack sudo[86608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:43:38 devstack sudo[86608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:43:38 devstack sudo[86608]: pam_unix(sudo:session): session closed for user root Nov 06 17:43:38 devstack cinder-volume[86463]: DEBUG oslo_concurrency.processutils [None req-d974d5f8-33b3-4e71-b775-6bc73a3b1cce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.335s {{(pid=86463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:43:38 devstack cinder-volume[86463]: DEBUG cinder.manager [None req-d974d5f8-33b3-4e71-b775-6bc73a3b1cce None None] Notifying Schedulers of capabilities ... {{(pid=86463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:43:38 devstack cinder-volume[86463]: INFO cinder.volume.manager [None req-d974d5f8-33b3-4e71-b775-6bc73a3b1cce None None] Driver initialization completed successfully. Nov 06 17:43:38 devstack cinder-volume[86463]: INFO cinder.manager [None req-d974d5f8-33b3-4e71-b775-6bc73a3b1cce None None] Initiating service 3 cleanup Nov 06 17:43:38 devstack cinder-volume[86463]: INFO cinder.manager [None req-d974d5f8-33b3-4e71-b775-6bc73a3b1cce None None] Service 3 cleanup completed. Nov 06 17:43:38 devstack cinder-volume[86463]: DEBUG cinder.service [None req-d974d5f8-33b3-4e71-b775-6bc73a3b1cce None None] Creating RPC server for service cinder-volume {{(pid=86463) start /opt/stack/cinder/cinder/service.py:231}} Nov 06 17:43:38 devstack cinder-volume[86463]: DEBUG cinder.service [None req-d974d5f8-33b3-4e71-b775-6bc73a3b1cce None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86463) start /opt/stack/cinder/cinder/service.py:237}} Nov 06 17:43:39 devstack cinder-volume[86463]: INFO cinder.volume.manager [None req-d974d5f8-33b3-4e71-b775-6bc73a3b1cce None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 06 17:43:39 devstack cinder-volume[86463]: DEBUG oslo_concurrency.lockutils [None req-d974d5f8-33b3-4e71-b775-6bc73a3b1cce None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:43:39 devstack cinder-volume[86463]: DEBUG oslo_concurrency.lockutils [None req-d974d5f8-33b3-4e71-b775-6bc73a3b1cce None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:43:39 devstack cinder-volume[86463]: DEBUG cinder.volume.drivers.quobyte [None req-d974d5f8-33b3-4e71-b775-6bc73a3b1cce None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=86463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:43:39 devstack cinder-volume[86463]: DEBUG cinder.volume.drivers.quobyte [None req-d974d5f8-33b3-4e71-b775-6bc73a3b1cce None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=86463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:43:39 devstack cinder-volume[86463]: DEBUG oslo_concurrency.lockutils [None req-d974d5f8-33b3-4e71-b775-6bc73a3b1cce None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:43:39 devstack cinder-volume[86463]: DEBUG oslo_concurrency.processutils [None req-d974d5f8-33b3-4e71-b775-6bc73a3b1cce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=86463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:43:39 devstack sudo[86613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:43:39 devstack sudo[86613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:43:39 devstack sudo[86613]: pam_unix(sudo:session): session closed for user root Nov 06 17:43:39 devstack cinder-volume[86463]: DEBUG oslo_concurrency.processutils [None req-d974d5f8-33b3-4e71-b775-6bc73a3b1cce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.247s {{(pid=86463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:43:39 devstack cinder-volume[86463]: INFO cinder.volume.manager [None req-d974d5f8-33b3-4e71-b775-6bc73a3b1cce None None] Driver post RPC initialization completed successfully. Nov 06 17:43:42 devstack cinder-volume[86246]: INFO oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] Caught SIGTERM, stopping children Nov 06 17:43:42 devstack cinder-volume[86246]: DEBUG oslo_concurrency.lockutils [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] Acquiring lock "singleton_lock" {{(pid=86246) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 17:43:42 devstack cinder-volume[86246]: DEBUG oslo_concurrency.lockutils [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] Acquired lock "singleton_lock" {{(pid=86246) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 17:43:42 devstack cinder-volume[86246]: DEBUG oslo_concurrency.lockutils [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] Releasing lock "singleton_lock" {{(pid=86246) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 17:43:42 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] Stop services. {{(pid=86246) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 06 17:43:42 devstack cinder-volume[86246]: DEBUG oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] Killing children. {{(pid=86246) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 06 17:43:42 devstack cinder-volume[86246]: INFO oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] Waiting on 1 children to exit Nov 06 17:43:43 devstack cinder-volume[86463]: DEBUG oslo_concurrency.lockutils [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] Acquiring lock "singleton_lock" {{(pid=86463) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 17:43:43 devstack cinder-volume[86463]: DEBUG oslo_concurrency.lockutils [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] Acquired lock "singleton_lock" {{(pid=86463) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 17:43:43 devstack cinder-volume[86463]: DEBUG oslo_concurrency.lockutils [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] Releasing lock "singleton_lock" {{(pid=86463) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 17:43:43 devstack cinder-volume[86463]: WARNING amqp [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 06 17:43:43 devstack cinder-volume[86463]: WARNING amqp [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 06 17:43:43 devstack cinder-volume[86246]: INFO oslo_service.backend._eventlet.service [None req-ce1db344-2012-4d0c-b668-38b6fdf644ff None None] Child 86463 exited with status 0 Nov 06 17:43:43 devstack cinder-volume[86806]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 06 17:43:43 devstack cinder-volume[86806]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 06 17:43:43 devstack cinder-volume[86806]: we strongly recommend against using it for new projects. Nov 06 17:43:43 devstack cinder-volume[86806]: If you are already using Eventlet, we recommend migrating to a different Nov 06 17:43:43 devstack cinder-volume[86806]: framework. For more detail see Nov 06 17:43:43 devstack cinder-volume[86806]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 06 17:43:43 devstack cinder-volume[86806]: import eventlet # noqa Nov 06 17:43:46 devstack cinder-volume[86806]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86806) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 17:43:46 devstack cinder-volume[86806]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86806) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 17:43:46 devstack cinder-volume[86806]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86806) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 17:43:47 devstack cinder-volume[86806]: INFO dbcounter [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] Registered counter for database cinder Nov 06 17:43:47 devstack cinder-volume[86806]: DEBUG oslo_db.sqlalchemy.engines [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86806) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG dbcounter [-] [86806] Writer thread running {{(pid=86806) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 17:43:48 devstack cinder-volume[86806]: INFO cinder.rpc [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 06 17:43:48 devstack cinder-volume[86806]: INFO cinder.rpc [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_db.sqlalchemy.engines [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86806) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 17:43:48 devstack cinder-volume[86806]: INFO cinder.volume.manager [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] Determined volume DB was empty at startup. Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG cinder.volume.manager [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86806) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 06 17:43:48 devstack cinder-volume[86806]: WARNING stevedore.named [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 17:43:48 devstack cinder-volume[86806]: WARNING castellan.key_manager [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 17:43:48 devstack cinder-volume[86806]: WARNING cinder.keymgr.conf_key_mgr [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 17:43:48 devstack cinder-volume[86806]: INFO cinder.volume.manager [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_db.sqlalchemy.engines [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86806) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 17:43:48 devstack cinder-volume[86806]: INFO oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] Starting 1 workers Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] Started child 87068 {{(pid=86806) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] Full set of CONF: {{(pid=86806) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] ******************************************************************************** {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] Configuration options gathered from: {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] ================================================================================ {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] allow_availability_zone_fallback = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] allow_compression_on_image_upload = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] allowed_direct_url_schemes = [] {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] api_rate_limit = True {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] auth_strategy = keystone {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_availability_zone = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_host = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_name = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[87068]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_stats_polling_interval = 60 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backup_api_class = cinder.backup.api.API {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backup_name_template = backup-%s {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backup_use_same_host = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backup_use_temp_snapshot = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] chap_password = **** {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] chap_username = {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] cinder_internal_tenant_project_id = d6b19e64c69247f0a7abe61b0152cd4c {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] cinder_internal_tenant_user_id = d952e618bde04ca0aeb163831b6b09e3 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] cluster = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] compression_format = gzip {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] compute_api_class = cinder.compute.nova.API {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] config_dir = [] {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] config_source = [] {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] control_exchange = openstack {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] debug = True {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] default_availability_zone = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] default_group_type = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] default_volume_type = QuobyteHD {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] disk_geometry = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] driver_client_cert = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] driver_client_cert_key = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] driver_data_namespace = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] driver_ssl_cert_path = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] driver_ssl_cert_verify = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] driver_use_ssl = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] enable_new_services = True {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] enable_unsupported_driver = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] enabled_backends = ['QuobyteHD'] {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] enforce_multipath_for_image_xfer = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] filter_function = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] glance_api_insecure = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] glance_api_servers = ['http://192.168.122.117/image'] {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] glance_api_ssl_compression = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] glance_ca_certificates_file = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] glance_catalog_info = image:glance:publicURL {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] glance_certfile = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] glance_keyfile = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] glance_num_retries = 3 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] glance_request_timeout = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] goodness_function = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] graceful_shutdown_timeout = 5 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] group_api_class = cinder.group.api.API {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] host = devstack {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] image_compress_on_upload = True {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] image_conversion_address_space_limit = 1 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] image_conversion_cpu_limit = 60 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] image_conversion_disable = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] image_introspection_address_space_limit = 1 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] image_introspection_cpu_limit = 60 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] image_upload_use_cinder_backend = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] image_upload_use_internal_tenant = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] image_volume_cache_enabled = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] image_volume_cache_max_count = 0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] image_volume_cache_max_size_gb = 0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] init_host_max_objects_retrieval = 0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] instance_format = [instance: %(uuid)s] {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] iscsi_target_flags = {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] iscsi_write_cache = on {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] iser_helper = tgtadm {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] iser_ip_address = 192.168.122.117 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] iser_port = 3260 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] log_color = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] log_config_append = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] log_dir = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] log_file = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] log_options = True {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] log_rotate_interval = 1 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] log_rotate_interval_type = days {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] log_rotation_type = none {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-3a05d234-1c6c-41fa-a209-61ce956226c6 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] max_age = 0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-3a05d234-1c6c-41fa-a209-61ce956226c6 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87068) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] max_logfile_count = 30 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] max_logfile_size_mb = 200 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] max_over_subscription_ratio = 20.0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] message_reap_interval = 86400 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] message_ttl = 2592000 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] migration_create_volume_timeout_secs = 300 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] monkey_patch = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] monkey_patch_modules = [] {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] my_ip = 192.168.122.117 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] no_snapshot_gb_quota = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] num_iser_scan_tries = 3 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] num_shell_tries = 3 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] num_volume_device_scan_tries = 3 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] nvmeof_conn_info_version = 1 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] nvmet_ns_id = 10 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] nvmet_port_id = 1 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] osapi_max_limit = 1000 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] osapi_volume_ext_list = [] {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] osapi_volume_listen_port = 8776 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] osapi_volume_use_ssl = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] osapi_volume_workers = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] per_volume_size_limit = -1 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] periodic_fuzzy_delay = 60 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] periodic_interval = 60 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] public_endpoint = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] publish_errors = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] quota_backup_gigabytes = 1000 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] quota_backups = 10 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] quota_gigabytes = 1000 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] quota_groups = 10 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] quota_snapshots = 10 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] quota_volumes = 10 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] rate_limit_burst = 0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] rate_limit_except_level = CRITICAL {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] rate_limit_interval = 0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] reinit_driver_count = 3 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] replication_device = **** {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] report_discard_supported = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] report_interval = 120 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] reservation_clean_interval = 86400 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] reservation_expire = 86400 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] reserved_image_namespaces = [] {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] reserved_percentage = 0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] rpc_response_timeout = 120 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] run_external_periodic_tasks = True {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] scst_target_driver = iscsi {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] scst_target_iqn_name = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] service_down_time = 720 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] shell_completion = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] snapshot_name_template = snapshot-%s {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] split_loggers = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] state_path = /opt/stack/data/cinder {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] storage_availability_zone = nova {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] storage_protocol = iSCSI {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] syslog_log_facility = LOG_USER {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] target_helper = lioadm {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] target_ip_address = 192.168.122.117 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] target_port = 3260 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] target_protocol = iscsi {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] target_secondary_ip_addresses = [] {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] trace_flags = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] transport_url = **** {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] until_refresh = 0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] use_chap_auth = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] use_default_quota_class = True {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] use_journal = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] use_json = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] use_multipath_for_image_xfer = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] use_stderr = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] use_syslog = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] verify_glance_signatures = enabled {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] volume_api_class = cinder.volume.api.API {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] volume_backend_name = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] volume_clear = zero {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] volume_clear_ionice = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] volume_clear_size = 0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] volume_copy_bps_limit = 0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] volume_dd_blocksize = 1M {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] volume_name_template = volume-%s {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] volume_service_inithost_offload = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] volume_usage_audit_period = month {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] zoning_mode = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_concurrency.disable_process_locking = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] keystone_authtoken.auth_section = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] keystone_authtoken.auth_type = password {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] keystone_authtoken.auth_version = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] keystone_authtoken.cache = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] keystone_authtoken.certfile = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] keystone_authtoken.include_service_catalog = True {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] keystone_authtoken.insecure = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] keystone_authtoken.interface = public {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] keystone_authtoken.keyfile = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] keystone_authtoken.memcache_password = **** {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] keystone_authtoken.memcache_username = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] keystone_authtoken.region_name = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] keystone_authtoken.service_type = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.117/identity {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] cache.backend = dogpile.cache.null {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] cache.backend_argument = **** {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] cache.backend_expiration_time = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] cache.config_prefix = cache.oslo {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] cache.debug_cache_backend = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3a05d234-1c6c-41fa-a209-61ce956226c6 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87068) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 06 17:43:48 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.quobyte [None req-3a05d234-1c6c-41fa-a209-61ce956226c6 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] cache.enable_retry_client = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] cache.enable_socket_keepalive = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.quobyte [None req-3a05d234-1c6c-41fa-a209-61ce956226c6 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 06 17:43:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3a05d234-1c6c-41fa-a209-61ce956226c6 None None] Running cmd (subprocess): mount.quobyte {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] cache.enabled = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] cache.expiration_time = 600 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] cache.hashclient_retry_attempts = 2 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] cache.memcache_dead_retry = 300 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] cache.memcache_pool_maxsize = 10 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] cache.memcache_sasl_enabled = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] cache.password = **** {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] cache.proxies = [] {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] cache.redis_db = 0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] cache.redis_server = localhost:6379 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] cache.retry_attempts = 2 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] cache.retry_delay = 0.0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] cache.socket_keepalive_count = 1 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] cache.socket_keepalive_idle = 1 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] cache.socket_keepalive_interval = 1 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] cache.socket_timeout = 1.0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] cache.tls_allowed_ciphers = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] cache.tls_cafile = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] cache.tls_certfile = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] cache.tls_enabled = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] cache.tls_keyfile = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] cache.username = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] coordination.backend_url = **** {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] database.asyncio_connection = **** {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] database.asyncio_slave_connection = **** {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] database.backend = sqlalchemy {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] database.connection = **** {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] database.connection_debug = 0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] database.connection_parameters = {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] database.connection_recycle_time = 3600 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] database.connection_trace = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] database.db_inc_retry_interval = True {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] database.db_max_retries = 20 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] database.db_max_retry_interval = 10 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] database.db_retry_interval = 1 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:48 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] database.max_overflow = 50 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] database.max_pool_size = 5 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] database.max_retries = 10 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] database.mysql_wsrep_sync_wait = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] database.pool_timeout = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] database.retry_interval = 10 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] database.slave_connection = **** {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] database.sqlite_synchronous = True {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] database.synchronous_reader = True {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] database.use_db_reconnect = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_messaging_tracing.insecure = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] profiler.connection_string = messaging:// {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] profiler.enabled = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] profiler.es_doc_type = notification {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack quobyte-client[87077]: Reading configuration file: /etc/quobyte/client.cfg Nov 06 17:43:49 devstack quobyte-client[87077]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] profiler.es_scroll_size = 10000 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] profiler.es_scroll_time = 2m {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] profiler.filter_error_trace = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] profiler.hmac_keys = **** {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3a05d234-1c6c-41fa-a209-61ce956226c6 None None] CMD "mount.quobyte" returned: 1 in 0.111s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:43:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3a05d234-1c6c-41fa-a209-61ce956226c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:43:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3a05d234-1c6c-41fa-a209-61ce956226c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] profiler.sentinel_service_name = mymaster {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] profiler.socket_timeout = 0.1 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3a05d234-1c6c-41fa-a209-61ce956226c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] profiler.trace_requests = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] profiler.trace_sqlalchemy = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] profiler_jaeger.process_tags = {} {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] profiler_jaeger.service_name_prefix = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] profiler_otlp.service_name_prefix = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_policy.enforce_new_defaults = True {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_policy.policy_default_rule = default {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_policy.policy_file = policy.yaml {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] privsep_osbrick.group = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] privsep_osbrick.helper_command = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] privsep_osbrick.user = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] cinder_sys_admin.group = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] cinder_sys_admin.helper_command = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3a05d234-1c6c-41fa-a209-61ce956226c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] cinder_sys_admin.user = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3a05d234-1c6c-41fa-a209-61ce956226c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:43:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3a05d234-1c6c-41fa-a209-61ce956226c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] service_user.auth_section = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] service_user.auth_type = password {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] service_user.cafile = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] service_user.certfile = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] service_user.collect_timing = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] service_user.insecure = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] service_user.keyfile = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] service_user.send_service_user_token = True {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] service_user.split_loggers = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] service_user.timeout = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] service_user.tls_ciphers = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] service_user.tls_min_version = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] glance.auth_section = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] glance.auth_type = password {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] glance.certfile = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] glance.collect_timing = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] glance.insecure = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] glance.keyfile = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] glance.region_name = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] glance.split_loggers = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] glance.timeout = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] glance.tls_ciphers = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] glance.tls_min_version = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.backend_availability_zone = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.chap_password = **** {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.chap_username = {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.disk_geometry = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.driver_client_cert = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.driver_client_cert_key = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.driver_data_namespace = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.driver_use_ssl = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.extra_capabilities = {} {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.filter_function = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.goodness_function = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.iscsi_target_flags = {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.iscsi_write_cache = on {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.iser_helper = tgtadm {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.iser_ip_address = 192.168.122.117 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.iser_port = 3260 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.nas_host = {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.nas_login = admin {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.nas_mount_options = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.nas_password = **** {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.nas_private_key = {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.nas_share_path = {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.num_shell_tries = 3 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack sudo[87078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack sudo[87078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.quobyte_volume_url = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.replication_device = **** {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.report_discard_supported = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.reserved_percentage = 0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.target_helper = tgtadm {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.target_ip_address = 192.168.122.117 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.target_port = 3260 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.target_protocol = iscsi {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.trace_flags = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.unique_fqdn_network = True {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.use_chap_auth = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.volume_backend_name = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.volume_clear = zero {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.volume_clear_ionice = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.volume_clear_size = 0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_reports.file_event_handler = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_reports.log_dir = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.backend_availability_zone = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.backend_host = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.chap_password = **** {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.chap_username = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.chiscsi_conf = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.disk_geometry = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.driver_client_cert = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.driver_data_namespace = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.driver_use_ssl = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.extra_capabilities = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.filter_function = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.goodness_function = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.iser_helper = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.iser_ip_address = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.iser_port = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.iser_target_prefix = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.nas_host = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.nas_login = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.nas_mount_options = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.nas_password = **** {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.nas_private_key = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.nas_share_path = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.nas_ssh_port = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.num_shell_tries = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.nvmet_port_id = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.replication_device = **** {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.report_discard_supported = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.reserved_percentage = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.scst_target_driver = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.storage_protocol = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.target_helper = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.target_ip_address = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.target_port = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.target_prefix = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.target_protocol = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.trace_flags = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.use_chap_auth = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.volume_clear = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.volume_clear_size = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] QuobyteHD.volumes_dir = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_messaging_rabbit.ssl = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_messaging_notifications.driver = [] {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_messaging_notifications.retry = -1 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] key_manager.fixed_key = **** {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] barbican.barbican_api_version = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] barbican.barbican_endpoint = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] barbican.barbican_endpoint_type = public {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] barbican.barbican_region_name = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] barbican.cafile = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] barbican.certfile = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] barbican.collect_timing = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] barbican.insecure = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] barbican.keyfile = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] barbican.number_of_retries = 60 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] barbican.retry_delay = 1 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] barbican.send_service_user_token = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] barbican.split_loggers = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] barbican.timeout = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] barbican.tls_ciphers = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] barbican.tls_min_version = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] barbican.verify_ssl = True {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] barbican.verify_ssl_path = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] barbican_service_user.auth_section = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] barbican_service_user.auth_type = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] barbican_service_user.cafile = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] barbican_service_user.certfile = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] barbican_service_user.collect_timing = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] barbican_service_user.insecure = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] barbican_service_user.keyfile = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] barbican_service_user.split_loggers = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] barbican_service_user.timeout = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] barbican_service_user.tls_ciphers = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] barbican_service_user.tls_min_version = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] vault.approle_role_id = **** {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] vault.approle_secret_id = **** {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] vault.auth_method = approle {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] vault.auth_path = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] vault.kv_mountpoint = secret {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] vault.kv_path = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] vault.kv_version = 2 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] vault.namespace = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] vault.root_token_id = **** {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] vault.ssl_ca_crt_file = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] vault.timeout = 60.0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] vault.token_file = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] vault.token_role = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] vault.use_ssl = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 17:43:49 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-c202ecde-0643-4a71-8b85-90d8f1c13980 None None] ******************************************************************************** {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 06 17:43:49 devstack sudo[87078]: pam_unix(sudo:session): session closed for user root Nov 06 17:43:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3a05d234-1c6c-41fa-a209-61ce956226c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.371s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:43:49 devstack cinder-volume[87068]: INFO cinder.volume.driver [None req-3a05d234-1c6c-41fa-a209-61ce956226c6 None None] Driver hasn't implemented _init_vendor_properties() Nov 06 17:43:49 devstack cinder-volume[87068]: DEBUG cinder.volume.driver [None req-3a05d234-1c6c-41fa-a209-61ce956226c6 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8181610107422, 'free_capacity_gb': 1773.8181610107422, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87068) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 06 17:43:49 devstack cinder-volume[87068]: DEBUG oslo_db.sqlalchemy.engines [None req-3a05d234-1c6c-41fa-a209-61ce956226c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87068) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 17:43:49 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writer thread running {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 17:43:49 devstack cinder-volume[87068]: DEBUG cinder.db.api [None req-3a05d234-1c6c-41fa-a209-61ce956226c6 None None] Building query based on filter {{(pid=87068) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}} Nov 06 17:43:49 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-3a05d234-1c6c-41fa-a209-61ce956226c6 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87068) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 06 17:43:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3a05d234-1c6c-41fa-a209-61ce956226c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:43:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3a05d234-1c6c-41fa-a209-61ce956226c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:43:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3a05d234-1c6c-41fa-a209-61ce956226c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:43:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3a05d234-1c6c-41fa-a209-61ce956226c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:43:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3a05d234-1c6c-41fa-a209-61ce956226c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:43:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3a05d234-1c6c-41fa-a209-61ce956226c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:43:49 devstack cinder-volume[87068]: INFO cinder.keymgr.migration [None req-cb49084b-5471-458a-b77c-96ecf9a0d64e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 06 17:43:49 devstack sudo[87091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:43:49 devstack sudo[87091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:43:49 devstack sudo[87091]: pam_unix(sudo:session): session closed for user root Nov 06 17:43:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3a05d234-1c6c-41fa-a209-61ce956226c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.298s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:43:49 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-3a05d234-1c6c-41fa-a209-61ce956226c6 None None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:43:49 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-3a05d234-1c6c-41fa-a209-61ce956226c6 None None] Driver initialization completed successfully. Nov 06 17:43:49 devstack cinder-volume[87068]: INFO cinder.manager [None req-3a05d234-1c6c-41fa-a209-61ce956226c6 None None] Initiating service 3 cleanup Nov 06 17:43:49 devstack cinder-volume[87068]: INFO cinder.manager [None req-3a05d234-1c6c-41fa-a209-61ce956226c6 None None] Service 3 cleanup completed. Nov 06 17:43:49 devstack cinder-volume[87068]: DEBUG cinder.service [None req-3a05d234-1c6c-41fa-a209-61ce956226c6 None None] Creating RPC server for service cinder-volume {{(pid=87068) start /opt/stack/cinder/cinder/service.py:231}} Nov 06 17:43:49 devstack cinder-volume[87068]: DEBUG cinder.service [None req-3a05d234-1c6c-41fa-a209-61ce956226c6 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87068) start /opt/stack/cinder/cinder/service.py:237}} Nov 06 17:43:50 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-3a05d234-1c6c-41fa-a209-61ce956226c6 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 06 17:43:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3a05d234-1c6c-41fa-a209-61ce956226c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:43:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3a05d234-1c6c-41fa-a209-61ce956226c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:43:50 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3a05d234-1c6c-41fa-a209-61ce956226c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:43:50 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3a05d234-1c6c-41fa-a209-61ce956226c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:43:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3a05d234-1c6c-41fa-a209-61ce956226c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:43:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3a05d234-1c6c-41fa-a209-61ce956226c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:43:50 devstack sudo[87103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:43:50 devstack sudo[87103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:43:50 devstack sudo[87103]: pam_unix(sudo:session): session closed for user root Nov 06 17:43:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3a05d234-1c6c-41fa-a209-61ce956226c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.348s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:43:50 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-3a05d234-1c6c-41fa-a209-61ce956226c6 None None] Driver post RPC initialization completed successfully. Nov 06 17:43:54 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running periodic task VolumeManager._thread_info {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 17:43:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] thread count: 6 {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 17:43:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] thread info: [<_MainThread(MainThread, started 133940619505792)>, , , , , ] {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 17:43:58 devstack cinder-volume[86806]: DEBUG dbcounter [-] [86806] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86806) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 17:43:59 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=2 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 17:44:00 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 17:44:54 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 17:44:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:44:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:44:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:44:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:44:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:44:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:44:54 devstack sudo[87598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:44:54 devstack sudo[87598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:44:54 devstack sudo[87598]: pam_unix(sudo:session): session closed for user root Nov 06 17:44:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.528s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:44:55 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:44:55 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running periodic task VolumeManager._thread_info {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 17:44:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] thread count: 6 {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 17:44:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] thread info: [<_MainThread(MainThread, started 133940619505792)>, , , , , ] {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 17:45:13 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c1fec14-9087-4eb1-a513-396a8b12d556 tempest-VolumesAdminNegativeTest-82536966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:45:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7c1fec14-9087-4eb1-a513-396a8b12d556 tempest-VolumesAdminNegativeTest-82536966 None] Flow 'volume_create_manager' (d3db7595-fad0-4c26-adb9-0e974d5e81a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:45:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7c1fec14-9087-4eb1-a513-396a8b12d556 tempest-VolumesAdminNegativeTest-82536966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9564a2c6-d9d6-4f1b-83d4-bb747bf8b9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:45:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7c1fec14-9087-4eb1-a513-396a8b12d556 tempest-VolumesAdminNegativeTest-82536966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9564a2c6-d9d6-4f1b-83d4-bb747bf8b9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:45:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1875081948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3afedf0f-40c3-4af0-ae82-b5c53002d7be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5825c2620d9344aba7c2b68e1fab3234',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:45:14Z,use_quota=True,user_id='e5ee8d2b578342f9a102558db610176f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:45:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7c1fec14-9087-4eb1-a513-396a8b12d556 tempest-VolumesAdminNegativeTest-82536966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a3773a2-03df-41d0-b5fd-103de89e1b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:45:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7c1fec14-9087-4eb1-a513-396a8b12d556 tempest-VolumesAdminNegativeTest-82536966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a3773a2-03df-41d0-b5fd-103de89e1b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:45:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7c1fec14-9087-4eb1-a513-396a8b12d556 tempest-VolumesAdminNegativeTest-82536966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc111375-d265-456f-b215-ce355582e9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:45:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7c1fec14-9087-4eb1-a513-396a8b12d556 tempest-VolumesAdminNegativeTest-82536966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc111375-d265-456f-b215-ce355582e9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3afedf0f-40c3-4af0-ae82-b5c53002d7be', 'volume_name': 'volume-3afedf0f-40c3-4af0-ae82-b5c53002d7be', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:45:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7c1fec14-9087-4eb1-a513-396a8b12d556 tempest-VolumesAdminNegativeTest-82536966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b12fb4f4-e7c8-4737-a401-c39da8c5b6f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:45:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7c1fec14-9087-4eb1-a513-396a8b12d556 tempest-VolumesAdminNegativeTest-82536966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b12fb4f4-e7c8-4737-a401-c39da8c5b6f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:45:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7c1fec14-9087-4eb1-a513-396a8b12d556 tempest-VolumesAdminNegativeTest-82536966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdec0c55-3215-4c21-a8d6-189897eaafb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:45:13 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-7c1fec14-9087-4eb1-a513-396a8b12d556 tempest-VolumesAdminNegativeTest-82536966 None] Volume 3afedf0f-40c3-4af0-ae82-b5c53002d7be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3afedf0f-40c3-4af0-ae82-b5c53002d7be', 'volume_size': 1} Nov 06 17:45:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7c1fec14-9087-4eb1-a513-396a8b12d556 tempest-VolumesAdminNegativeTest-82536966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:45:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7c1fec14-9087-4eb1-a513-396a8b12d556 tempest-VolumesAdminNegativeTest-82536966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:45:13 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7c1fec14-9087-4eb1-a513-396a8b12d556 tempest-VolumesAdminNegativeTest-82536966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:45:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1875081948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3afedf0f-40c3-4af0-ae82-b5c53002d7be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5825c2620d9344aba7c2b68e1fab3234',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:45:14Z,use_quota=True,user_id='e5ee8d2b578342f9a102558db610176f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:45:13 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-7c1fec14-9087-4eb1-a513-396a8b12d556 tempest-VolumesAdminNegativeTest-82536966 None] Creating volume 3afedf0f-40c3-4af0-ae82-b5c53002d7be {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:45:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7c1fec14-9087-4eb1-a513-396a8b12d556 tempest-VolumesAdminNegativeTest-82536966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:45:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7c1fec14-9087-4eb1-a513-396a8b12d556 tempest-VolumesAdminNegativeTest-82536966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:45:13 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7c1fec14-9087-4eb1-a513-396a8b12d556 tempest-VolumesAdminNegativeTest-82536966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:45:13 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7c1fec14-9087-4eb1-a513-396a8b12d556 tempest-VolumesAdminNegativeTest-82536966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:45:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7c1fec14-9087-4eb1-a513-396a8b12d556 tempest-VolumesAdminNegativeTest-82536966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:45:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7c1fec14-9087-4eb1-a513-396a8b12d556 tempest-VolumesAdminNegativeTest-82536966 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:45:14 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-7c1fec14-9087-4eb1-a513-396a8b12d556 tempest-VolumesAdminNegativeTest-82536966 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:45:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7c1fec14-9087-4eb1-a513-396a8b12d556 tempest-VolumesAdminNegativeTest-82536966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3afedf0f-40c3-4af0-ae82-b5c53002d7be 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:45:14 devstack sudo[87916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3afedf0f-40c3-4af0-ae82-b5c53002d7be 1073741824 Nov 06 17:45:14 devstack sudo[87916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:45:15 devstack sudo[87916]: pam_unix(sudo:session): session closed for user root Nov 06 17:45:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7c1fec14-9087-4eb1-a513-396a8b12d556 tempest-VolumesAdminNegativeTest-82536966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3afedf0f-40c3-4af0-ae82-b5c53002d7be 1073741824" returned: 0 in 1.125s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:45:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7c1fec14-9087-4eb1-a513-396a8b12d556 tempest-VolumesAdminNegativeTest-82536966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3afedf0f-40c3-4af0-ae82-b5c53002d7be {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:45:15 devstack sudo[88234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3afedf0f-40c3-4af0-ae82-b5c53002d7be Nov 06 17:45:15 devstack sudo[88234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:45:15 devstack sudo[88234]: pam_unix(sudo:session): session closed for user root Nov 06 17:45:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7c1fec14-9087-4eb1-a513-396a8b12d556 tempest-VolumesAdminNegativeTest-82536966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3afedf0f-40c3-4af0-ae82-b5c53002d7be" returned: 0 in 0.547s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:45:15 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7c1fec14-9087-4eb1-a513-396a8b12d556 tempest-VolumesAdminNegativeTest-82536966 None] <== create_volume: return (1788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:45:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7c1fec14-9087-4eb1-a513-396a8b12d556 tempest-VolumesAdminNegativeTest-82536966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.793s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:45:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7c1fec14-9087-4eb1-a513-396a8b12d556 tempest-VolumesAdminNegativeTest-82536966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdec0c55-3215-4c21-a8d6-189897eaafb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3afedf0f-40c3-4af0-ae82-b5c53002d7be', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:45:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7c1fec14-9087-4eb1-a513-396a8b12d556 tempest-VolumesAdminNegativeTest-82536966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ac0ffff-5147-4b40-bd56-64f031ad3065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:45:15 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-7c1fec14-9087-4eb1-a513-396a8b12d556 tempest-VolumesAdminNegativeTest-82536966 None] Volume volume-3afedf0f-40c3-4af0-ae82-b5c53002d7be (3afedf0f-40c3-4af0-ae82-b5c53002d7be): created successfully Nov 06 17:45:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7c1fec14-9087-4eb1-a513-396a8b12d556 tempest-VolumesAdminNegativeTest-82536966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ac0ffff-5147-4b40-bd56-64f031ad3065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:45:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7c1fec14-9087-4eb1-a513-396a8b12d556 tempest-VolumesAdminNegativeTest-82536966 None] Flow 'volume_create_manager' (d3db7595-fad0-4c26-adb9-0e974d5e81a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:45:15 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-7c1fec14-9087-4eb1-a513-396a8b12d556 tempest-VolumesAdminNegativeTest-82536966 None] Created volume successfully. Nov 06 17:45:16 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b054b19f-f9b5-422c-b138-f8d245ba122d tempest-VolumesAdminNegativeTest-82536966 None] Acquiring lock "cinder-3afedf0f-40c3-4af0-ae82-b5c53002d7be-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:45:16 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b054b19f-f9b5-422c-b138-f8d245ba122d tempest-VolumesAdminNegativeTest-82536966 None] Lock "cinder-3afedf0f-40c3-4af0-ae82-b5c53002d7be-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:45:17 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b054b19f-f9b5-422c-b138-f8d245ba122d tempest-VolumesAdminNegativeTest-82536966 None] Acquiring lock "cinder-quobyte-3afedf0f-40c3-4af0-ae82-b5c53002d7be" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:45:17 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b054b19f-f9b5-422c-b138-f8d245ba122d tempest-VolumesAdminNegativeTest-82536966 None] Lock "cinder-quobyte-3afedf0f-40c3-4af0-ae82-b5c53002d7be" acquired by "delete_volume" :: waited 0.043s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:45:17 devstack cinder-volume[87068]: INFO oslo.privsep.daemon [None req-b054b19f-f9b5-422c-b138-f8d245ba122d tempest-VolumesAdminNegativeTest-82536966 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp24uxyc4l/privsep.sock'] Nov 06 17:45:17 devstack sudo[88238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp24uxyc4l/privsep.sock Nov 06 17:45:17 devstack sudo[88238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:45:18 devstack cinder-volume[87068]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Nov 06 17:45:18 devstack cinder-volume[87068]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 06 17:45:18 devstack cinder-volume[87068]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Nov 06 17:45:18 devstack cinder-volume[87068]: WARNING oslo.privsep.daemon [-] privsep log: Nov 06 17:45:18 devstack cinder-volume[87068]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Nov 06 17:45:18 devstack cinder-volume[87068]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Nov 06 17:45:18 devstack cinder-volume[87068]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 06 17:45:18 devstack cinder-volume[87068]: WARNING oslo.privsep.daemon [-] privsep log: Nov 06 17:45:18 devstack cinder-volume[87068]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Nov 06 17:45:18 devstack sudo[88238]: pam_unix(sudo:session): session closed for user root Nov 06 17:45:18 devstack cinder-volume[87068]: INFO oslo.privsep.daemon [None req-b054b19f-f9b5-422c-b138-f8d245ba122d tempest-VolumesAdminNegativeTest-82536966 None] Spawned new privsep daemon via rootwrap Nov 06 17:45:18 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [None req-b054b19f-f9b5-422c-b138-f8d245ba122d tempest-VolumesAdminNegativeTest-82536966 None] Accepted privsep connection to /tmp/tmp24uxyc4l/privsep.sock {{(pid=87068) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Nov 06 17:45:18 devstack cinder-volume[87068]: INFO oslo.privsep.daemon [-] privsep daemon starting Nov 06 17:45:18 devstack cinder-volume[87068]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Nov 06 17:45:18 devstack cinder-volume[87068]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Nov 06 17:45:18 devstack cinder-volume[87068]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88268 Nov 06 17:45:18 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a156e5-09ba-4dfd-92ec-67fa18022b60]: (2,) {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:45:18 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce02c41-2d2f-4882-9638-7416c083f5e8]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:45:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b054b19f-f9b5-422c-b138-f8d245ba122d tempest-VolumesAdminNegativeTest-82536966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3afedf0f-40c3-4af0-ae82-b5c53002d7be {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:45:18 devstack sudo[88270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3afedf0f-40c3-4af0-ae82-b5c53002d7be Nov 06 17:45:18 devstack sudo[88270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:45:19 devstack sudo[88270]: pam_unix(sudo:session): session closed for user root Nov 06 17:45:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b054b19f-f9b5-422c-b138-f8d245ba122d tempest-VolumesAdminNegativeTest-82536966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3afedf0f-40c3-4af0-ae82-b5c53002d7be" returned: 0 in 0.599s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:45:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b054b19f-f9b5-422c-b138-f8d245ba122d tempest-VolumesAdminNegativeTest-82536966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3afedf0f-40c3-4af0-ae82-b5c53002d7be {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:45:19 devstack sudo[88276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3afedf0f-40c3-4af0-ae82-b5c53002d7be Nov 06 17:45:19 devstack sudo[88276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:45:19 devstack sudo[88276]: pam_unix(sudo:session): session closed for user root Nov 06 17:45:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b054b19f-f9b5-422c-b138-f8d245ba122d tempest-VolumesAdminNegativeTest-82536966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3afedf0f-40c3-4af0-ae82-b5c53002d7be" returned: 0 in 0.319s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:45:19 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b054b19f-f9b5-422c-b138-f8d245ba122d tempest-VolumesAdminNegativeTest-82536966 None] Lock "cinder-quobyte-3afedf0f-40c3-4af0-ae82-b5c53002d7be" released by "delete_volume" :: held 2.586s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:45:19 devstack cinder-volume[87068]: WARNING cinder.quota [None req-b054b19f-f9b5-422c-b138-f8d245ba122d tempest-VolumesAdminNegativeTest-82536966 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 06 17:45:19 devstack cinder-volume[87068]: WARNING cinder.quota [None req-b054b19f-f9b5-422c-b138-f8d245ba122d tempest-VolumesAdminNegativeTest-82536966 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 06 17:45:19 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-b054b19f-f9b5-422c-b138-f8d245ba122d tempest-VolumesAdminNegativeTest-82536966 None] Created reservations ['136b4f7a-c7bd-4ee2-83de-c66eb84ea6f6', '101552ea-b432-4d04-88d5-50c837266742', '8a14919c-9dc4-4995-9f19-27e6284f1fbe', '21bfbd64-8008-4dce-82f4-945e6cdd1ad2'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:45:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b054b19f-f9b5-422c-b138-f8d245ba122d tempest-VolumesAdminNegativeTest-82536966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:45:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b054b19f-f9b5-422c-b138-f8d245ba122d tempest-VolumesAdminNegativeTest-82536966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:45:19 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b054b19f-f9b5-422c-b138-f8d245ba122d tempest-VolumesAdminNegativeTest-82536966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:45:19 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b054b19f-f9b5-422c-b138-f8d245ba122d tempest-VolumesAdminNegativeTest-82536966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:45:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b054b19f-f9b5-422c-b138-f8d245ba122d tempest-VolumesAdminNegativeTest-82536966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:45:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b054b19f-f9b5-422c-b138-f8d245ba122d tempest-VolumesAdminNegativeTest-82536966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:45:20 devstack sudo[88280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:45:20 devstack sudo[88280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:45:20 devstack sudo[88280]: pam_unix(sudo:session): session closed for user root Nov 06 17:45:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b054b19f-f9b5-422c-b138-f8d245ba122d tempest-VolumesAdminNegativeTest-82536966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.291s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:45:20 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-b054b19f-f9b5-422c-b138-f8d245ba122d tempest-VolumesAdminNegativeTest-82536966 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:45:20 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-b054b19f-f9b5-422c-b138-f8d245ba122d tempest-VolumesAdminNegativeTest-82536966 None] Deleted volume successfully. Nov 06 17:45:20 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b054b19f-f9b5-422c-b138-f8d245ba122d tempest-VolumesAdminNegativeTest-82536966 None] Lock "cinder-3afedf0f-40c3-4af0-ae82-b5c53002d7be-delete_volume" released by "delete_volume" :: held 3.372s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:45:29 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:UPDATE=14,cinder:DELETE=1,cinder:SELECT=4,cinder:INSERT=3 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 17:45:30 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=10,cinder:INSERT=2,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 17:45:33 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-da858401-faf5-4bb7-b60a-7276feda05bb tempest-AttachVolumeTestJSON-401623914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:45:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-da858401-faf5-4bb7-b60a-7276feda05bb tempest-AttachVolumeTestJSON-401623914 None] Flow 'volume_create_manager' (50417784-6a5f-437a-9a03-34a01d05ab67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:45:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-da858401-faf5-4bb7-b60a-7276feda05bb tempest-AttachVolumeTestJSON-401623914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fad48397-3cd4-4b62-9a91-4a66d23ca0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:45:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-da858401-faf5-4bb7-b60a-7276feda05bb tempest-AttachVolumeTestJSON-401623914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fad48397-3cd4-4b62-9a91-4a66d23ca0fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-672007607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cfa4fd9-aed2-438c-aaf9-6abbd4054d67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71415b16ed6244e8bcf27ec2ce3458af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:45:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:45:34Z,use_quota=True,user_id='32cfaf0b7dbd414390a951d17f55497c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:45:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-da858401-faf5-4bb7-b60a-7276feda05bb tempest-AttachVolumeTestJSON-401623914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7efc4b4d-366f-4df5-82e7-b1f76b17372d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:45:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-da858401-faf5-4bb7-b60a-7276feda05bb tempest-AttachVolumeTestJSON-401623914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7efc4b4d-366f-4df5-82e7-b1f76b17372d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:45:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-da858401-faf5-4bb7-b60a-7276feda05bb tempest-AttachVolumeTestJSON-401623914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be835125-cead-45f5-b88a-373065622b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:45:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-da858401-faf5-4bb7-b60a-7276feda05bb tempest-AttachVolumeTestJSON-401623914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be835125-cead-45f5-b88a-373065622b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cfa4fd9-aed2-438c-aaf9-6abbd4054d67', 'volume_name': 'volume-1cfa4fd9-aed2-438c-aaf9-6abbd4054d67', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:45:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-da858401-faf5-4bb7-b60a-7276feda05bb tempest-AttachVolumeTestJSON-401623914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f668e6af-d93a-4290-94b8-4a407cc90993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:45:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-da858401-faf5-4bb7-b60a-7276feda05bb tempest-AttachVolumeTestJSON-401623914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f668e6af-d93a-4290-94b8-4a407cc90993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:45:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-da858401-faf5-4bb7-b60a-7276feda05bb tempest-AttachVolumeTestJSON-401623914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87d8b938-8c47-4556-81d7-4d96b6f4292b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:45:33 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-da858401-faf5-4bb7-b60a-7276feda05bb tempest-AttachVolumeTestJSON-401623914 None] Volume 1cfa4fd9-aed2-438c-aaf9-6abbd4054d67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cfa4fd9-aed2-438c-aaf9-6abbd4054d67', 'volume_size': 1} Nov 06 17:45:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-da858401-faf5-4bb7-b60a-7276feda05bb tempest-AttachVolumeTestJSON-401623914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:45:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-da858401-faf5-4bb7-b60a-7276feda05bb tempest-AttachVolumeTestJSON-401623914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:45:33 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-da858401-faf5-4bb7-b60a-7276feda05bb tempest-AttachVolumeTestJSON-401623914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-672007607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cfa4fd9-aed2-438c-aaf9-6abbd4054d67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71415b16ed6244e8bcf27ec2ce3458af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:45:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:45:34Z,use_quota=True,user_id='32cfaf0b7dbd414390a951d17f55497c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:45:33 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-da858401-faf5-4bb7-b60a-7276feda05bb tempest-AttachVolumeTestJSON-401623914 None] Creating volume 1cfa4fd9-aed2-438c-aaf9-6abbd4054d67 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:45:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-da858401-faf5-4bb7-b60a-7276feda05bb tempest-AttachVolumeTestJSON-401623914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:45:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-da858401-faf5-4bb7-b60a-7276feda05bb tempest-AttachVolumeTestJSON-401623914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:45:33 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-da858401-faf5-4bb7-b60a-7276feda05bb tempest-AttachVolumeTestJSON-401623914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:45:33 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-da858401-faf5-4bb7-b60a-7276feda05bb tempest-AttachVolumeTestJSON-401623914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:45:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-da858401-faf5-4bb7-b60a-7276feda05bb tempest-AttachVolumeTestJSON-401623914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:45:33 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-da858401-faf5-4bb7-b60a-7276feda05bb tempest-AttachVolumeTestJSON-401623914 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:45:33 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-da858401-faf5-4bb7-b60a-7276feda05bb tempest-AttachVolumeTestJSON-401623914 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:45:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-da858401-faf5-4bb7-b60a-7276feda05bb tempest-AttachVolumeTestJSON-401623914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1cfa4fd9-aed2-438c-aaf9-6abbd4054d67 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:45:33 devstack sudo[88378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1cfa4fd9-aed2-438c-aaf9-6abbd4054d67 1073741824 Nov 06 17:45:33 devstack sudo[88378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:45:34 devstack sudo[88378]: pam_unix(sudo:session): session closed for user root Nov 06 17:45:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-da858401-faf5-4bb7-b60a-7276feda05bb tempest-AttachVolumeTestJSON-401623914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1cfa4fd9-aed2-438c-aaf9-6abbd4054d67 1073741824" returned: 0 in 0.528s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:45:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-da858401-faf5-4bb7-b60a-7276feda05bb tempest-AttachVolumeTestJSON-401623914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1cfa4fd9-aed2-438c-aaf9-6abbd4054d67 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:45:34 devstack sudo[88385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1cfa4fd9-aed2-438c-aaf9-6abbd4054d67 Nov 06 17:45:34 devstack sudo[88385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:45:34 devstack sudo[88385]: pam_unix(sudo:session): session closed for user root Nov 06 17:45:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-da858401-faf5-4bb7-b60a-7276feda05bb tempest-AttachVolumeTestJSON-401623914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1cfa4fd9-aed2-438c-aaf9-6abbd4054d67" returned: 0 in 0.321s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:45:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-da858401-faf5-4bb7-b60a-7276feda05bb tempest-AttachVolumeTestJSON-401623914 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:45:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-da858401-faf5-4bb7-b60a-7276feda05bb tempest-AttachVolumeTestJSON-401623914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:45:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-da858401-faf5-4bb7-b60a-7276feda05bb tempest-AttachVolumeTestJSON-401623914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87d8b938-8c47-4556-81d7-4d96b6f4292b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cfa4fd9-aed2-438c-aaf9-6abbd4054d67', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:45:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-da858401-faf5-4bb7-b60a-7276feda05bb tempest-AttachVolumeTestJSON-401623914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e27dd003-2601-421c-b4a5-5f9cee0ec7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:45:34 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-da858401-faf5-4bb7-b60a-7276feda05bb tempest-AttachVolumeTestJSON-401623914 None] Volume volume-1cfa4fd9-aed2-438c-aaf9-6abbd4054d67 (1cfa4fd9-aed2-438c-aaf9-6abbd4054d67): created successfully Nov 06 17:45:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-da858401-faf5-4bb7-b60a-7276feda05bb tempest-AttachVolumeTestJSON-401623914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e27dd003-2601-421c-b4a5-5f9cee0ec7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:45:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-da858401-faf5-4bb7-b60a-7276feda05bb tempest-AttachVolumeTestJSON-401623914 None] Flow 'volume_create_manager' (50417784-6a5f-437a-9a03-34a01d05ab67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:45:34 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-da858401-faf5-4bb7-b60a-7276feda05bb tempest-AttachVolumeTestJSON-401623914 None] Created volume successfully. Nov 06 17:45:36 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-fca293fb-150a-459a-add7-f1b23ca5fb5e tempest-AttachVolumeShelveTestJSON-1940941598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:45:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fca293fb-150a-459a-add7-f1b23ca5fb5e tempest-AttachVolumeShelveTestJSON-1940941598 None] Flow 'volume_create_manager' (765b2335-a038-44bf-8d53-0b4c171c5d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:45:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fca293fb-150a-459a-add7-f1b23ca5fb5e tempest-AttachVolumeShelveTestJSON-1940941598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdf0cdd3-ea03-4ec3-8470-9b60c43f900e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:45:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fca293fb-150a-459a-add7-f1b23ca5fb5e tempest-AttachVolumeShelveTestJSON-1940941598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdf0cdd3-ea03-4ec3-8470-9b60c43f900e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:45:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-804335326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aa4b7e2-d657-407f-8ea5-8745b31339ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25014e4822c641f38af5a3ab66a27a2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:45:37Z,use_quota=True,user_id='f6862b182b3f4ae0b28753f77a98eab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:45:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fca293fb-150a-459a-add7-f1b23ca5fb5e tempest-AttachVolumeShelveTestJSON-1940941598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca7d077b-ced3-428d-aebf-c0b296952753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:45:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fca293fb-150a-459a-add7-f1b23ca5fb5e tempest-AttachVolumeShelveTestJSON-1940941598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca7d077b-ced3-428d-aebf-c0b296952753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:45:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fca293fb-150a-459a-add7-f1b23ca5fb5e tempest-AttachVolumeShelveTestJSON-1940941598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4905228-12fc-4195-8ef9-7fdafa759c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:45:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fca293fb-150a-459a-add7-f1b23ca5fb5e tempest-AttachVolumeShelveTestJSON-1940941598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4905228-12fc-4195-8ef9-7fdafa759c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1aa4b7e2-d657-407f-8ea5-8745b31339ac', 'volume_name': 'volume-1aa4b7e2-d657-407f-8ea5-8745b31339ac', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:45:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fca293fb-150a-459a-add7-f1b23ca5fb5e tempest-AttachVolumeShelveTestJSON-1940941598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f05d0f4-babb-483b-a3ef-2ee5af8888db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:45:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fca293fb-150a-459a-add7-f1b23ca5fb5e tempest-AttachVolumeShelveTestJSON-1940941598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f05d0f4-babb-483b-a3ef-2ee5af8888db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:45:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fca293fb-150a-459a-add7-f1b23ca5fb5e tempest-AttachVolumeShelveTestJSON-1940941598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3f96339-94b3-4bab-a464-cf346598c293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:45:36 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-fca293fb-150a-459a-add7-f1b23ca5fb5e tempest-AttachVolumeShelveTestJSON-1940941598 None] Volume 1aa4b7e2-d657-407f-8ea5-8745b31339ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1aa4b7e2-d657-407f-8ea5-8745b31339ac', 'volume_size': 1} Nov 06 17:45:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fca293fb-150a-459a-add7-f1b23ca5fb5e tempest-AttachVolumeShelveTestJSON-1940941598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:45:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fca293fb-150a-459a-add7-f1b23ca5fb5e tempest-AttachVolumeShelveTestJSON-1940941598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:45:36 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fca293fb-150a-459a-add7-f1b23ca5fb5e tempest-AttachVolumeShelveTestJSON-1940941598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:45:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-804335326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aa4b7e2-d657-407f-8ea5-8745b31339ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25014e4822c641f38af5a3ab66a27a2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:45:37Z,use_quota=True,user_id='f6862b182b3f4ae0b28753f77a98eab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:45:36 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-fca293fb-150a-459a-add7-f1b23ca5fb5e tempest-AttachVolumeShelveTestJSON-1940941598 None] Creating volume 1aa4b7e2-d657-407f-8ea5-8745b31339ac {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:45:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fca293fb-150a-459a-add7-f1b23ca5fb5e tempest-AttachVolumeShelveTestJSON-1940941598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:45:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fca293fb-150a-459a-add7-f1b23ca5fb5e tempest-AttachVolumeShelveTestJSON-1940941598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:45:36 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fca293fb-150a-459a-add7-f1b23ca5fb5e tempest-AttachVolumeShelveTestJSON-1940941598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:45:36 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fca293fb-150a-459a-add7-f1b23ca5fb5e tempest-AttachVolumeShelveTestJSON-1940941598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:45:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fca293fb-150a-459a-add7-f1b23ca5fb5e tempest-AttachVolumeShelveTestJSON-1940941598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:45:36 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fca293fb-150a-459a-add7-f1b23ca5fb5e tempest-AttachVolumeShelveTestJSON-1940941598 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:45:36 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-fca293fb-150a-459a-add7-f1b23ca5fb5e tempest-AttachVolumeShelveTestJSON-1940941598 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:45:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fca293fb-150a-459a-add7-f1b23ca5fb5e tempest-AttachVolumeShelveTestJSON-1940941598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1aa4b7e2-d657-407f-8ea5-8745b31339ac 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:45:37 devstack sudo[88398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1aa4b7e2-d657-407f-8ea5-8745b31339ac 1073741824 Nov 06 17:45:37 devstack sudo[88398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:45:37 devstack sudo[88398]: pam_unix(sudo:session): session closed for user root Nov 06 17:45:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fca293fb-150a-459a-add7-f1b23ca5fb5e tempest-AttachVolumeShelveTestJSON-1940941598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1aa4b7e2-d657-407f-8ea5-8745b31339ac 1073741824" returned: 0 in 0.633s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:45:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fca293fb-150a-459a-add7-f1b23ca5fb5e tempest-AttachVolumeShelveTestJSON-1940941598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1aa4b7e2-d657-407f-8ea5-8745b31339ac {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:45:37 devstack sudo[88408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1aa4b7e2-d657-407f-8ea5-8745b31339ac Nov 06 17:45:37 devstack sudo[88408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:45:37 devstack sudo[88408]: pam_unix(sudo:session): session closed for user root Nov 06 17:45:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fca293fb-150a-459a-add7-f1b23ca5fb5e tempest-AttachVolumeShelveTestJSON-1940941598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1aa4b7e2-d657-407f-8ea5-8745b31339ac" returned: 0 in 0.286s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:45:37 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fca293fb-150a-459a-add7-f1b23ca5fb5e tempest-AttachVolumeShelveTestJSON-1940941598 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:45:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fca293fb-150a-459a-add7-f1b23ca5fb5e tempest-AttachVolumeShelveTestJSON-1940941598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:45:37 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fca293fb-150a-459a-add7-f1b23ca5fb5e tempest-AttachVolumeShelveTestJSON-1940941598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3f96339-94b3-4bab-a464-cf346598c293) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1aa4b7e2-d657-407f-8ea5-8745b31339ac', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:45:37 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fca293fb-150a-459a-add7-f1b23ca5fb5e tempest-AttachVolumeShelveTestJSON-1940941598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e4e8bda-77d4-41d0-91b5-bf91e252bdb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:45:37 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-fca293fb-150a-459a-add7-f1b23ca5fb5e tempest-AttachVolumeShelveTestJSON-1940941598 None] Volume volume-1aa4b7e2-d657-407f-8ea5-8745b31339ac (1aa4b7e2-d657-407f-8ea5-8745b31339ac): created successfully Nov 06 17:45:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fca293fb-150a-459a-add7-f1b23ca5fb5e tempest-AttachVolumeShelveTestJSON-1940941598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e4e8bda-77d4-41d0-91b5-bf91e252bdb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:45:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fca293fb-150a-459a-add7-f1b23ca5fb5e tempest-AttachVolumeShelveTestJSON-1940941598 None] Flow 'volume_create_manager' (765b2335-a038-44bf-8d53-0b4c171c5d1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:45:38 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-fca293fb-150a-459a-add7-f1b23ca5fb5e tempest-AttachVolumeShelveTestJSON-1940941598 None] Created volume successfully. Nov 06 17:45:39 devstack cinder-volume[87068]: WARNING py.warnings [req-d5de9b1e-86f9-4f54-a1d1-2255ae0f4367 req-deb6fe41-8721-48bc-803d-a4d63fa5dd80 tempest-AttachVolumeTestJSON-401623914 None] /opt/stack/cinder/cinder/db/api.py:2442: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Nov 06 17:45:39 devstack cinder-volume[87068]: .first() Nov 06 17:45:39 devstack cinder-volume[87068]: Nov 06 17:45:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-d5de9b1e-86f9-4f54-a1d1-2255ae0f4367 req-deb6fe41-8721-48bc-803d-a4d63fa5dd80 tempest-AttachVolumeTestJSON-401623914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:45:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-d5de9b1e-86f9-4f54-a1d1-2255ae0f4367 req-deb6fe41-8721-48bc-803d-a4d63fa5dd80 tempest-AttachVolumeTestJSON-401623914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:45:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-d5de9b1e-86f9-4f54-a1d1-2255ae0f4367 req-deb6fe41-8721-48bc-803d-a4d63fa5dd80 tempest-AttachVolumeTestJSON-401623914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:45:39 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-d5de9b1e-86f9-4f54-a1d1-2255ae0f4367 req-deb6fe41-8721-48bc-803d-a4d63fa5dd80 tempest-AttachVolumeTestJSON-401623914 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072', 'name': 'volume-1cfa4fd9-aed2-438c-aaf9-6abbd4054d67', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '04ef151d-fc12-4a2f-a47f-6db42c9effd9', 'enforce_multipath': True} {{(pid=87068) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 17:45:39 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-d5de9b1e-86f9-4f54-a1d1-2255ae0f4367 req-deb6fe41-8721-48bc-803d-a4d63fa5dd80 tempest-AttachVolumeTestJSON-401623914 None] attachment_update completed successfully. Nov 06 17:45:46 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-77c4e471-0af5-4b75-b64c-714b9cf4bf49 tempest-TaggedAttachmentsTest-1919826915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:45:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-77c4e471-0af5-4b75-b64c-714b9cf4bf49 tempest-TaggedAttachmentsTest-1919826915 None] Flow 'volume_create_manager' (56c431ef-6c35-424c-982c-1da29890038f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:45:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-77c4e471-0af5-4b75-b64c-714b9cf4bf49 tempest-TaggedAttachmentsTest-1919826915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b27a7168-4d3d-4e80-83ef-6119da002b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:45:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-77c4e471-0af5-4b75-b64c-714b9cf4bf49 tempest-TaggedAttachmentsTest-1919826915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b27a7168-4d3d-4e80-83ef-6119da002b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:45:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-962257156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ada0d808-5737-43f1-981c-bd4c657f2465,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69c5c091d030435797b7b4a1d002e372',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:45:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:45:47Z,use_quota=True,user_id='b814ec5b013f440a86128f9636991162',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:45:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-77c4e471-0af5-4b75-b64c-714b9cf4bf49 tempest-TaggedAttachmentsTest-1919826915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6894ea05-ebed-46e0-b318-c72e12189427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:45:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-77c4e471-0af5-4b75-b64c-714b9cf4bf49 tempest-TaggedAttachmentsTest-1919826915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6894ea05-ebed-46e0-b318-c72e12189427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:45:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-77c4e471-0af5-4b75-b64c-714b9cf4bf49 tempest-TaggedAttachmentsTest-1919826915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de3d6ec6-08ba-41ea-aa1d-300a8ae66472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:45:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-77c4e471-0af5-4b75-b64c-714b9cf4bf49 tempest-TaggedAttachmentsTest-1919826915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de3d6ec6-08ba-41ea-aa1d-300a8ae66472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ada0d808-5737-43f1-981c-bd4c657f2465', 'volume_name': 'volume-ada0d808-5737-43f1-981c-bd4c657f2465', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:45:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-77c4e471-0af5-4b75-b64c-714b9cf4bf49 tempest-TaggedAttachmentsTest-1919826915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5feb4c67-4467-40b2-805d-b281bad6e916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:45:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-77c4e471-0af5-4b75-b64c-714b9cf4bf49 tempest-TaggedAttachmentsTest-1919826915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5feb4c67-4467-40b2-805d-b281bad6e916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:45:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-77c4e471-0af5-4b75-b64c-714b9cf4bf49 tempest-TaggedAttachmentsTest-1919826915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c249f5ec-684e-4313-95fd-0fe33bbbf758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:45:46 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-77c4e471-0af5-4b75-b64c-714b9cf4bf49 tempest-TaggedAttachmentsTest-1919826915 None] Volume ada0d808-5737-43f1-981c-bd4c657f2465: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ada0d808-5737-43f1-981c-bd4c657f2465', 'volume_size': 1} Nov 06 17:45:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-77c4e471-0af5-4b75-b64c-714b9cf4bf49 tempest-TaggedAttachmentsTest-1919826915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:45:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-77c4e471-0af5-4b75-b64c-714b9cf4bf49 tempest-TaggedAttachmentsTest-1919826915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:45:46 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-77c4e471-0af5-4b75-b64c-714b9cf4bf49 tempest-TaggedAttachmentsTest-1919826915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:45:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-962257156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ada0d808-5737-43f1-981c-bd4c657f2465,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69c5c091d030435797b7b4a1d002e372',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:45:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:45:47Z,use_quota=True,user_id='b814ec5b013f440a86128f9636991162',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:45:46 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-77c4e471-0af5-4b75-b64c-714b9cf4bf49 tempest-TaggedAttachmentsTest-1919826915 None] Creating volume ada0d808-5737-43f1-981c-bd4c657f2465 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:45:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-77c4e471-0af5-4b75-b64c-714b9cf4bf49 tempest-TaggedAttachmentsTest-1919826915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:45:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-77c4e471-0af5-4b75-b64c-714b9cf4bf49 tempest-TaggedAttachmentsTest-1919826915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:45:46 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-77c4e471-0af5-4b75-b64c-714b9cf4bf49 tempest-TaggedAttachmentsTest-1919826915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:45:46 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-77c4e471-0af5-4b75-b64c-714b9cf4bf49 tempest-TaggedAttachmentsTest-1919826915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:45:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-77c4e471-0af5-4b75-b64c-714b9cf4bf49 tempest-TaggedAttachmentsTest-1919826915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:45:46 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-77c4e471-0af5-4b75-b64c-714b9cf4bf49 tempest-TaggedAttachmentsTest-1919826915 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:45:46 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-77c4e471-0af5-4b75-b64c-714b9cf4bf49 tempest-TaggedAttachmentsTest-1919826915 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:45:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-77c4e471-0af5-4b75-b64c-714b9cf4bf49 tempest-TaggedAttachmentsTest-1919826915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ada0d808-5737-43f1-981c-bd4c657f2465 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:45:46 devstack sudo[88904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ada0d808-5737-43f1-981c-bd4c657f2465 1073741824 Nov 06 17:45:46 devstack sudo[88904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:45:47 devstack sudo[88904]: pam_unix(sudo:session): session closed for user root Nov 06 17:45:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-77c4e471-0af5-4b75-b64c-714b9cf4bf49 tempest-TaggedAttachmentsTest-1919826915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ada0d808-5737-43f1-981c-bd4c657f2465 1073741824" returned: 0 in 0.506s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:45:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-77c4e471-0af5-4b75-b64c-714b9cf4bf49 tempest-TaggedAttachmentsTest-1919826915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ada0d808-5737-43f1-981c-bd4c657f2465 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:45:47 devstack sudo[88909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ada0d808-5737-43f1-981c-bd4c657f2465 Nov 06 17:45:47 devstack sudo[88909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:45:47 devstack sudo[88909]: pam_unix(sudo:session): session closed for user root Nov 06 17:45:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-77c4e471-0af5-4b75-b64c-714b9cf4bf49 tempest-TaggedAttachmentsTest-1919826915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ada0d808-5737-43f1-981c-bd4c657f2465" returned: 0 in 0.338s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:45:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-77c4e471-0af5-4b75-b64c-714b9cf4bf49 tempest-TaggedAttachmentsTest-1919826915 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:45:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-77c4e471-0af5-4b75-b64c-714b9cf4bf49 tempest-TaggedAttachmentsTest-1919826915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:45:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-77c4e471-0af5-4b75-b64c-714b9cf4bf49 tempest-TaggedAttachmentsTest-1919826915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c249f5ec-684e-4313-95fd-0fe33bbbf758) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ada0d808-5737-43f1-981c-bd4c657f2465', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:45:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-77c4e471-0af5-4b75-b64c-714b9cf4bf49 tempest-TaggedAttachmentsTest-1919826915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceacfd8b-eab6-41e3-9751-f2261f5c2f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:45:47 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-77c4e471-0af5-4b75-b64c-714b9cf4bf49 tempest-TaggedAttachmentsTest-1919826915 None] Volume volume-ada0d808-5737-43f1-981c-bd4c657f2465 (ada0d808-5737-43f1-981c-bd4c657f2465): created successfully Nov 06 17:45:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-77c4e471-0af5-4b75-b64c-714b9cf4bf49 tempest-TaggedAttachmentsTest-1919826915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceacfd8b-eab6-41e3-9751-f2261f5c2f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:45:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-77c4e471-0af5-4b75-b64c-714b9cf4bf49 tempest-TaggedAttachmentsTest-1919826915 None] Flow 'volume_create_manager' (56c431ef-6c35-424c-982c-1da29890038f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:45:47 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-77c4e471-0af5-4b75-b64c-714b9cf4bf49 tempest-TaggedAttachmentsTest-1919826915 None] Created volume successfully. Nov 06 17:45:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-ac0e2329-1d54-40e6-8d3c-93763ed8dd61 req-aa022fe8-0bb8-4827-bc21-39a4c8714dac tempest-AttachVolumeShelveTestJSON-1940941598 None] No connector for attachment 67e664da-94e9-4096-b903-691d088fc55e; skipping storage backend terminate_connection call. {{(pid=87068) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5009}} Nov 06 17:45:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-ac0e2329-1d54-40e6-8d3c-93763ed8dd61 req-aa022fe8-0bb8-4827-bc21-39a4c8714dac tempest-AttachVolumeShelveTestJSON-1940941598 None] Deleting attachment 67e664da-94e9-4096-b903-691d088fc55e. {{(pid=87068) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 17:45:54 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 17:45:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:45:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:45:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:45:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:45:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:45:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:45:54 devstack sudo[89497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:45:54 devstack sudo[89497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:45:54 devstack sudo[89497]: pam_unix(sudo:session): session closed for user root Nov 06 17:45:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.398s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:45:54 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:46:04 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:UPDATE=13,cinder:SELECT=14,cinder:INSERT=2,cinder:DELETE=2 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 17:46:04 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=14,cinder:UPDATE=9,cinder:DELETE=1,cinder:INSERT=1 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 17:46:15 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-e069f383-12c0-41ca-aedd-09d160c83470 req-06b05ae8-9ba0-4c33-b2e2-fa7977d286e2 tempest-AttachVolumeTestJSON-401623914 None] Terminate volume connection completed successfully. Nov 06 17:46:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-e069f383-12c0-41ca-aedd-09d160c83470 req-06b05ae8-9ba0-4c33-b2e2-fa7977d286e2 tempest-AttachVolumeTestJSON-401623914 None] Deleting attachment 04ef151d-fc12-4a2f-a47f-6db42c9effd9. {{(pid=87068) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 17:46:25 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=1 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 17:46:25 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=1 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 17:46:25 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3af9a12-12b8-48ab-89a5-6648ee425d6d tempest-DeleteServersTestJSON-769596624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:46:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c3af9a12-12b8-48ab-89a5-6648ee425d6d tempest-DeleteServersTestJSON-769596624 None] Flow 'volume_create_manager' (799813da-1c6f-497d-b99a-4de3b0ec20e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:46:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c3af9a12-12b8-48ab-89a5-6648ee425d6d tempest-DeleteServersTestJSON-769596624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b134ff7-907c-4d23-97b9-b126a41f84df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:46:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c3af9a12-12b8-48ab-89a5-6648ee425d6d tempest-DeleteServersTestJSON-769596624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b134ff7-907c-4d23-97b9-b126a41f84df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:46:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-537971790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50b7ea42-f08f-4b7c-89a5-e2f614e97824,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a13057e3ae34bbcb692149a8f97eb7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:46:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:46:26Z,use_quota=True,user_id='9a101dac66ea40b5835feddcdbfa7c9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:46:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c3af9a12-12b8-48ab-89a5-6648ee425d6d tempest-DeleteServersTestJSON-769596624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b37d040a-36d3-4064-9e85-62b58961f281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:46:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c3af9a12-12b8-48ab-89a5-6648ee425d6d tempest-DeleteServersTestJSON-769596624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b37d040a-36d3-4064-9e85-62b58961f281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:46:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c3af9a12-12b8-48ab-89a5-6648ee425d6d tempest-DeleteServersTestJSON-769596624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dbcce50-19be-4234-b879-eac1ef1355e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:46:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c3af9a12-12b8-48ab-89a5-6648ee425d6d tempest-DeleteServersTestJSON-769596624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dbcce50-19be-4234-b879-eac1ef1355e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50b7ea42-f08f-4b7c-89a5-e2f614e97824', 'volume_name': 'volume-50b7ea42-f08f-4b7c-89a5-e2f614e97824', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:46:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c3af9a12-12b8-48ab-89a5-6648ee425d6d tempest-DeleteServersTestJSON-769596624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6141f34e-e7a0-4fe5-86ad-9a281057d7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:46:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c3af9a12-12b8-48ab-89a5-6648ee425d6d tempest-DeleteServersTestJSON-769596624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6141f34e-e7a0-4fe5-86ad-9a281057d7dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:46:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c3af9a12-12b8-48ab-89a5-6648ee425d6d tempest-DeleteServersTestJSON-769596624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b2f4f3b-29fc-41a3-a97e-2f02caa9051e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:46:26 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-c3af9a12-12b8-48ab-89a5-6648ee425d6d tempest-DeleteServersTestJSON-769596624 None] Volume 50b7ea42-f08f-4b7c-89a5-e2f614e97824: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50b7ea42-f08f-4b7c-89a5-e2f614e97824', 'volume_size': 1} Nov 06 17:46:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c3af9a12-12b8-48ab-89a5-6648ee425d6d tempest-DeleteServersTestJSON-769596624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:46:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c3af9a12-12b8-48ab-89a5-6648ee425d6d tempest-DeleteServersTestJSON-769596624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:46:26 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c3af9a12-12b8-48ab-89a5-6648ee425d6d tempest-DeleteServersTestJSON-769596624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:46:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-537971790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50b7ea42-f08f-4b7c-89a5-e2f614e97824,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a13057e3ae34bbcb692149a8f97eb7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:46:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:46:26Z,use_quota=True,user_id='9a101dac66ea40b5835feddcdbfa7c9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:46:26 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-c3af9a12-12b8-48ab-89a5-6648ee425d6d tempest-DeleteServersTestJSON-769596624 None] Creating volume 50b7ea42-f08f-4b7c-89a5-e2f614e97824 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:46:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c3af9a12-12b8-48ab-89a5-6648ee425d6d tempest-DeleteServersTestJSON-769596624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:46:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c3af9a12-12b8-48ab-89a5-6648ee425d6d tempest-DeleteServersTestJSON-769596624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:46:26 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c3af9a12-12b8-48ab-89a5-6648ee425d6d tempest-DeleteServersTestJSON-769596624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:46:26 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c3af9a12-12b8-48ab-89a5-6648ee425d6d tempest-DeleteServersTestJSON-769596624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:46:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c3af9a12-12b8-48ab-89a5-6648ee425d6d tempest-DeleteServersTestJSON-769596624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:46:26 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c3af9a12-12b8-48ab-89a5-6648ee425d6d tempest-DeleteServersTestJSON-769596624 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:46:26 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-c3af9a12-12b8-48ab-89a5-6648ee425d6d tempest-DeleteServersTestJSON-769596624 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:46:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c3af9a12-12b8-48ab-89a5-6648ee425d6d tempest-DeleteServersTestJSON-769596624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-50b7ea42-f08f-4b7c-89a5-e2f614e97824 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:46:26 devstack sudo[89973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-50b7ea42-f08f-4b7c-89a5-e2f614e97824 1073741824 Nov 06 17:46:26 devstack sudo[89973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:46:27 devstack sudo[89973]: pam_unix(sudo:session): session closed for user root Nov 06 17:46:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c3af9a12-12b8-48ab-89a5-6648ee425d6d tempest-DeleteServersTestJSON-769596624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-50b7ea42-f08f-4b7c-89a5-e2f614e97824 1073741824" returned: 0 in 0.883s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:46:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c3af9a12-12b8-48ab-89a5-6648ee425d6d tempest-DeleteServersTestJSON-769596624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-50b7ea42-f08f-4b7c-89a5-e2f614e97824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:46:27 devstack sudo[89984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-50b7ea42-f08f-4b7c-89a5-e2f614e97824 Nov 06 17:46:27 devstack sudo[89984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:46:27 devstack sudo[89984]: pam_unix(sudo:session): session closed for user root Nov 06 17:46:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c3af9a12-12b8-48ab-89a5-6648ee425d6d tempest-DeleteServersTestJSON-769596624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-50b7ea42-f08f-4b7c-89a5-e2f614e97824" returned: 0 in 0.277s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:46:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c3af9a12-12b8-48ab-89a5-6648ee425d6d tempest-DeleteServersTestJSON-769596624 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:46:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c3af9a12-12b8-48ab-89a5-6648ee425d6d tempest-DeleteServersTestJSON-769596624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:46:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c3af9a12-12b8-48ab-89a5-6648ee425d6d tempest-DeleteServersTestJSON-769596624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b2f4f3b-29fc-41a3-a97e-2f02caa9051e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50b7ea42-f08f-4b7c-89a5-e2f614e97824', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:46:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c3af9a12-12b8-48ab-89a5-6648ee425d6d tempest-DeleteServersTestJSON-769596624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61cfa766-75eb-4abc-809b-c159dee81662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:46:27 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-c3af9a12-12b8-48ab-89a5-6648ee425d6d tempest-DeleteServersTestJSON-769596624 None] Volume volume-50b7ea42-f08f-4b7c-89a5-e2f614e97824 (50b7ea42-f08f-4b7c-89a5-e2f614e97824): created successfully Nov 06 17:46:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c3af9a12-12b8-48ab-89a5-6648ee425d6d tempest-DeleteServersTestJSON-769596624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61cfa766-75eb-4abc-809b-c159dee81662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:46:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c3af9a12-12b8-48ab-89a5-6648ee425d6d tempest-DeleteServersTestJSON-769596624 None] Flow 'volume_create_manager' (799813da-1c6f-497d-b99a-4de3b0ec20e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:46:27 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-c3af9a12-12b8-48ab-89a5-6648ee425d6d tempest-DeleteServersTestJSON-769596624 None] Created volume successfully. Nov 06 17:46:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-e78cc050-2a31-421f-9720-f91f5f8afcba req-a367cb89-6e94-404f-8bbe-610c0f69efed tempest-DeleteServersTestJSON-769596624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:46:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-e78cc050-2a31-421f-9720-f91f5f8afcba req-a367cb89-6e94-404f-8bbe-610c0f69efed tempest-DeleteServersTestJSON-769596624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:46:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-e78cc050-2a31-421f-9720-f91f5f8afcba req-a367cb89-6e94-404f-8bbe-610c0f69efed tempest-DeleteServersTestJSON-769596624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:46:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-e78cc050-2a31-421f-9720-f91f5f8afcba req-a367cb89-6e94-404f-8bbe-610c0f69efed tempest-DeleteServersTestJSON-769596624 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072', 'name': 'volume-50b7ea42-f08f-4b7c-89a5-e2f614e97824', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '91b8fd8d-11c4-4015-b396-a11f9438ee21', 'enforce_multipath': True} {{(pid=87068) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 17:46:29 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-e78cc050-2a31-421f-9720-f91f5f8afcba req-a367cb89-6e94-404f-8bbe-610c0f69efed tempest-DeleteServersTestJSON-769596624 None] attachment_update completed successfully. Nov 06 17:46:33 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-161afc67-3c5a-46f6-8272-79d57ae66295 req-9cb3f396-8479-41e9-8b8e-cd4e0a8060a9 tempest-DeleteServersTestJSON-769596624 None] Terminate volume connection completed successfully. Nov 06 17:46:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-161afc67-3c5a-46f6-8272-79d57ae66295 req-9cb3f396-8479-41e9-8b8e-cd4e0a8060a9 tempest-DeleteServersTestJSON-769596624 None] Deleting attachment 91b8fd8d-11c4-4015-b396-a11f9438ee21. {{(pid=87068) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 17:46:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8d5c191c-f619-43cd-9a78-a8e8b71e2a02 tempest-DeleteServersTestJSON-769596624 None] Acquiring lock "cinder-50b7ea42-f08f-4b7c-89a5-e2f614e97824-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:46:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8d5c191c-f619-43cd-9a78-a8e8b71e2a02 tempest-DeleteServersTestJSON-769596624 None] Lock "cinder-50b7ea42-f08f-4b7c-89a5-e2f614e97824-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:46:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8d5c191c-f619-43cd-9a78-a8e8b71e2a02 tempest-DeleteServersTestJSON-769596624 None] Acquiring lock "cinder-quobyte-50b7ea42-f08f-4b7c-89a5-e2f614e97824" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:46:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8d5c191c-f619-43cd-9a78-a8e8b71e2a02 tempest-DeleteServersTestJSON-769596624 None] Lock "cinder-quobyte-50b7ea42-f08f-4b7c-89a5-e2f614e97824" acquired by "delete_volume" :: waited 0.023s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:46:34 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[25feb407-ca5e-4143-ac6f-0a7bb541fef4]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:46:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8d5c191c-f619-43cd-9a78-a8e8b71e2a02 tempest-DeleteServersTestJSON-769596624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-50b7ea42-f08f-4b7c-89a5-e2f614e97824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:46:34 devstack sudo[90476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-50b7ea42-f08f-4b7c-89a5-e2f614e97824 Nov 06 17:46:34 devstack sudo[90476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:46:34 devstack sudo[90476]: pam_unix(sudo:session): session closed for user root Nov 06 17:46:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8d5c191c-f619-43cd-9a78-a8e8b71e2a02 tempest-DeleteServersTestJSON-769596624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-50b7ea42-f08f-4b7c-89a5-e2f614e97824" returned: 0 in 0.369s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:46:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8d5c191c-f619-43cd-9a78-a8e8b71e2a02 tempest-DeleteServersTestJSON-769596624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-50b7ea42-f08f-4b7c-89a5-e2f614e97824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:46:34 devstack sudo[90481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-50b7ea42-f08f-4b7c-89a5-e2f614e97824 Nov 06 17:46:34 devstack sudo[90481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:46:34 devstack sudo[90481]: pam_unix(sudo:session): session closed for user root Nov 06 17:46:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8d5c191c-f619-43cd-9a78-a8e8b71e2a02 tempest-DeleteServersTestJSON-769596624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-50b7ea42-f08f-4b7c-89a5-e2f614e97824" returned: 0 in 0.244s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:46:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8d5c191c-f619-43cd-9a78-a8e8b71e2a02 tempest-DeleteServersTestJSON-769596624 None] Lock "cinder-quobyte-50b7ea42-f08f-4b7c-89a5-e2f614e97824" released by "delete_volume" :: held 0.665s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:46:35 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-8d5c191c-f619-43cd-9a78-a8e8b71e2a02 tempest-DeleteServersTestJSON-769596624 None] Created reservations ['8dfb3c24-7551-4f5b-958c-29af07af1570', '8c1ab8c0-a4cd-47ab-af61-bcfc331c71ae', '7a3d73af-dcce-4180-9255-05f0bce05465', '026823e7-6cbd-478a-b4f6-12a0ac982ae6'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:46:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8d5c191c-f619-43cd-9a78-a8e8b71e2a02 tempest-DeleteServersTestJSON-769596624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:46:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8d5c191c-f619-43cd-9a78-a8e8b71e2a02 tempest-DeleteServersTestJSON-769596624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:46:35 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8d5c191c-f619-43cd-9a78-a8e8b71e2a02 tempest-DeleteServersTestJSON-769596624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:46:35 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8d5c191c-f619-43cd-9a78-a8e8b71e2a02 tempest-DeleteServersTestJSON-769596624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:46:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8d5c191c-f619-43cd-9a78-a8e8b71e2a02 tempest-DeleteServersTestJSON-769596624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:46:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8d5c191c-f619-43cd-9a78-a8e8b71e2a02 tempest-DeleteServersTestJSON-769596624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:46:35 devstack sudo[90484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:46:35 devstack sudo[90484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:46:35 devstack sudo[90484]: pam_unix(sudo:session): session closed for user root Nov 06 17:46:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8d5c191c-f619-43cd-9a78-a8e8b71e2a02 tempest-DeleteServersTestJSON-769596624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.306s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:46:35 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-8d5c191c-f619-43cd-9a78-a8e8b71e2a02 tempest-DeleteServersTestJSON-769596624 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:46:35 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-8d5c191c-f619-43cd-9a78-a8e8b71e2a02 tempest-DeleteServersTestJSON-769596624 None] Deleted volume successfully. Nov 06 17:46:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8d5c191c-f619-43cd-9a78-a8e8b71e2a02 tempest-DeleteServersTestJSON-769596624 None] Lock "cinder-50b7ea42-f08f-4b7c-89a5-e2f614e97824-delete_volume" released by "delete_volume" :: held 1.213s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:46:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-ad0effa9-ae52-4b65-bd77-063ac3ac0351 req-998cbd1a-20c8-4653-a3be-bb7321e88ea9 tempest-TaggedAttachmentsTest-1919826915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:46:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-ad0effa9-ae52-4b65-bd77-063ac3ac0351 req-998cbd1a-20c8-4653-a3be-bb7321e88ea9 tempest-TaggedAttachmentsTest-1919826915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:46:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-ad0effa9-ae52-4b65-bd77-063ac3ac0351 req-998cbd1a-20c8-4653-a3be-bb7321e88ea9 tempest-TaggedAttachmentsTest-1919826915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:46:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-ad0effa9-ae52-4b65-bd77-063ac3ac0351 req-998cbd1a-20c8-4653-a3be-bb7321e88ea9 tempest-TaggedAttachmentsTest-1919826915 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072', 'name': 'volume-ada0d808-5737-43f1-981c-bd4c657f2465', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'adfbebae-9207-4bab-8a2f-4180e74a1d67', 'enforce_multipath': True} {{(pid=87068) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 17:46:42 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-ad0effa9-ae52-4b65-bd77-063ac3ac0351 req-998cbd1a-20c8-4653-a3be-bb7321e88ea9 tempest-TaggedAttachmentsTest-1919826915 None] attachment_update completed successfully. Nov 06 17:46:45 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-a621331c-937e-40a6-925a-130b908bb159 req-e5488862-35d8-44ac-8783-fc4bcc28597a tempest-TaggedAttachmentsTest-1919826915 None] Terminate volume connection completed successfully. Nov 06 17:46:45 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-a621331c-937e-40a6-925a-130b908bb159 req-e5488862-35d8-44ac-8783-fc4bcc28597a tempest-TaggedAttachmentsTest-1919826915 None] Deleting attachment adfbebae-9207-4bab-8a2f-4180e74a1d67. {{(pid=87068) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 17:46:54 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 17:46:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:46:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:46:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:46:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:46:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:46:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:46:54 devstack sudo[91131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:46:54 devstack sudo[91131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:46:54 devstack sudo[91131]: pam_unix(sudo:session): session closed for user root Nov 06 17:46:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.380s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:46:54 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:46:54 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running periodic task VolumeManager._thread_info {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 17:46:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] thread count: 8 {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 17:46:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] thread info: [<_MainThread(MainThread, started 133940619505792)>, , , , , , , ] {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 17:46:55 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=21,cinder:UPDATE=14,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 17:46:55 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:UPDATE=14,cinder:SELECT=23,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 17:46:56 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-33f0648b-d6b6-4820-af44-6e9e75c90133 tempest-TaggedAttachmentsTest-1919826915 None] Acquiring lock "cinder-ada0d808-5737-43f1-981c-bd4c657f2465-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:46:56 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-33f0648b-d6b6-4820-af44-6e9e75c90133 tempest-TaggedAttachmentsTest-1919826915 None] Lock "cinder-ada0d808-5737-43f1-981c-bd4c657f2465-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:46:56 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-33f0648b-d6b6-4820-af44-6e9e75c90133 tempest-TaggedAttachmentsTest-1919826915 None] Acquiring lock "cinder-quobyte-ada0d808-5737-43f1-981c-bd4c657f2465" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:46:56 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-33f0648b-d6b6-4820-af44-6e9e75c90133 tempest-TaggedAttachmentsTest-1919826915 None] Lock "cinder-quobyte-ada0d808-5737-43f1-981c-bd4c657f2465" acquired by "delete_volume" :: waited 0.023s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:46:56 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[50abe295-5b00-4198-9e01-0279acfb0388]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:46:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-33f0648b-d6b6-4820-af44-6e9e75c90133 tempest-TaggedAttachmentsTest-1919826915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ada0d808-5737-43f1-981c-bd4c657f2465 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:46:57 devstack sudo[91158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ada0d808-5737-43f1-981c-bd4c657f2465 Nov 06 17:46:57 devstack sudo[91158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:46:57 devstack sudo[91158]: pam_unix(sudo:session): session closed for user root Nov 06 17:46:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-33f0648b-d6b6-4820-af44-6e9e75c90133 tempest-TaggedAttachmentsTest-1919826915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ada0d808-5737-43f1-981c-bd4c657f2465" returned: 0 in 0.404s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:46:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-33f0648b-d6b6-4820-af44-6e9e75c90133 tempest-TaggedAttachmentsTest-1919826915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ada0d808-5737-43f1-981c-bd4c657f2465 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:46:57 devstack sudo[91163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ada0d808-5737-43f1-981c-bd4c657f2465 Nov 06 17:46:57 devstack sudo[91163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:46:57 devstack sudo[91163]: pam_unix(sudo:session): session closed for user root Nov 06 17:46:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-33f0648b-d6b6-4820-af44-6e9e75c90133 tempest-TaggedAttachmentsTest-1919826915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ada0d808-5737-43f1-981c-bd4c657f2465" returned: 0 in 0.311s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:46:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-33f0648b-d6b6-4820-af44-6e9e75c90133 tempest-TaggedAttachmentsTest-1919826915 None] Lock "cinder-quobyte-ada0d808-5737-43f1-981c-bd4c657f2465" released by "delete_volume" :: held 0.778s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:46:57 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-33f0648b-d6b6-4820-af44-6e9e75c90133 tempest-TaggedAttachmentsTest-1919826915 None] Created reservations ['3cdb01a3-7795-4dcf-b772-3f1f65a7959f', 'd0fd3590-fb60-468d-bfff-882a93ea0bbd', 'e32585f9-1431-4807-9917-751913d1b40d', 'f1bdee7b-3c4e-4079-b9f0-6df6425dff0f'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:46:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-33f0648b-d6b6-4820-af44-6e9e75c90133 tempest-TaggedAttachmentsTest-1919826915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:46:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-33f0648b-d6b6-4820-af44-6e9e75c90133 tempest-TaggedAttachmentsTest-1919826915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:46:57 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-33f0648b-d6b6-4820-af44-6e9e75c90133 tempest-TaggedAttachmentsTest-1919826915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:46:57 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-33f0648b-d6b6-4820-af44-6e9e75c90133 tempest-TaggedAttachmentsTest-1919826915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:46:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-33f0648b-d6b6-4820-af44-6e9e75c90133 tempest-TaggedAttachmentsTest-1919826915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:46:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-33f0648b-d6b6-4820-af44-6e9e75c90133 tempest-TaggedAttachmentsTest-1919826915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:46:57 devstack sudo[91166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:46:57 devstack sudo[91166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:46:58 devstack sudo[91166]: pam_unix(sudo:session): session closed for user root Nov 06 17:46:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-33f0648b-d6b6-4820-af44-6e9e75c90133 tempest-TaggedAttachmentsTest-1919826915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.288s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:46:58 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-33f0648b-d6b6-4820-af44-6e9e75c90133 tempest-TaggedAttachmentsTest-1919826915 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:46:58 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-33f0648b-d6b6-4820-af44-6e9e75c90133 tempest-TaggedAttachmentsTest-1919826915 None] Deleted volume successfully. Nov 06 17:46:58 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-33f0648b-d6b6-4820-af44-6e9e75c90133 tempest-TaggedAttachmentsTest-1919826915 None] Lock "cinder-ada0d808-5737-43f1-981c-bd4c657f2465-delete_volume" released by "delete_volume" :: held 1.311s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:47:01 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-77e56269-f468-4c6d-bfb7-b2d5f37b72ca tempest-AttachVolumeShelveTestJSON-1940941598 None] Acquiring lock "cinder-1aa4b7e2-d657-407f-8ea5-8745b31339ac-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:47:01 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-77e56269-f468-4c6d-bfb7-b2d5f37b72ca tempest-AttachVolumeShelveTestJSON-1940941598 None] Lock "cinder-1aa4b7e2-d657-407f-8ea5-8745b31339ac-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:47:01 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-77e56269-f468-4c6d-bfb7-b2d5f37b72ca tempest-AttachVolumeShelveTestJSON-1940941598 None] Acquiring lock "cinder-quobyte-1aa4b7e2-d657-407f-8ea5-8745b31339ac" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:47:01 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-77e56269-f468-4c6d-bfb7-b2d5f37b72ca tempest-AttachVolumeShelveTestJSON-1940941598 None] Lock "cinder-quobyte-1aa4b7e2-d657-407f-8ea5-8745b31339ac" acquired by "delete_volume" :: waited 0.027s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:47:01 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[793f15fd-3400-44c1-91b7-0b2207f3789d]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:47:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-77e56269-f468-4c6d-bfb7-b2d5f37b72ca tempest-AttachVolumeShelveTestJSON-1940941598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1aa4b7e2-d657-407f-8ea5-8745b31339ac {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:47:01 devstack sudo[91177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1aa4b7e2-d657-407f-8ea5-8745b31339ac Nov 06 17:47:01 devstack sudo[91177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:47:01 devstack sudo[91177]: pam_unix(sudo:session): session closed for user root Nov 06 17:47:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-77e56269-f468-4c6d-bfb7-b2d5f37b72ca tempest-AttachVolumeShelveTestJSON-1940941598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1aa4b7e2-d657-407f-8ea5-8745b31339ac" returned: 0 in 0.423s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:47:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-77e56269-f468-4c6d-bfb7-b2d5f37b72ca tempest-AttachVolumeShelveTestJSON-1940941598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1aa4b7e2-d657-407f-8ea5-8745b31339ac {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:47:01 devstack sudo[91185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1aa4b7e2-d657-407f-8ea5-8745b31339ac Nov 06 17:47:01 devstack sudo[91185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:47:01 devstack sudo[91185]: pam_unix(sudo:session): session closed for user root Nov 06 17:47:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-77e56269-f468-4c6d-bfb7-b2d5f37b72ca tempest-AttachVolumeShelveTestJSON-1940941598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1aa4b7e2-d657-407f-8ea5-8745b31339ac" returned: 0 in 0.270s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:47:01 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-77e56269-f468-4c6d-bfb7-b2d5f37b72ca tempest-AttachVolumeShelveTestJSON-1940941598 None] Lock "cinder-quobyte-1aa4b7e2-d657-407f-8ea5-8745b31339ac" released by "delete_volume" :: held 0.747s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:47:02 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-77e56269-f468-4c6d-bfb7-b2d5f37b72ca tempest-AttachVolumeShelveTestJSON-1940941598 None] Created reservations ['c3ea7a08-6605-4762-bc40-4fb71df2cfb4', '06fb6ea1-1d65-4928-8b3d-d46e0322232d', '5245c7c9-84e2-4608-a1c0-1f612f6f62ae', '4987f0c9-2565-4465-b5cc-e58d123ddca5'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:47:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-77e56269-f468-4c6d-bfb7-b2d5f37b72ca tempest-AttachVolumeShelveTestJSON-1940941598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:47:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-77e56269-f468-4c6d-bfb7-b2d5f37b72ca tempest-AttachVolumeShelveTestJSON-1940941598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:47:02 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-77e56269-f468-4c6d-bfb7-b2d5f37b72ca tempest-AttachVolumeShelveTestJSON-1940941598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:47:02 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-77e56269-f468-4c6d-bfb7-b2d5f37b72ca tempest-AttachVolumeShelveTestJSON-1940941598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:47:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-77e56269-f468-4c6d-bfb7-b2d5f37b72ca tempest-AttachVolumeShelveTestJSON-1940941598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:47:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-77e56269-f468-4c6d-bfb7-b2d5f37b72ca tempest-AttachVolumeShelveTestJSON-1940941598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:47:02 devstack sudo[91188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:47:02 devstack sudo[91188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:47:02 devstack sudo[91188]: pam_unix(sudo:session): session closed for user root Nov 06 17:47:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-77e56269-f468-4c6d-bfb7-b2d5f37b72ca tempest-AttachVolumeShelveTestJSON-1940941598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.323s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:47:02 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-77e56269-f468-4c6d-bfb7-b2d5f37b72ca tempest-AttachVolumeShelveTestJSON-1940941598 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:47:02 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-77e56269-f468-4c6d-bfb7-b2d5f37b72ca tempest-AttachVolumeShelveTestJSON-1940941598 None] Deleted volume successfully. Nov 06 17:47:02 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-77e56269-f468-4c6d-bfb7-b2d5f37b72ca tempest-AttachVolumeShelveTestJSON-1940941598 None] Lock "cinder-1aa4b7e2-d657-407f-8ea5-8745b31339ac-delete_volume" released by "delete_volume" :: held 1.366s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:47:12 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=11,cinder:UPDATE=18,cinder:INSERT=4 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 17:47:12 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=9,cinder:INSERT=4,cinder:UPDATE=14,cinder:DELETE=2 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 17:47:16 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [req-ad3f1969-63da-4f07-ad38-8f9e3ed85b48 req-75d2f198-6bb6-46d6-a679-d333a75eebf1 tempest-VolumesGetTestJSON-14203665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:47:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-ad3f1969-63da-4f07-ad38-8f9e3ed85b48 req-75d2f198-6bb6-46d6-a679-d333a75eebf1 tempest-VolumesGetTestJSON-14203665 None] Flow 'volume_create_manager' (8a792239-393d-499d-a738-6d67793ae5cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:47:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-ad3f1969-63da-4f07-ad38-8f9e3ed85b48 req-75d2f198-6bb6-46d6-a679-d333a75eebf1 tempest-VolumesGetTestJSON-14203665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52600574-27c4-4f97-bf4b-963db336ac1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:47:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-ad3f1969-63da-4f07-ad38-8f9e3ed85b48 req-75d2f198-6bb6-46d6-a679-d333a75eebf1 tempest-VolumesGetTestJSON-14203665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52600574-27c4-4f97-bf4b-963db336ac1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:47:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1765890051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1352d251-8cc0-4ada-a503-cc54ae2b0326,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8d2af1593e074324a11eae71c07e980a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:47:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:47:16Z,use_quota=True,user_id='78d6808d51344b6e9ae7bbf19fc332b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:47:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-ad3f1969-63da-4f07-ad38-8f9e3ed85b48 req-75d2f198-6bb6-46d6-a679-d333a75eebf1 tempest-VolumesGetTestJSON-14203665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1685067e-3a0d-4edf-9275-299e51a22026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:47:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-ad3f1969-63da-4f07-ad38-8f9e3ed85b48 req-75d2f198-6bb6-46d6-a679-d333a75eebf1 tempest-VolumesGetTestJSON-14203665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1685067e-3a0d-4edf-9275-299e51a22026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:47:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-ad3f1969-63da-4f07-ad38-8f9e3ed85b48 req-75d2f198-6bb6-46d6-a679-d333a75eebf1 tempest-VolumesGetTestJSON-14203665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01ac4d03-a62b-4242-bfba-a9dc7cefd414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:47:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-ad3f1969-63da-4f07-ad38-8f9e3ed85b48 req-75d2f198-6bb6-46d6-a679-d333a75eebf1 tempest-VolumesGetTestJSON-14203665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01ac4d03-a62b-4242-bfba-a9dc7cefd414) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1352d251-8cc0-4ada-a503-cc54ae2b0326', 'volume_name': 'volume-1352d251-8cc0-4ada-a503-cc54ae2b0326', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:47:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-ad3f1969-63da-4f07-ad38-8f9e3ed85b48 req-75d2f198-6bb6-46d6-a679-d333a75eebf1 tempest-VolumesGetTestJSON-14203665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (497b6f28-53d7-4af5-b2c6-a77979ec61f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:47:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-ad3f1969-63da-4f07-ad38-8f9e3ed85b48 req-75d2f198-6bb6-46d6-a679-d333a75eebf1 tempest-VolumesGetTestJSON-14203665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (497b6f28-53d7-4af5-b2c6-a77979ec61f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:47:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-ad3f1969-63da-4f07-ad38-8f9e3ed85b48 req-75d2f198-6bb6-46d6-a679-d333a75eebf1 tempest-VolumesGetTestJSON-14203665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21f72e3d-8bf6-40cd-a1d3-a8c3d437c404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:47:16 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [req-ad3f1969-63da-4f07-ad38-8f9e3ed85b48 req-75d2f198-6bb6-46d6-a679-d333a75eebf1 tempest-VolumesGetTestJSON-14203665 None] Volume 1352d251-8cc0-4ada-a503-cc54ae2b0326: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1352d251-8cc0-4ada-a503-cc54ae2b0326', 'volume_size': 1} Nov 06 17:47:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-ad3f1969-63da-4f07-ad38-8f9e3ed85b48 req-75d2f198-6bb6-46d6-a679-d333a75eebf1 tempest-VolumesGetTestJSON-14203665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:47:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-ad3f1969-63da-4f07-ad38-8f9e3ed85b48 req-75d2f198-6bb6-46d6-a679-d333a75eebf1 tempest-VolumesGetTestJSON-14203665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:47:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [req-ad3f1969-63da-4f07-ad38-8f9e3ed85b48 req-75d2f198-6bb6-46d6-a679-d333a75eebf1 tempest-VolumesGetTestJSON-14203665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:47:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1765890051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1352d251-8cc0-4ada-a503-cc54ae2b0326,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8d2af1593e074324a11eae71c07e980a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:47:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:47:16Z,use_quota=True,user_id='78d6808d51344b6e9ae7bbf19fc332b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:47:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [req-ad3f1969-63da-4f07-ad38-8f9e3ed85b48 req-75d2f198-6bb6-46d6-a679-d333a75eebf1 tempest-VolumesGetTestJSON-14203665 None] Creating volume 1352d251-8cc0-4ada-a503-cc54ae2b0326 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:47:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-ad3f1969-63da-4f07-ad38-8f9e3ed85b48 req-75d2f198-6bb6-46d6-a679-d333a75eebf1 tempest-VolumesGetTestJSON-14203665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:47:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-ad3f1969-63da-4f07-ad38-8f9e3ed85b48 req-75d2f198-6bb6-46d6-a679-d333a75eebf1 tempest-VolumesGetTestJSON-14203665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:47:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [req-ad3f1969-63da-4f07-ad38-8f9e3ed85b48 req-75d2f198-6bb6-46d6-a679-d333a75eebf1 tempest-VolumesGetTestJSON-14203665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:47:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [req-ad3f1969-63da-4f07-ad38-8f9e3ed85b48 req-75d2f198-6bb6-46d6-a679-d333a75eebf1 tempest-VolumesGetTestJSON-14203665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:47:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-ad3f1969-63da-4f07-ad38-8f9e3ed85b48 req-75d2f198-6bb6-46d6-a679-d333a75eebf1 tempest-VolumesGetTestJSON-14203665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:47:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [req-ad3f1969-63da-4f07-ad38-8f9e3ed85b48 req-75d2f198-6bb6-46d6-a679-d333a75eebf1 tempest-VolumesGetTestJSON-14203665 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:47:16 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [req-ad3f1969-63da-4f07-ad38-8f9e3ed85b48 req-75d2f198-6bb6-46d6-a679-d333a75eebf1 tempest-VolumesGetTestJSON-14203665 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:47:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-ad3f1969-63da-4f07-ad38-8f9e3ed85b48 req-75d2f198-6bb6-46d6-a679-d333a75eebf1 tempest-VolumesGetTestJSON-14203665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1352d251-8cc0-4ada-a503-cc54ae2b0326 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:47:16 devstack sudo[91317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1352d251-8cc0-4ada-a503-cc54ae2b0326 1073741824 Nov 06 17:47:16 devstack sudo[91317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:47:17 devstack sudo[91317]: pam_unix(sudo:session): session closed for user root Nov 06 17:47:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-ad3f1969-63da-4f07-ad38-8f9e3ed85b48 req-75d2f198-6bb6-46d6-a679-d333a75eebf1 tempest-VolumesGetTestJSON-14203665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1352d251-8cc0-4ada-a503-cc54ae2b0326 1073741824" returned: 0 in 0.619s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:47:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-ad3f1969-63da-4f07-ad38-8f9e3ed85b48 req-75d2f198-6bb6-46d6-a679-d333a75eebf1 tempest-VolumesGetTestJSON-14203665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1352d251-8cc0-4ada-a503-cc54ae2b0326 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:47:17 devstack sudo[91324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1352d251-8cc0-4ada-a503-cc54ae2b0326 Nov 06 17:47:17 devstack sudo[91324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:47:17 devstack sudo[91324]: pam_unix(sudo:session): session closed for user root Nov 06 17:47:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-ad3f1969-63da-4f07-ad38-8f9e3ed85b48 req-75d2f198-6bb6-46d6-a679-d333a75eebf1 tempest-VolumesGetTestJSON-14203665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1352d251-8cc0-4ada-a503-cc54ae2b0326" returned: 0 in 0.382s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:47:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [req-ad3f1969-63da-4f07-ad38-8f9e3ed85b48 req-75d2f198-6bb6-46d6-a679-d333a75eebf1 tempest-VolumesGetTestJSON-14203665 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:47:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-ad3f1969-63da-4f07-ad38-8f9e3ed85b48 req-75d2f198-6bb6-46d6-a679-d333a75eebf1 tempest-VolumesGetTestJSON-14203665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:47:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-ad3f1969-63da-4f07-ad38-8f9e3ed85b48 req-75d2f198-6bb6-46d6-a679-d333a75eebf1 tempest-VolumesGetTestJSON-14203665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21f72e3d-8bf6-40cd-a1d3-a8c3d437c404) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1352d251-8cc0-4ada-a503-cc54ae2b0326', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:47:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-ad3f1969-63da-4f07-ad38-8f9e3ed85b48 req-75d2f198-6bb6-46d6-a679-d333a75eebf1 tempest-VolumesGetTestJSON-14203665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7b1c41e-2802-49c3-acd5-17cc8952735e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:47:17 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [req-ad3f1969-63da-4f07-ad38-8f9e3ed85b48 req-75d2f198-6bb6-46d6-a679-d333a75eebf1 tempest-VolumesGetTestJSON-14203665 None] Volume volume-1352d251-8cc0-4ada-a503-cc54ae2b0326 (1352d251-8cc0-4ada-a503-cc54ae2b0326): created successfully Nov 06 17:47:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-ad3f1969-63da-4f07-ad38-8f9e3ed85b48 req-75d2f198-6bb6-46d6-a679-d333a75eebf1 tempest-VolumesGetTestJSON-14203665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7b1c41e-2802-49c3-acd5-17cc8952735e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:47:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-ad3f1969-63da-4f07-ad38-8f9e3ed85b48 req-75d2f198-6bb6-46d6-a679-d333a75eebf1 tempest-VolumesGetTestJSON-14203665 None] Flow 'volume_create_manager' (8a792239-393d-499d-a738-6d67793ae5cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:47:17 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-ad3f1969-63da-4f07-ad38-8f9e3ed85b48 req-75d2f198-6bb6-46d6-a679-d333a75eebf1 tempest-VolumesGetTestJSON-14203665 None] Created volume successfully. Nov 06 17:47:19 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-20ff935e-8788-40df-80ed-edd0cabfae56 req-e36a14fa-eee6-4198-97a1-21dc63573f8b tempest-VolumesGetTestJSON-14203665 None] Acquiring lock "cinder-1352d251-8cc0-4ada-a503-cc54ae2b0326-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:47:19 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-20ff935e-8788-40df-80ed-edd0cabfae56 req-e36a14fa-eee6-4198-97a1-21dc63573f8b tempest-VolumesGetTestJSON-14203665 None] Lock "cinder-1352d251-8cc0-4ada-a503-cc54ae2b0326-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:47:19 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-20ff935e-8788-40df-80ed-edd0cabfae56 req-e36a14fa-eee6-4198-97a1-21dc63573f8b tempest-VolumesGetTestJSON-14203665 None] Acquiring lock "cinder-quobyte-1352d251-8cc0-4ada-a503-cc54ae2b0326" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:47:19 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-20ff935e-8788-40df-80ed-edd0cabfae56 req-e36a14fa-eee6-4198-97a1-21dc63573f8b tempest-VolumesGetTestJSON-14203665 None] Lock "cinder-quobyte-1352d251-8cc0-4ada-a503-cc54ae2b0326" acquired by "delete_volume" :: waited 0.024s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:47:19 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fdf2a8c-89a0-486d-bf72-dc0453ddaea9]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:47:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-20ff935e-8788-40df-80ed-edd0cabfae56 req-e36a14fa-eee6-4198-97a1-21dc63573f8b tempest-VolumesGetTestJSON-14203665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1352d251-8cc0-4ada-a503-cc54ae2b0326 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:47:19 devstack sudo[91332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1352d251-8cc0-4ada-a503-cc54ae2b0326 Nov 06 17:47:19 devstack sudo[91332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:47:19 devstack sudo[91332]: pam_unix(sudo:session): session closed for user root Nov 06 17:47:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-20ff935e-8788-40df-80ed-edd0cabfae56 req-e36a14fa-eee6-4198-97a1-21dc63573f8b tempest-VolumesGetTestJSON-14203665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1352d251-8cc0-4ada-a503-cc54ae2b0326" returned: 0 in 0.486s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:47:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-20ff935e-8788-40df-80ed-edd0cabfae56 req-e36a14fa-eee6-4198-97a1-21dc63573f8b tempest-VolumesGetTestJSON-14203665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1352d251-8cc0-4ada-a503-cc54ae2b0326 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:47:19 devstack sudo[91339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1352d251-8cc0-4ada-a503-cc54ae2b0326 Nov 06 17:47:19 devstack sudo[91339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:47:20 devstack sudo[91339]: pam_unix(sudo:session): session closed for user root Nov 06 17:47:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-20ff935e-8788-40df-80ed-edd0cabfae56 req-e36a14fa-eee6-4198-97a1-21dc63573f8b tempest-VolumesGetTestJSON-14203665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1352d251-8cc0-4ada-a503-cc54ae2b0326" returned: 0 in 0.512s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:47:20 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-20ff935e-8788-40df-80ed-edd0cabfae56 req-e36a14fa-eee6-4198-97a1-21dc63573f8b tempest-VolumesGetTestJSON-14203665 None] Lock "cinder-quobyte-1352d251-8cc0-4ada-a503-cc54ae2b0326" released by "delete_volume" :: held 1.099s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:47:20 devstack cinder-volume[87068]: DEBUG cinder.quota [req-20ff935e-8788-40df-80ed-edd0cabfae56 req-e36a14fa-eee6-4198-97a1-21dc63573f8b tempest-VolumesGetTestJSON-14203665 None] Created reservations ['b4fc4e43-16c1-46d2-a8f5-83c4aed0d0cb', '48fe2229-e759-45a0-a241-ab45a7672ef0', '6603d78b-5685-4f56-aef8-a6b069c0aa7f', '712f056f-7c92-497f-8b51-83b7ac36f9cc'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:47:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-20ff935e-8788-40df-80ed-edd0cabfae56 req-e36a14fa-eee6-4198-97a1-21dc63573f8b tempest-VolumesGetTestJSON-14203665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:47:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-20ff935e-8788-40df-80ed-edd0cabfae56 req-e36a14fa-eee6-4198-97a1-21dc63573f8b tempest-VolumesGetTestJSON-14203665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:47:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [req-20ff935e-8788-40df-80ed-edd0cabfae56 req-e36a14fa-eee6-4198-97a1-21dc63573f8b tempest-VolumesGetTestJSON-14203665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:47:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [req-20ff935e-8788-40df-80ed-edd0cabfae56 req-e36a14fa-eee6-4198-97a1-21dc63573f8b tempest-VolumesGetTestJSON-14203665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:47:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-20ff935e-8788-40df-80ed-edd0cabfae56 req-e36a14fa-eee6-4198-97a1-21dc63573f8b tempest-VolumesGetTestJSON-14203665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:47:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-20ff935e-8788-40df-80ed-edd0cabfae56 req-e36a14fa-eee6-4198-97a1-21dc63573f8b tempest-VolumesGetTestJSON-14203665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:47:20 devstack sudo[91343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:47:20 devstack sudo[91343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:47:21 devstack sudo[91343]: pam_unix(sudo:session): session closed for user root Nov 06 17:47:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-20ff935e-8788-40df-80ed-edd0cabfae56 req-e36a14fa-eee6-4198-97a1-21dc63573f8b tempest-VolumesGetTestJSON-14203665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.417s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:47:21 devstack cinder-volume[87068]: DEBUG cinder.manager [req-20ff935e-8788-40df-80ed-edd0cabfae56 req-e36a14fa-eee6-4198-97a1-21dc63573f8b tempest-VolumesGetTestJSON-14203665 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:47:21 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-20ff935e-8788-40df-80ed-edd0cabfae56 req-e36a14fa-eee6-4198-97a1-21dc63573f8b tempest-VolumesGetTestJSON-14203665 None] Deleted volume successfully. Nov 06 17:47:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-20ff935e-8788-40df-80ed-edd0cabfae56 req-e36a14fa-eee6-4198-97a1-21dc63573f8b tempest-VolumesGetTestJSON-14203665 None] Lock "cinder-1352d251-8cc0-4ada-a503-cc54ae2b0326-delete_volume" released by "delete_volume" :: held 2.061s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:47:30 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:UPDATE=13,cinder:SELECT=6,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 17:47:31 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=8,cinder:UPDATE=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 17:47:37 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-8f459a21-86d3-4f4a-96f5-32190d3f3405 tempest-GroupSnapshotsTest-200721168 None] Group tempest-GroupSnapshotsTest-Group-1968065612: creating Nov 06 17:47:37 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-8f459a21-86d3-4f4a-96f5-32190d3f3405 tempest-GroupSnapshotsTest-200721168 None] Group tempest-GroupSnapshotsTest-Group-1968065612: created successfully Nov 06 17:47:37 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-8f459a21-86d3-4f4a-96f5-32190d3f3405 tempest-GroupSnapshotsTest-200721168 None] Create group completed successfully. Nov 06 17:47:38 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3322a65-e1a4-4fa1-a799-e72fccff8fe2 tempest-ServerActionsTestOtherA-1480259007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:47:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c3322a65-e1a4-4fa1-a799-e72fccff8fe2 tempest-ServerActionsTestOtherA-1480259007 None] Flow 'volume_create_manager' (39e0de03-693c-4114-bc39-045e424420ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:47:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c3322a65-e1a4-4fa1-a799-e72fccff8fe2 tempest-ServerActionsTestOtherA-1480259007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b9fae5c-fe5c-4a24-aa2d-a768987d2a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:47:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c3322a65-e1a4-4fa1-a799-e72fccff8fe2 tempest-ServerActionsTestOtherA-1480259007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b9fae5c-fe5c-4a24-aa2d-a768987d2a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:47:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1693922426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=459474e7-2a9c-4265-9f62-8b738b7531b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0c73c13fe8543f19021e9a4d51ecd4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:47:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:47:38Z,use_quota=True,user_id='6321867b95d34ba6b8f5d17ccfe205f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:47:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c3322a65-e1a4-4fa1-a799-e72fccff8fe2 tempest-ServerActionsTestOtherA-1480259007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e36f0ba-a163-48ec-9d05-e7e79cee0cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:47:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c3322a65-e1a4-4fa1-a799-e72fccff8fe2 tempest-ServerActionsTestOtherA-1480259007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e36f0ba-a163-48ec-9d05-e7e79cee0cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:47:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c3322a65-e1a4-4fa1-a799-e72fccff8fe2 tempest-ServerActionsTestOtherA-1480259007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f18d40f-1b78-463a-b152-94d6b1eb9c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:47:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c3322a65-e1a4-4fa1-a799-e72fccff8fe2 tempest-ServerActionsTestOtherA-1480259007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f18d40f-1b78-463a-b152-94d6b1eb9c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '459474e7-2a9c-4265-9f62-8b738b7531b7', 'volume_name': 'volume-459474e7-2a9c-4265-9f62-8b738b7531b7', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:47:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c3322a65-e1a4-4fa1-a799-e72fccff8fe2 tempest-ServerActionsTestOtherA-1480259007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbf403a5-23d8-46a7-9f8e-64d06206f040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:47:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c3322a65-e1a4-4fa1-a799-e72fccff8fe2 tempest-ServerActionsTestOtherA-1480259007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbf403a5-23d8-46a7-9f8e-64d06206f040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:47:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c3322a65-e1a4-4fa1-a799-e72fccff8fe2 tempest-ServerActionsTestOtherA-1480259007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02525ab2-aa4b-4827-b96e-d57ac028bb38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:47:38 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-c3322a65-e1a4-4fa1-a799-e72fccff8fe2 tempest-ServerActionsTestOtherA-1480259007 None] Volume 459474e7-2a9c-4265-9f62-8b738b7531b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-459474e7-2a9c-4265-9f62-8b738b7531b7', 'volume_size': 1} Nov 06 17:47:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c3322a65-e1a4-4fa1-a799-e72fccff8fe2 tempest-ServerActionsTestOtherA-1480259007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:47:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c3322a65-e1a4-4fa1-a799-e72fccff8fe2 tempest-ServerActionsTestOtherA-1480259007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:47:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c3322a65-e1a4-4fa1-a799-e72fccff8fe2 tempest-ServerActionsTestOtherA-1480259007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:47:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1693922426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=459474e7-2a9c-4265-9f62-8b738b7531b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0c73c13fe8543f19021e9a4d51ecd4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:47:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:47:38Z,use_quota=True,user_id='6321867b95d34ba6b8f5d17ccfe205f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:47:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-c3322a65-e1a4-4fa1-a799-e72fccff8fe2 tempest-ServerActionsTestOtherA-1480259007 None] Creating volume 459474e7-2a9c-4265-9f62-8b738b7531b7 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:47:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c3322a65-e1a4-4fa1-a799-e72fccff8fe2 tempest-ServerActionsTestOtherA-1480259007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:47:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c3322a65-e1a4-4fa1-a799-e72fccff8fe2 tempest-ServerActionsTestOtherA-1480259007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:47:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c3322a65-e1a4-4fa1-a799-e72fccff8fe2 tempest-ServerActionsTestOtherA-1480259007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:47:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c3322a65-e1a4-4fa1-a799-e72fccff8fe2 tempest-ServerActionsTestOtherA-1480259007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:47:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c3322a65-e1a4-4fa1-a799-e72fccff8fe2 tempest-ServerActionsTestOtherA-1480259007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:47:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c3322a65-e1a4-4fa1-a799-e72fccff8fe2 tempest-ServerActionsTestOtherA-1480259007 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:47:38 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-c3322a65-e1a4-4fa1-a799-e72fccff8fe2 tempest-ServerActionsTestOtherA-1480259007 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:47:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c3322a65-e1a4-4fa1-a799-e72fccff8fe2 tempest-ServerActionsTestOtherA-1480259007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-459474e7-2a9c-4265-9f62-8b738b7531b7 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:47:38 devstack sudo[91486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-459474e7-2a9c-4265-9f62-8b738b7531b7 1073741824 Nov 06 17:47:38 devstack sudo[91486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:47:39 devstack sudo[91486]: pam_unix(sudo:session): session closed for user root Nov 06 17:47:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c3322a65-e1a4-4fa1-a799-e72fccff8fe2 tempest-ServerActionsTestOtherA-1480259007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-459474e7-2a9c-4265-9f62-8b738b7531b7 1073741824" returned: 0 in 0.732s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:47:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c3322a65-e1a4-4fa1-a799-e72fccff8fe2 tempest-ServerActionsTestOtherA-1480259007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-459474e7-2a9c-4265-9f62-8b738b7531b7 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:47:39 devstack sudo[91492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-459474e7-2a9c-4265-9f62-8b738b7531b7 Nov 06 17:47:39 devstack sudo[91492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:47:39 devstack sudo[91492]: pam_unix(sudo:session): session closed for user root Nov 06 17:47:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c3322a65-e1a4-4fa1-a799-e72fccff8fe2 tempest-ServerActionsTestOtherA-1480259007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-459474e7-2a9c-4265-9f62-8b738b7531b7" returned: 0 in 0.466s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:47:39 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c3322a65-e1a4-4fa1-a799-e72fccff8fe2 tempest-ServerActionsTestOtherA-1480259007 None] <== create_volume: return (1300ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:47:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c3322a65-e1a4-4fa1-a799-e72fccff8fe2 tempest-ServerActionsTestOtherA-1480259007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.307s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:47:39 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c3322a65-e1a4-4fa1-a799-e72fccff8fe2 tempest-ServerActionsTestOtherA-1480259007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02525ab2-aa4b-4827-b96e-d57ac028bb38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-459474e7-2a9c-4265-9f62-8b738b7531b7', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:47:39 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c3322a65-e1a4-4fa1-a799-e72fccff8fe2 tempest-ServerActionsTestOtherA-1480259007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffd3d1a4-16e8-405f-886b-f5a195b46cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:47:39 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-c3322a65-e1a4-4fa1-a799-e72fccff8fe2 tempest-ServerActionsTestOtherA-1480259007 None] Volume volume-459474e7-2a9c-4265-9f62-8b738b7531b7 (459474e7-2a9c-4265-9f62-8b738b7531b7): created successfully Nov 06 17:47:39 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c3322a65-e1a4-4fa1-a799-e72fccff8fe2 tempest-ServerActionsTestOtherA-1480259007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffd3d1a4-16e8-405f-886b-f5a195b46cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:47:40 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c3322a65-e1a4-4fa1-a799-e72fccff8fe2 tempest-ServerActionsTestOtherA-1480259007 None] Flow 'volume_create_manager' (39e0de03-693c-4114-bc39-045e424420ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:47:40 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-c3322a65-e1a4-4fa1-a799-e72fccff8fe2 tempest-ServerActionsTestOtherA-1480259007 None] Created volume successfully. Nov 06 17:47:40 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-4817e604-b8e5-4de5-a74d-5a84de6f79b1 tempest-GroupSnapshotsTest-200721168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:47:40 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4817e604-b8e5-4de5-a74d-5a84de6f79b1 tempest-GroupSnapshotsTest-200721168 None] Flow 'volume_create_manager' (0d125d04-a02d-43b9-acf2-b6fcbdf8feee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:47:40 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4817e604-b8e5-4de5-a74d-5a84de6f79b1 tempest-GroupSnapshotsTest-200721168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (890eb58b-c069-49a9-a0dd-8d6ff6eff46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:47:40 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4817e604-b8e5-4de5-a74d-5a84de6f79b1 tempest-GroupSnapshotsTest-200721168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (890eb58b-c069-49a9-a0dd-8d6ff6eff46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:47:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1863968062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7ec27c0a-250c-4ce6-8c29-a00393af18bb,host='devstack@QuobyteHD#QuobyteHD',id=250b5bfa-ae6a-4d43-b7cc-d294f4003e44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc68bbf6525c4727a32d77d254bbbc75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:47:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:47:40Z,use_quota=True,user_id='e62775d7e794453ca97d7197939d35bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ce510ec-8f2a-459c-9a89-0391f5b590b2),volume_type_id=3ce510ec-8f2a-459c-9a89-0391f5b590b2)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:47:40 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4817e604-b8e5-4de5-a74d-5a84de6f79b1 tempest-GroupSnapshotsTest-200721168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6ff529d-0d66-4620-b7fb-938e3b2635ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:47:40 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4817e604-b8e5-4de5-a74d-5a84de6f79b1 tempest-GroupSnapshotsTest-200721168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6ff529d-0d66-4620-b7fb-938e3b2635ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:47:40 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4817e604-b8e5-4de5-a74d-5a84de6f79b1 tempest-GroupSnapshotsTest-200721168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (889bb4b9-ca81-48db-bfe7-6dcfc9bea25b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:47:40 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4817e604-b8e5-4de5-a74d-5a84de6f79b1 tempest-GroupSnapshotsTest-200721168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (889bb4b9-ca81-48db-bfe7-6dcfc9bea25b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '250b5bfa-ae6a-4d43-b7cc-d294f4003e44', 'volume_name': 'volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:47:40 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4817e604-b8e5-4de5-a74d-5a84de6f79b1 tempest-GroupSnapshotsTest-200721168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0485b360-b5fa-4ec9-872a-392e2f47ccdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:47:40 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4817e604-b8e5-4de5-a74d-5a84de6f79b1 tempest-GroupSnapshotsTest-200721168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0485b360-b5fa-4ec9-872a-392e2f47ccdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:47:40 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4817e604-b8e5-4de5-a74d-5a84de6f79b1 tempest-GroupSnapshotsTest-200721168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5db0d9a-79d6-4815-bfe3-90d373371e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:47:40 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-4817e604-b8e5-4de5-a74d-5a84de6f79b1 tempest-GroupSnapshotsTest-200721168 None] Volume 250b5bfa-ae6a-4d43-b7cc-d294f4003e44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44', 'volume_size': 1} Nov 06 17:47:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4817e604-b8e5-4de5-a74d-5a84de6f79b1 tempest-GroupSnapshotsTest-200721168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:47:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4817e604-b8e5-4de5-a74d-5a84de6f79b1 tempest-GroupSnapshotsTest-200721168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:47:40 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4817e604-b8e5-4de5-a74d-5a84de6f79b1 tempest-GroupSnapshotsTest-200721168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7ec27c0a-250c-4ce6-8c29-a00393af18bb,created_at=2026-11-06T16:47:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1863968062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7ec27c0a-250c-4ce6-8c29-a00393af18bb,host='devstack@QuobyteHD#QuobyteHD',id=250b5bfa-ae6a-4d43-b7cc-d294f4003e44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc68bbf6525c4727a32d77d254bbbc75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:47:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:47:40Z,use_quota=True,user_id='e62775d7e794453ca97d7197939d35bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ce510ec-8f2a-459c-9a89-0391f5b590b2),volume_type_id=3ce510ec-8f2a-459c-9a89-0391f5b590b2)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:47:40 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-4817e604-b8e5-4de5-a74d-5a84de6f79b1 tempest-GroupSnapshotsTest-200721168 None] Creating volume 250b5bfa-ae6a-4d43-b7cc-d294f4003e44 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:47:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4817e604-b8e5-4de5-a74d-5a84de6f79b1 tempest-GroupSnapshotsTest-200721168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:47:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4817e604-b8e5-4de5-a74d-5a84de6f79b1 tempest-GroupSnapshotsTest-200721168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:47:40 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4817e604-b8e5-4de5-a74d-5a84de6f79b1 tempest-GroupSnapshotsTest-200721168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:47:40 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4817e604-b8e5-4de5-a74d-5a84de6f79b1 tempest-GroupSnapshotsTest-200721168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:47:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4817e604-b8e5-4de5-a74d-5a84de6f79b1 tempest-GroupSnapshotsTest-200721168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:47:40 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4817e604-b8e5-4de5-a74d-5a84de6f79b1 tempest-GroupSnapshotsTest-200721168 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:47:40 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-4817e604-b8e5-4de5-a74d-5a84de6f79b1 tempest-GroupSnapshotsTest-200721168 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:47:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4817e604-b8e5-4de5-a74d-5a84de6f79b1 tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:47:40 devstack sudo[91499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44 1073741824 Nov 06 17:47:40 devstack sudo[91499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:47:41 devstack sudo[91499]: pam_unix(sudo:session): session closed for user root Nov 06 17:47:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4817e604-b8e5-4de5-a74d-5a84de6f79b1 tempest-GroupSnapshotsTest-200721168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44 1073741824" returned: 0 in 0.906s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:47:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4817e604-b8e5-4de5-a74d-5a84de6f79b1 tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:47:41 devstack sudo[91539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44 Nov 06 17:47:41 devstack sudo[91539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:47:41 devstack sudo[91539]: pam_unix(sudo:session): session closed for user root Nov 06 17:47:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4817e604-b8e5-4de5-a74d-5a84de6f79b1 tempest-GroupSnapshotsTest-200721168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44" returned: 0 in 0.731s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:47:41 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4817e604-b8e5-4de5-a74d-5a84de6f79b1 tempest-GroupSnapshotsTest-200721168 None] <== create_volume: return (1789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:47:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4817e604-b8e5-4de5-a74d-5a84de6f79b1 tempest-GroupSnapshotsTest-200721168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.793s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:47:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4817e604-b8e5-4de5-a74d-5a84de6f79b1 tempest-GroupSnapshotsTest-200721168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5db0d9a-79d6-4815-bfe3-90d373371e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:47:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4817e604-b8e5-4de5-a74d-5a84de6f79b1 tempest-GroupSnapshotsTest-200721168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d64fd59-44e5-464d-91d2-9b87b4b05971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:47:42 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-4817e604-b8e5-4de5-a74d-5a84de6f79b1 tempest-GroupSnapshotsTest-200721168 None] Volume volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44 (250b5bfa-ae6a-4d43-b7cc-d294f4003e44): created successfully Nov 06 17:47:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4817e604-b8e5-4de5-a74d-5a84de6f79b1 tempest-GroupSnapshotsTest-200721168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d64fd59-44e5-464d-91d2-9b87b4b05971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:47:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4817e604-b8e5-4de5-a74d-5a84de6f79b1 tempest-GroupSnapshotsTest-200721168 None] Flow 'volume_create_manager' (0d125d04-a02d-43b9-acf2-b6fcbdf8feee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:47:42 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-4817e604-b8e5-4de5-a74d-5a84de6f79b1 tempest-GroupSnapshotsTest-200721168 None] Created volume successfully. Nov 06 17:47:43 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-6ee7f4d8-7984-45b0-a06b-6ed458263aab tempest-GroupSnapshotsTest-200721168 None] GroupSnapshot a3aa2929-0465-46c6-90b3-a316aae92e6c: creating. Nov 06 17:47:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6ee7f4d8-7984-45b0-a06b-6ed458263aab tempest-GroupSnapshotsTest-200721168 None] Group snapshot a3aa2929-0465-46c6-90b3-a316aae92e6c: creating. {{(pid=87068) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 06 17:47:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6ee7f4d8-7984-45b0-a06b-6ed458263aab tempest-GroupSnapshotsTest-200721168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:47:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6ee7f4d8-7984-45b0-a06b-6ed458263aab tempest-GroupSnapshotsTest-200721168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:47:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-6ee7f4d8-7984-45b0-a06b-6ed458263aab tempest-GroupSnapshotsTest-200721168 None] Creating offline snapshot 987d8aa2-740e-480e-8451-0c85cdcdb529 of volume 250b5bfa-ae6a-4d43-b7cc-d294f4003e44 {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 17:47:43 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0bebbd-d046-48fc-a6de-ed47fbafad15]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:47:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6ee7f4d8-7984-45b0-a06b-6ed458263aab tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:47:43 devstack sudo[91632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44 Nov 06 17:47:43 devstack sudo[91632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:47:43 devstack sudo[91632]: pam_unix(sudo:session): session closed for user root Nov 06 17:47:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6ee7f4d8-7984-45b0-a06b-6ed458263aab tempest-GroupSnapshotsTest-200721168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44" returned: 0 in 0.421s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:47:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6ee7f4d8-7984-45b0-a06b-6ed458263aab tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44.987d8aa2-740e-480e-8451-0c85cdcdb529 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:47:43 devstack sudo[91639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44.987d8aa2-740e-480e-8451-0c85cdcdb529 1G Nov 06 17:47:43 devstack sudo[91639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:47:44 devstack sudo[91639]: pam_unix(sudo:session): session closed for user root Nov 06 17:47:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6ee7f4d8-7984-45b0-a06b-6ed458263aab tempest-GroupSnapshotsTest-200721168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44.987d8aa2-740e-480e-8451-0c85cdcdb529 1G" returned: 0 in 0.550s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:47:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6ee7f4d8-7984-45b0-a06b-6ed458263aab tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44.987d8aa2-740e-480e-8451-0c85cdcdb529 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:47:44 devstack sudo[91648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44.987d8aa2-740e-480e-8451-0c85cdcdb529 Nov 06 17:47:44 devstack sudo[91648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:47:44 devstack sudo[91648]: pam_unix(sudo:session): session closed for user root Nov 06 17:47:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6ee7f4d8-7984-45b0-a06b-6ed458263aab tempest-GroupSnapshotsTest-200721168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44.987d8aa2-740e-480e-8451-0c85cdcdb529" returned: 0 in 0.413s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:47:44 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-6ee7f4d8-7984-45b0-a06b-6ed458263aab tempest-GroupSnapshotsTest-200721168 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44.987d8aa2-740e-480e-8451-0c85cdcdb529 is being set with open permissions: ugo+rw: NotImplementedError Nov 06 17:47:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6ee7f4d8-7984-45b0-a06b-6ed458263aab tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44.987d8aa2-740e-480e-8451-0c85cdcdb529 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:47:44 devstack sudo[91655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44.987d8aa2-740e-480e-8451-0c85cdcdb529 Nov 06 17:47:44 devstack sudo[91655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:47:45 devstack sudo[91655]: pam_unix(sudo:session): session closed for user root Nov 06 17:47:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6ee7f4d8-7984-45b0-a06b-6ed458263aab tempest-GroupSnapshotsTest-200721168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44.987d8aa2-740e-480e-8451-0c85cdcdb529" returned: 0 in 0.388s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:47:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6ee7f4d8-7984-45b0-a06b-6ed458263aab tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:47:45 devstack sudo[91658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44.info Nov 06 17:47:45 devstack sudo[91658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:47:45 devstack sudo[91658]: pam_unix(sudo:session): session closed for user root Nov 06 17:47:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6ee7f4d8-7984-45b0-a06b-6ed458263aab tempest-GroupSnapshotsTest-200721168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44.info" returned: 0 in 0.392s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:47:45 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-6ee7f4d8-7984-45b0-a06b-6ed458263aab tempest-GroupSnapshotsTest-200721168 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 17:47:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6ee7f4d8-7984-45b0-a06b-6ed458263aab tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:47:45 devstack sudo[91661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44.info Nov 06 17:47:45 devstack sudo[91661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:47:46 devstack sudo[91661]: pam_unix(sudo:session): session closed for user root Nov 06 17:47:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6ee7f4d8-7984-45b0-a06b-6ed458263aab tempest-GroupSnapshotsTest-200721168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44.info" returned: 0 in 0.395s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:47:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6ee7f4d8-7984-45b0-a06b-6ed458263aab tempest-GroupSnapshotsTest-200721168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.763s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:47:46 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-6ee7f4d8-7984-45b0-a06b-6ed458263aab tempest-GroupSnapshotsTest-200721168 None] group_snapshot a3aa2929-0465-46c6-90b3-a316aae92e6c: created successfully Nov 06 17:47:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-360f26c8-29e9-49e7-a051-1083095a04b1 tempest-GroupSnapshotsTest-200721168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:47:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-360f26c8-29e9-49e7-a051-1083095a04b1 tempest-GroupSnapshotsTest-200721168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:47:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-360f26c8-29e9-49e7-a051-1083095a04b1 tempest-GroupSnapshotsTest-200721168 None] Acquiring lock "cinder-quobyte-987d8aa2-740e-480e-8451-0c85cdcdb529-7e094f9e-6c97-4ed6-b4f2-68307f003123" by "_create_volume_from_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:47:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-360f26c8-29e9-49e7-a051-1083095a04b1 tempest-GroupSnapshotsTest-200721168 None] Lock "cinder-quobyte-987d8aa2-740e-480e-8451-0c85cdcdb529-7e094f9e-6c97-4ed6-b4f2-68307f003123" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:47:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-360f26c8-29e9-49e7-a051-1083095a04b1 tempest-GroupSnapshotsTest-200721168 None] Creating volume 7e094f9e-6c97-4ed6-b4f2-68307f003123 from snapshot 987d8aa2-740e-480e-8451-0c85cdcdb529 {{(pid=87068) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 17:47:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-360f26c8-29e9-49e7-a051-1083095a04b1 tempest-GroupSnapshotsTest-200721168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:47:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-360f26c8-29e9-49e7-a051-1083095a04b1 tempest-GroupSnapshotsTest-200721168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:47:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-360f26c8-29e9-49e7-a051-1083095a04b1 tempest-GroupSnapshotsTest-200721168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:47:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-360f26c8-29e9-49e7-a051-1083095a04b1 tempest-GroupSnapshotsTest-200721168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:47:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-360f26c8-29e9-49e7-a051-1083095a04b1 tempest-GroupSnapshotsTest-200721168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:47:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-360f26c8-29e9-49e7-a051-1083095a04b1 tempest-GroupSnapshotsTest-200721168 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:47:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-360f26c8-29e9-49e7-a051-1083095a04b1 tempest-GroupSnapshotsTest-200721168 None] Acquiring lock "cinder-quobyte-7e094f9e-6c97-4ed6-b4f2-68307f003123" by "_copy_volume_from_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:47:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-360f26c8-29e9-49e7-a051-1083095a04b1 tempest-GroupSnapshotsTest-200721168 None] Lock "cinder-quobyte-7e094f9e-6c97-4ed6-b4f2-68307f003123" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:47:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-360f26c8-29e9-49e7-a051-1083095a04b1 tempest-GroupSnapshotsTest-200721168 None] snapshot: 987d8aa2-740e-480e-8451-0c85cdcdb529, volume: 7e094f9e-6c97-4ed6-b4f2-68307f003123, {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 17:47:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-360f26c8-29e9-49e7-a051-1083095a04b1 tempest-GroupSnapshotsTest-200721168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:47:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-360f26c8-29e9-49e7-a051-1083095a04b1 tempest-GroupSnapshotsTest-200721168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:47:48 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-360f26c8-29e9-49e7-a051-1083095a04b1 tempest-GroupSnapshotsTest-200721168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:47:48 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-360f26c8-29e9-49e7-a051-1083095a04b1 tempest-GroupSnapshotsTest-200721168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:47:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-360f26c8-29e9-49e7-a051-1083095a04b1 tempest-GroupSnapshotsTest-200721168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:47:48 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b27ac3c-177d-4616-a652-6446db074e17]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:47:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-360f26c8-29e9-49e7-a051-1083095a04b1 tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44.987d8aa2-740e-480e-8451-0c85cdcdb529 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:47:48 devstack sudo[91689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44.987d8aa2-740e-480e-8451-0c85cdcdb529 Nov 06 17:47:48 devstack sudo[91689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:47:48 devstack sudo[91689]: pam_unix(sudo:session): session closed for user root Nov 06 17:47:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-360f26c8-29e9-49e7-a051-1083095a04b1 tempest-GroupSnapshotsTest-200721168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44.987d8aa2-740e-480e-8451-0c85cdcdb529" returned: 0 in 0.697s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:47:48 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-360f26c8-29e9-49e7-a051-1083095a04b1 tempest-GroupSnapshotsTest-200721168 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 17:47:48 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91c58f8-a307-406a-ae76-098dd7688f5b]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:47:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-360f26c8-29e9-49e7-a051-1083095a04b1 tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:47:49 devstack sudo[91694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44 Nov 06 17:47:49 devstack sudo[91694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:47:49 devstack sudo[91694]: pam_unix(sudo:session): session closed for user root Nov 06 17:47:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-360f26c8-29e9-49e7-a051-1083095a04b1 tempest-GroupSnapshotsTest-200721168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44" returned: 0 in 0.658s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:47:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-360f26c8-29e9-49e7-a051-1083095a04b1 tempest-GroupSnapshotsTest-200721168 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44 {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 17:47:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-360f26c8-29e9-49e7-a051-1083095a04b1 tempest-GroupSnapshotsTest-200721168 None] Creating direct copy from snapshot {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 17:47:49 devstack cinder-volume[87068]: DEBUG cinder.utils [None req-360f26c8-29e9-49e7-a051-1083095a04b1 tempest-GroupSnapshotsTest-200721168 None] Path /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7e094f9e-6c97-4ed6-b4f2-68307f003123 not found in is_blk_device check {{(pid=87068) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 17:47:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-360f26c8-29e9-49e7-a051-1083095a04b1 tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7e094f9e-6c97-4ed6-b4f2-68307f003123 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:47:49 devstack sudo[91701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7e094f9e-6c97-4ed6-b4f2-68307f003123 Nov 06 17:47:49 devstack sudo[91701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:47:54 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 17:47:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:47:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:47:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:47:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:47:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.058s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:47:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:47:54 devstack sudo[91814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:47:54 devstack sudo[91814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:47:55 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-61c505ba-933f-41a0-9476-6fc143d73cca tempest-AttachVolumeTestJSON-401623914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:47:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-61c505ba-933f-41a0-9476-6fc143d73cca tempest-AttachVolumeTestJSON-401623914 None] Flow 'volume_create_manager' (b00541a7-b869-43a0-883c-3cc1af2cec9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:47:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-61c505ba-933f-41a0-9476-6fc143d73cca tempest-AttachVolumeTestJSON-401623914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8b9771b-e62b-4f51-b90f-5bb48eb23eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:47:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-61c505ba-933f-41a0-9476-6fc143d73cca tempest-AttachVolumeTestJSON-401623914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8b9771b-e62b-4f51-b90f-5bb48eb23eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:47:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1990357679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c938cbe-d6e4-4060-8e65-83931bd580f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71415b16ed6244e8bcf27ec2ce3458af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:47:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:47:55Z,use_quota=True,user_id='32cfaf0b7dbd414390a951d17f55497c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:47:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-61c505ba-933f-41a0-9476-6fc143d73cca tempest-AttachVolumeTestJSON-401623914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20b67d4c-2b6c-491a-96fc-2a8da075b4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:47:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-61c505ba-933f-41a0-9476-6fc143d73cca tempest-AttachVolumeTestJSON-401623914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20b67d4c-2b6c-491a-96fc-2a8da075b4a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:47:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-61c505ba-933f-41a0-9476-6fc143d73cca tempest-AttachVolumeTestJSON-401623914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96b23e20-fce5-4b52-9e8e-8fcb8b199779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:47:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-61c505ba-933f-41a0-9476-6fc143d73cca tempest-AttachVolumeTestJSON-401623914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96b23e20-fce5-4b52-9e8e-8fcb8b199779) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c938cbe-d6e4-4060-8e65-83931bd580f3', 'volume_name': 'volume-9c938cbe-d6e4-4060-8e65-83931bd580f3', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:47:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-61c505ba-933f-41a0-9476-6fc143d73cca tempest-AttachVolumeTestJSON-401623914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e26510b2-05a7-4a3c-860d-2704e2650f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:47:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-61c505ba-933f-41a0-9476-6fc143d73cca tempest-AttachVolumeTestJSON-401623914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e26510b2-05a7-4a3c-860d-2704e2650f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:47:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-61c505ba-933f-41a0-9476-6fc143d73cca tempest-AttachVolumeTestJSON-401623914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c28601de-4ca6-4ab1-ad0e-b53bf057e508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:47:55 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-61c505ba-933f-41a0-9476-6fc143d73cca tempest-AttachVolumeTestJSON-401623914 None] Volume 9c938cbe-d6e4-4060-8e65-83931bd580f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c938cbe-d6e4-4060-8e65-83931bd580f3', 'volume_size': 1} Nov 06 17:47:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-61c505ba-933f-41a0-9476-6fc143d73cca tempest-AttachVolumeTestJSON-401623914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:47:56 devstack sudo[91814]: pam_unix(sudo:session): session closed for user root Nov 06 17:47:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 1.661s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:47:56 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:47:56 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running periodic task VolumeManager._thread_info {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 17:47:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] thread count: 8 {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 17:47:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] thread info: [<_MainThread(MainThread, started 133940619505792)>, , , , , , , ] {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 17:48:01 devstack sudo[91701]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-360f26c8-29e9-49e7-a051-1083095a04b1 tempest-GroupSnapshotsTest-200721168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7e094f9e-6c97-4ed6-b4f2-68307f003123" returned: 0 in 12.254s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:01 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-360f26c8-29e9-49e7-a051-1083095a04b1 tempest-GroupSnapshotsTest-200721168 None] Image conversion details: src /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44, size 1024.00 MB, duration 12.25 sec, destination /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7e094f9e-6c97-4ed6-b4f2-68307f003123 {{(pid=87068) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 17:48:01 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-360f26c8-29e9-49e7-a051-1083095a04b1 tempest-GroupSnapshotsTest-200721168 None] Converted 1024.00 MB image at 83.56 MB/s Nov 06 17:48:01 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-360f26c8-29e9-49e7-a051-1083095a04b1 tempest-GroupSnapshotsTest-200721168 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7e094f9e-6c97-4ed6-b4f2-68307f003123 is being set with open permissions: ugo+rw: NotImplementedError Nov 06 17:48:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-360f26c8-29e9-49e7-a051-1083095a04b1 tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7e094f9e-6c97-4ed6-b4f2-68307f003123 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:01 devstack sudo[91852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7e094f9e-6c97-4ed6-b4f2-68307f003123 Nov 06 17:48:01 devstack sudo[91852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:01 devstack sudo[91852]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-360f26c8-29e9-49e7-a051-1083095a04b1 tempest-GroupSnapshotsTest-200721168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7e094f9e-6c97-4ed6-b4f2-68307f003123" returned: 0 in 0.264s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:02 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-360f26c8-29e9-49e7-a051-1083095a04b1 tempest-GroupSnapshotsTest-200721168 None] Lock "cinder-quobyte-7e094f9e-6c97-4ed6-b4f2-68307f003123" released by "_copy_volume_from_snapshot" :: held 14.042s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:48:02 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-360f26c8-29e9-49e7-a051-1083095a04b1 tempest-GroupSnapshotsTest-200721168 None] Lock "cinder-quobyte-987d8aa2-740e-480e-8451-0c85cdcdb529-7e094f9e-6c97-4ed6-b4f2-68307f003123" released by "_create_volume_from_snapshot" :: held 14.151s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:48:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-360f26c8-29e9-49e7-a051-1083095a04b1 tempest-GroupSnapshotsTest-200721168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.178s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:48:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-61c505ba-933f-41a0-9476-6fc143d73cca tempest-AttachVolumeTestJSON-401623914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.239s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:48:02 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-61c505ba-933f-41a0-9476-6fc143d73cca tempest-AttachVolumeTestJSON-401623914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:47:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1990357679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c938cbe-d6e4-4060-8e65-83931bd580f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71415b16ed6244e8bcf27ec2ce3458af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:47:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:47:55Z,use_quota=True,user_id='32cfaf0b7dbd414390a951d17f55497c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:48:02 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-61c505ba-933f-41a0-9476-6fc143d73cca tempest-AttachVolumeTestJSON-401623914 None] Creating volume 9c938cbe-d6e4-4060-8e65-83931bd580f3 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:48:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-61c505ba-933f-41a0-9476-6fc143d73cca tempest-AttachVolumeTestJSON-401623914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:48:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-61c505ba-933f-41a0-9476-6fc143d73cca tempest-AttachVolumeTestJSON-401623914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:48:02 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-61c505ba-933f-41a0-9476-6fc143d73cca tempest-AttachVolumeTestJSON-401623914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:48:02 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-61c505ba-933f-41a0-9476-6fc143d73cca tempest-AttachVolumeTestJSON-401623914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:48:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-61c505ba-933f-41a0-9476-6fc143d73cca tempest-AttachVolumeTestJSON-401623914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:48:02 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-61c505ba-933f-41a0-9476-6fc143d73cca tempest-AttachVolumeTestJSON-401623914 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:48:02 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-61c505ba-933f-41a0-9476-6fc143d73cca tempest-AttachVolumeTestJSON-401623914 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:48:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-61c505ba-933f-41a0-9476-6fc143d73cca tempest-AttachVolumeTestJSON-401623914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9c938cbe-d6e4-4060-8e65-83931bd580f3 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:02 devstack sudo[91855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9c938cbe-d6e4-4060-8e65-83931bd580f3 1073741824 Nov 06 17:48:02 devstack sudo[91855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:02 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-360f26c8-29e9-49e7-a051-1083095a04b1 tempest-GroupSnapshotsTest-200721168 None] Create group from source-snapshot-a3aa2929-0465-46c6-90b3-a316aae92e6c completed successfully. Nov 06 17:48:02 devstack sudo[91855]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-61c505ba-933f-41a0-9476-6fc143d73cca tempest-AttachVolumeTestJSON-401623914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9c938cbe-d6e4-4060-8e65-83931bd580f3 1073741824" returned: 0 in 0.413s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-61c505ba-933f-41a0-9476-6fc143d73cca tempest-AttachVolumeTestJSON-401623914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9c938cbe-d6e4-4060-8e65-83931bd580f3 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:02 devstack sudo[91861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9c938cbe-d6e4-4060-8e65-83931bd580f3 Nov 06 17:48:02 devstack sudo[91861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:02 devstack sudo[91861]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-61c505ba-933f-41a0-9476-6fc143d73cca tempest-AttachVolumeTestJSON-401623914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9c938cbe-d6e4-4060-8e65-83931bd580f3" returned: 0 in 0.244s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:02 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-61c505ba-933f-41a0-9476-6fc143d73cca tempest-AttachVolumeTestJSON-401623914 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:48:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-61c505ba-933f-41a0-9476-6fc143d73cca tempest-AttachVolumeTestJSON-401623914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:48:02 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-61c505ba-933f-41a0-9476-6fc143d73cca tempest-AttachVolumeTestJSON-401623914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c28601de-4ca6-4ab1-ad0e-b53bf057e508) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c938cbe-d6e4-4060-8e65-83931bd580f3', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:48:02 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-61c505ba-933f-41a0-9476-6fc143d73cca tempest-AttachVolumeTestJSON-401623914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8b5af24-00e8-489c-8698-a3fc9cc96c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:48:02 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-61c505ba-933f-41a0-9476-6fc143d73cca tempest-AttachVolumeTestJSON-401623914 None] Volume volume-9c938cbe-d6e4-4060-8e65-83931bd580f3 (9c938cbe-d6e4-4060-8e65-83931bd580f3): created successfully Nov 06 17:48:02 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-61c505ba-933f-41a0-9476-6fc143d73cca tempest-AttachVolumeTestJSON-401623914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8b5af24-00e8-489c-8698-a3fc9cc96c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:48:02 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-61c505ba-933f-41a0-9476-6fc143d73cca tempest-AttachVolumeTestJSON-401623914 None] Flow 'volume_create_manager' (b00541a7-b869-43a0-883c-3cc1af2cec9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:48:02 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-61c505ba-933f-41a0-9476-6fc143d73cca tempest-AttachVolumeTestJSON-401623914 None] Created volume successfully. Nov 06 17:48:03 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8152853a-02e4-450c-9355-2e15993a6cfc tempest-GroupSnapshotsTest-200721168 None] Acquiring lock "cinder-quobyte-7e094f9e-6c97-4ed6-b4f2-68307f003123" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:48:03 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8152853a-02e4-450c-9355-2e15993a6cfc tempest-GroupSnapshotsTest-200721168 None] Lock "cinder-quobyte-7e094f9e-6c97-4ed6-b4f2-68307f003123" acquired by "delete_volume" :: waited 0.019s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:48:03 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4036c55-5970-4a08-9707-28dbe469db61]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:48:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8152853a-02e4-450c-9355-2e15993a6cfc tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7e094f9e-6c97-4ed6-b4f2-68307f003123 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:04 devstack sudo[91877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7e094f9e-6c97-4ed6-b4f2-68307f003123 Nov 06 17:48:04 devstack sudo[91877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-db86243f-430f-41b0-a659-cd18d05254a8 req-e0ca2930-26e5-422d-b69c-ddff0e700b33 tempest-AttachVolumeTestJSON-401623914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:48:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-db86243f-430f-41b0-a659-cd18d05254a8 req-e0ca2930-26e5-422d-b69c-ddff0e700b33 tempest-AttachVolumeTestJSON-401623914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:48:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-db86243f-430f-41b0-a659-cd18d05254a8 req-e0ca2930-26e5-422d-b69c-ddff0e700b33 tempest-AttachVolumeTestJSON-401623914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:48:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-db86243f-430f-41b0-a659-cd18d05254a8 req-e0ca2930-26e5-422d-b69c-ddff0e700b33 tempest-AttachVolumeTestJSON-401623914 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072', 'name': 'volume-9c938cbe-d6e4-4060-8e65-83931bd580f3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4d8ca5b9-488c-4bd2-a4d3-9bb361bccf31', 'enforce_multipath': True} {{(pid=87068) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 17:48:04 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-db86243f-430f-41b0-a659-cd18d05254a8 req-e0ca2930-26e5-422d-b69c-ddff0e700b33 tempest-AttachVolumeTestJSON-401623914 None] attachment_update completed successfully. Nov 06 17:48:04 devstack sudo[91877]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8152853a-02e4-450c-9355-2e15993a6cfc tempest-GroupSnapshotsTest-200721168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7e094f9e-6c97-4ed6-b4f2-68307f003123" returned: 0 in 0.553s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8152853a-02e4-450c-9355-2e15993a6cfc tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7e094f9e-6c97-4ed6-b4f2-68307f003123 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:04 devstack sudo[91891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7e094f9e-6c97-4ed6-b4f2-68307f003123 Nov 06 17:48:04 devstack sudo[91891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:04 devstack sudo[91891]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8152853a-02e4-450c-9355-2e15993a6cfc tempest-GroupSnapshotsTest-200721168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7e094f9e-6c97-4ed6-b4f2-68307f003123" returned: 0 in 0.425s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:04 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8152853a-02e4-450c-9355-2e15993a6cfc tempest-GroupSnapshotsTest-200721168 None] Lock "cinder-quobyte-7e094f9e-6c97-4ed6-b4f2-68307f003123" released by "delete_volume" :: held 1.068s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:48:04 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-8152853a-02e4-450c-9355-2e15993a6cfc tempest-GroupSnapshotsTest-200721168 None] Created reservations ['b31c2a19-2da1-4797-9359-fa23c6ff4d4c'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:48:04 devstack cinder-volume[87068]: WARNING cinder.quota [None req-8152853a-02e4-450c-9355-2e15993a6cfc tempest-GroupSnapshotsTest-200721168 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1787856327 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1787856327, it is now deprecated. Please use the default quota class for default quota. Nov 06 17:48:04 devstack cinder-volume[87068]: WARNING cinder.quota [None req-8152853a-02e4-450c-9355-2e15993a6cfc tempest-GroupSnapshotsTest-200721168 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1787856327 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1787856327, it is now deprecated. Please use the default quota class for default quota. Nov 06 17:48:05 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-8152853a-02e4-450c-9355-2e15993a6cfc tempest-GroupSnapshotsTest-200721168 None] Created reservations ['b64d441c-3264-44ec-a27c-7dc5712bb0c8', '588e49a7-013c-45b8-b0c1-67aec0f03010', 'cb618333-a6e2-4207-b577-468ff696b15f', '1dde0478-b0d3-4698-9daa-66768d9143a7'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:48:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8152853a-02e4-450c-9355-2e15993a6cfc tempest-GroupSnapshotsTest-200721168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:48:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8152853a-02e4-450c-9355-2e15993a6cfc tempest-GroupSnapshotsTest-200721168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:48:05 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8152853a-02e4-450c-9355-2e15993a6cfc tempest-GroupSnapshotsTest-200721168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:48:05 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8152853a-02e4-450c-9355-2e15993a6cfc tempest-GroupSnapshotsTest-200721168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:48:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8152853a-02e4-450c-9355-2e15993a6cfc tempest-GroupSnapshotsTest-200721168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:48:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8152853a-02e4-450c-9355-2e15993a6cfc tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:05 devstack sudo[92300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:48:05 devstack sudo[92300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:05 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-886bcc7c-9295-4422-bd7a-d741bad2ddc6 tempest-GroupSnapshotsTest-200721168 None] group_snapshot a3aa2929-0465-46c6-90b3-a316aae92e6c: deleting Nov 06 17:48:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-886bcc7c-9295-4422-bd7a-d741bad2ddc6 tempest-GroupSnapshotsTest-200721168 None] group_snapshot a3aa2929-0465-46c6-90b3-a316aae92e6c: deleting {{(pid=87068) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 06 17:48:05 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-886bcc7c-9295-4422-bd7a-d741bad2ddc6 tempest-GroupSnapshotsTest-200721168 None] Acquiring lock "cinder-quobyte-250b5bfa-ae6a-4d43-b7cc-d294f4003e44" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:48:05 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-886bcc7c-9295-4422-bd7a-d741bad2ddc6 tempest-GroupSnapshotsTest-200721168 None] Lock "cinder-quobyte-250b5bfa-ae6a-4d43-b7cc-d294f4003e44" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:48:05 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-886bcc7c-9295-4422-bd7a-d741bad2ddc6 tempest-GroupSnapshotsTest-200721168 None] Acquiring lock "cinder-quobyte-987d8aa2-740e-480e-8451-0c85cdcdb529" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:48:05 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-886bcc7c-9295-4422-bd7a-d741bad2ddc6 tempest-GroupSnapshotsTest-200721168 None] Lock "cinder-quobyte-987d8aa2-740e-480e-8451-0c85cdcdb529" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:48:05 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-886bcc7c-9295-4422-bd7a-d741bad2ddc6 tempest-GroupSnapshotsTest-200721168 None] Deleting offline snapshot 987d8aa2-740e-480e-8451-0c85cdcdb529 of volume 250b5bfa-ae6a-4d43-b7cc-d294f4003e44 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 17:48:05 devstack sudo[92300]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:05 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-886bcc7c-9295-4422-bd7a-d741bad2ddc6 tempest-GroupSnapshotsTest-200721168 None] snapshot_file for this snap is: volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44.987d8aa2-740e-480e-8451-0c85cdcdb529 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 17:48:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8152853a-02e4-450c-9355-2e15993a6cfc tempest-GroupSnapshotsTest-200721168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.496s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:05 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-8152853a-02e4-450c-9355-2e15993a6cfc tempest-GroupSnapshotsTest-200721168 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:48:05 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-8152853a-02e4-450c-9355-2e15993a6cfc tempest-GroupSnapshotsTest-200721168 None] Delete group completed successfully. Nov 06 17:48:05 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1fdd99-8b4b-4bef-b318-1cdeb0b81982]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:48:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-886bcc7c-9295-4422-bd7a-d741bad2ddc6 tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44.987d8aa2-740e-480e-8451-0c85cdcdb529 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:05 devstack sudo[92303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44.987d8aa2-740e-480e-8451-0c85cdcdb529 Nov 06 17:48:05 devstack sudo[92303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:06 devstack sudo[92303]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-886bcc7c-9295-4422-bd7a-d741bad2ddc6 tempest-GroupSnapshotsTest-200721168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44.987d8aa2-740e-480e-8451-0c85cdcdb529" returned: 0 in 0.443s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-886bcc7c-9295-4422-bd7a-d741bad2ddc6 tempest-GroupSnapshotsTest-200721168 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 17:48:06 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d48801a-50ca-4133-8c72-9a0d37b8bea0]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:48:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-886bcc7c-9295-4422-bd7a-d741bad2ddc6 tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:06 devstack sudo[92308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44 Nov 06 17:48:06 devstack sudo[92308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:06 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad3f7ea4-3840-4961-ab15-a0d52bff01cf tempest-AttachVolumeTestJSON-401623914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:48:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ad3f7ea4-3840-4961-ab15-a0d52bff01cf tempest-AttachVolumeTestJSON-401623914 None] Flow 'volume_create_manager' (1a0203d2-08bb-49ff-9a78-f6eb8f69bef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:48:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ad3f7ea4-3840-4961-ab15-a0d52bff01cf tempest-AttachVolumeTestJSON-401623914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d4f477d-dc32-477b-8caf-463232052791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:48:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ad3f7ea4-3840-4961-ab15-a0d52bff01cf tempest-AttachVolumeTestJSON-401623914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d4f477d-dc32-477b-8caf-463232052791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:48:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-317892188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7ec1411-b6a4-43da-b1aa-2d0480b09606,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71415b16ed6244e8bcf27ec2ce3458af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:48:07Z,use_quota=True,user_id='32cfaf0b7dbd414390a951d17f55497c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:48:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ad3f7ea4-3840-4961-ab15-a0d52bff01cf tempest-AttachVolumeTestJSON-401623914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (095feef4-f71e-44c1-96ad-6906b0df7bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:48:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ad3f7ea4-3840-4961-ab15-a0d52bff01cf tempest-AttachVolumeTestJSON-401623914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (095feef4-f71e-44c1-96ad-6906b0df7bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:48:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ad3f7ea4-3840-4961-ab15-a0d52bff01cf tempest-AttachVolumeTestJSON-401623914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a13e2e35-09fe-49d2-9753-8919bdf68e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:48:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ad3f7ea4-3840-4961-ab15-a0d52bff01cf tempest-AttachVolumeTestJSON-401623914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a13e2e35-09fe-49d2-9753-8919bdf68e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7ec1411-b6a4-43da-b1aa-2d0480b09606', 'volume_name': 'volume-d7ec1411-b6a4-43da-b1aa-2d0480b09606', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:48:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ad3f7ea4-3840-4961-ab15-a0d52bff01cf tempest-AttachVolumeTestJSON-401623914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (974f5e66-38c6-4f88-aa50-c1408f58c24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:48:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ad3f7ea4-3840-4961-ab15-a0d52bff01cf tempest-AttachVolumeTestJSON-401623914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (974f5e66-38c6-4f88-aa50-c1408f58c24e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:48:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ad3f7ea4-3840-4961-ab15-a0d52bff01cf tempest-AttachVolumeTestJSON-401623914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d6a1a18-3d71-43d1-bea4-b9bd377b69e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:48:07 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-ad3f7ea4-3840-4961-ab15-a0d52bff01cf tempest-AttachVolumeTestJSON-401623914 None] Volume d7ec1411-b6a4-43da-b1aa-2d0480b09606: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7ec1411-b6a4-43da-b1aa-2d0480b09606', 'volume_size': 1} Nov 06 17:48:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ad3f7ea4-3840-4961-ab15-a0d52bff01cf tempest-AttachVolumeTestJSON-401623914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:48:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ad3f7ea4-3840-4961-ab15-a0d52bff01cf tempest-AttachVolumeTestJSON-401623914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:48:07 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ad3f7ea4-3840-4961-ab15-a0d52bff01cf tempest-AttachVolumeTestJSON-401623914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:48:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-317892188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7ec1411-b6a4-43da-b1aa-2d0480b09606,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71415b16ed6244e8bcf27ec2ce3458af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:48:07Z,use_quota=True,user_id='32cfaf0b7dbd414390a951d17f55497c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:48:07 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-ad3f7ea4-3840-4961-ab15-a0d52bff01cf tempest-AttachVolumeTestJSON-401623914 None] Creating volume d7ec1411-b6a4-43da-b1aa-2d0480b09606 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:48:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ad3f7ea4-3840-4961-ab15-a0d52bff01cf tempest-AttachVolumeTestJSON-401623914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:48:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ad3f7ea4-3840-4961-ab15-a0d52bff01cf tempest-AttachVolumeTestJSON-401623914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:48:07 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ad3f7ea4-3840-4961-ab15-a0d52bff01cf tempest-AttachVolumeTestJSON-401623914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:48:07 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ad3f7ea4-3840-4961-ab15-a0d52bff01cf tempest-AttachVolumeTestJSON-401623914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:48:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ad3f7ea4-3840-4961-ab15-a0d52bff01cf tempest-AttachVolumeTestJSON-401623914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:48:07 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ad3f7ea4-3840-4961-ab15-a0d52bff01cf tempest-AttachVolumeTestJSON-401623914 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:48:07 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-ad3f7ea4-3840-4961-ab15-a0d52bff01cf tempest-AttachVolumeTestJSON-401623914 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:48:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ad3f7ea4-3840-4961-ab15-a0d52bff01cf tempest-AttachVolumeTestJSON-401623914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d7ec1411-b6a4-43da-b1aa-2d0480b09606 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:07 devstack sudo[92308]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-886bcc7c-9295-4422-bd7a-d741bad2ddc6 tempest-GroupSnapshotsTest-200721168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44" returned: 0 in 0.856s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-886bcc7c-9295-4422-bd7a-d741bad2ddc6 tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44.987d8aa2-740e-480e-8451-0c85cdcdb529 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:07 devstack sudo[92348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d7ec1411-b6a4-43da-b1aa-2d0480b09606 1073741824 Nov 06 17:48:07 devstack sudo[92348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:07 devstack sudo[92349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44.987d8aa2-740e-480e-8451-0c85cdcdb529 Nov 06 17:48:07 devstack sudo[92349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:07 devstack sudo[92349]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-886bcc7c-9295-4422-bd7a-d741bad2ddc6 tempest-GroupSnapshotsTest-200721168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44.987d8aa2-740e-480e-8451-0c85cdcdb529" returned: 0 in 0.464s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-886bcc7c-9295-4422-bd7a-d741bad2ddc6 tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44.987d8aa2-740e-480e-8451-0c85cdcdb529 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:07 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5ad9cbd-2223-4d5d-84c8-c23636caeffb tempest-AttachVolumeNegativeTest-577825985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:48:07 devstack sudo[92359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44.987d8aa2-740e-480e-8451-0c85cdcdb529 Nov 06 17:48:07 devstack sudo[92359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d5ad9cbd-2223-4d5d-84c8-c23636caeffb tempest-AttachVolumeNegativeTest-577825985 None] Flow 'volume_create_manager' (800d8554-dd4a-42a4-8959-cff0880b7c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:48:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d5ad9cbd-2223-4d5d-84c8-c23636caeffb tempest-AttachVolumeNegativeTest-577825985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40ca897b-0eda-4bb4-8770-04568d71a392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:48:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d5ad9cbd-2223-4d5d-84c8-c23636caeffb tempest-AttachVolumeNegativeTest-577825985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40ca897b-0eda-4bb4-8770-04568d71a392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:48:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-319240339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6e2c1d5-a6b9-4004-957a-95538b36bc89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a899b78c2d34f678680c8113c7dc62f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:48:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:48:08Z,use_quota=True,user_id='3ac9532494834390be879588a01db91d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:48:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d5ad9cbd-2223-4d5d-84c8-c23636caeffb tempest-AttachVolumeNegativeTest-577825985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a03a640d-081f-4b0d-a94a-1b876c0a8628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:48:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d5ad9cbd-2223-4d5d-84c8-c23636caeffb tempest-AttachVolumeNegativeTest-577825985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a03a640d-081f-4b0d-a94a-1b876c0a8628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:48:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d5ad9cbd-2223-4d5d-84c8-c23636caeffb tempest-AttachVolumeNegativeTest-577825985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05857eb4-c87e-44bb-b2d0-bbf81e35ba73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:48:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d5ad9cbd-2223-4d5d-84c8-c23636caeffb tempest-AttachVolumeNegativeTest-577825985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05857eb4-c87e-44bb-b2d0-bbf81e35ba73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6e2c1d5-a6b9-4004-957a-95538b36bc89', 'volume_name': 'volume-a6e2c1d5-a6b9-4004-957a-95538b36bc89', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:48:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d5ad9cbd-2223-4d5d-84c8-c23636caeffb tempest-AttachVolumeNegativeTest-577825985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08503102-3aba-4216-9dcd-c04e354a733e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:48:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d5ad9cbd-2223-4d5d-84c8-c23636caeffb tempest-AttachVolumeNegativeTest-577825985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08503102-3aba-4216-9dcd-c04e354a733e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:48:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d5ad9cbd-2223-4d5d-84c8-c23636caeffb tempest-AttachVolumeNegativeTest-577825985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deeae30b-76a3-422d-882a-5722dd8556ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:48:07 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-d5ad9cbd-2223-4d5d-84c8-c23636caeffb tempest-AttachVolumeNegativeTest-577825985 None] Volume a6e2c1d5-a6b9-4004-957a-95538b36bc89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6e2c1d5-a6b9-4004-957a-95538b36bc89', 'volume_size': 1} Nov 06 17:48:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d5ad9cbd-2223-4d5d-84c8-c23636caeffb tempest-AttachVolumeNegativeTest-577825985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:48:07 devstack sudo[92348]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ad3f7ea4-3840-4961-ab15-a0d52bff01cf tempest-AttachVolumeTestJSON-401623914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d7ec1411-b6a4-43da-b1aa-2d0480b09606 1073741824" returned: 0 in 0.597s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ad3f7ea4-3840-4961-ab15-a0d52bff01cf tempest-AttachVolumeTestJSON-401623914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d7ec1411-b6a4-43da-b1aa-2d0480b09606 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:07 devstack sudo[92361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d7ec1411-b6a4-43da-b1aa-2d0480b09606 Nov 06 17:48:07 devstack sudo[92361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:07 devstack sudo[92359]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-886bcc7c-9295-4422-bd7a-d741bad2ddc6 tempest-GroupSnapshotsTest-200721168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44.987d8aa2-740e-480e-8451-0c85cdcdb529" returned: 0 in 0.285s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:07 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-886bcc7c-9295-4422-bd7a-d741bad2ddc6 tempest-GroupSnapshotsTest-200721168 None] Lock "cinder-quobyte-987d8aa2-740e-480e-8451-0c85cdcdb529" released by "_delete_snapshot" :: held 2.205s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:48:07 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-886bcc7c-9295-4422-bd7a-d741bad2ddc6 tempest-GroupSnapshotsTest-200721168 None] Lock "cinder-quobyte-250b5bfa-ae6a-4d43-b7cc-d294f4003e44" released by "delete_snapshot" :: held 2.248s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:48:07 devstack cinder-volume[87068]: WARNING cinder.quota [None req-886bcc7c-9295-4422-bd7a-d741bad2ddc6 tempest-GroupSnapshotsTest-200721168 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1787856327 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1787856327, it is now deprecated. Please use the default quota class for default quota. Nov 06 17:48:07 devstack sudo[92361]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ad3f7ea4-3840-4961-ab15-a0d52bff01cf tempest-AttachVolumeTestJSON-401623914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d7ec1411-b6a4-43da-b1aa-2d0480b09606" returned: 0 in 0.259s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:07 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ad3f7ea4-3840-4961-ab15-a0d52bff01cf tempest-AttachVolumeTestJSON-401623914 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:48:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ad3f7ea4-3840-4961-ab15-a0d52bff01cf tempest-AttachVolumeTestJSON-401623914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:48:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d5ad9cbd-2223-4d5d-84c8-c23636caeffb tempest-AttachVolumeNegativeTest-577825985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.308s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:48:08 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d5ad9cbd-2223-4d5d-84c8-c23636caeffb tempest-AttachVolumeNegativeTest-577825985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:48:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-319240339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6e2c1d5-a6b9-4004-957a-95538b36bc89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a899b78c2d34f678680c8113c7dc62f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:48:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:48:08Z,use_quota=True,user_id='3ac9532494834390be879588a01db91d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:48:08 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-d5ad9cbd-2223-4d5d-84c8-c23636caeffb tempest-AttachVolumeNegativeTest-577825985 None] Creating volume a6e2c1d5-a6b9-4004-957a-95538b36bc89 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:48:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d5ad9cbd-2223-4d5d-84c8-c23636caeffb tempest-AttachVolumeNegativeTest-577825985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:48:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d5ad9cbd-2223-4d5d-84c8-c23636caeffb tempest-AttachVolumeNegativeTest-577825985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:48:08 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d5ad9cbd-2223-4d5d-84c8-c23636caeffb tempest-AttachVolumeNegativeTest-577825985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:48:08 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d5ad9cbd-2223-4d5d-84c8-c23636caeffb tempest-AttachVolumeNegativeTest-577825985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:48:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d5ad9cbd-2223-4d5d-84c8-c23636caeffb tempest-AttachVolumeNegativeTest-577825985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:48:08 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d5ad9cbd-2223-4d5d-84c8-c23636caeffb tempest-AttachVolumeNegativeTest-577825985 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:48:08 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-d5ad9cbd-2223-4d5d-84c8-c23636caeffb tempest-AttachVolumeNegativeTest-577825985 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:48:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d5ad9cbd-2223-4d5d-84c8-c23636caeffb tempest-AttachVolumeNegativeTest-577825985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a6e2c1d5-a6b9-4004-957a-95538b36bc89 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ad3f7ea4-3840-4961-ab15-a0d52bff01cf tempest-AttachVolumeTestJSON-401623914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d6a1a18-3d71-43d1-bea4-b9bd377b69e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7ec1411-b6a4-43da-b1aa-2d0480b09606', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:48:08 devstack sudo[92365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a6e2c1d5-a6b9-4004-957a-95538b36bc89 1073741824 Nov 06 17:48:08 devstack sudo[92365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ad3f7ea4-3840-4961-ab15-a0d52bff01cf tempest-AttachVolumeTestJSON-401623914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f032546-dad7-4912-9d95-45bbbc6ac01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:48:08 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-886bcc7c-9295-4422-bd7a-d741bad2ddc6 tempest-GroupSnapshotsTest-200721168 None] Created reservations ['f7f3cd17-b96c-4688-8c6e-edc9ca90bbec', 'e64844e4-9029-48f2-9d49-c59c4c5fead8', '541bfd62-74da-4173-8fce-efc80d6358c7', '9b4490c3-91b1-4b52-a47e-fccfe4de7e8a'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:48:08 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-ad3f7ea4-3840-4961-ab15-a0d52bff01cf tempest-AttachVolumeTestJSON-401623914 None] Volume volume-d7ec1411-b6a4-43da-b1aa-2d0480b09606 (d7ec1411-b6a4-43da-b1aa-2d0480b09606): created successfully Nov 06 17:48:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ad3f7ea4-3840-4961-ab15-a0d52bff01cf tempest-AttachVolumeTestJSON-401623914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f032546-dad7-4912-9d95-45bbbc6ac01d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:48:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ad3f7ea4-3840-4961-ab15-a0d52bff01cf tempest-AttachVolumeTestJSON-401623914 None] Flow 'volume_create_manager' (1a0203d2-08bb-49ff-9a78-f6eb8f69bef2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:48:08 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-ad3f7ea4-3840-4961-ab15-a0d52bff01cf tempest-AttachVolumeTestJSON-401623914 None] Created volume successfully. Nov 06 17:48:08 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-886bcc7c-9295-4422-bd7a-d741bad2ddc6 tempest-GroupSnapshotsTest-200721168 None] group_snapshot a3aa2929-0465-46c6-90b3-a316aae92e6c: deleted successfully Nov 06 17:48:08 devstack sudo[92365]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d5ad9cbd-2223-4d5d-84c8-c23636caeffb tempest-AttachVolumeNegativeTest-577825985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a6e2c1d5-a6b9-4004-957a-95538b36bc89 1073741824" returned: 0 in 0.420s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d5ad9cbd-2223-4d5d-84c8-c23636caeffb tempest-AttachVolumeNegativeTest-577825985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a6e2c1d5-a6b9-4004-957a-95538b36bc89 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:08 devstack sudo[92370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a6e2c1d5-a6b9-4004-957a-95538b36bc89 Nov 06 17:48:08 devstack sudo[92370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:08 devstack sudo[92370]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d5ad9cbd-2223-4d5d-84c8-c23636caeffb tempest-AttachVolumeNegativeTest-577825985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a6e2c1d5-a6b9-4004-957a-95538b36bc89" returned: 0 in 0.262s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:08 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d5ad9cbd-2223-4d5d-84c8-c23636caeffb tempest-AttachVolumeNegativeTest-577825985 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:48:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d5ad9cbd-2223-4d5d-84c8-c23636caeffb tempest-AttachVolumeNegativeTest-577825985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:48:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d5ad9cbd-2223-4d5d-84c8-c23636caeffb tempest-AttachVolumeNegativeTest-577825985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deeae30b-76a3-422d-882a-5722dd8556ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6e2c1d5-a6b9-4004-957a-95538b36bc89', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:48:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d5ad9cbd-2223-4d5d-84c8-c23636caeffb tempest-AttachVolumeNegativeTest-577825985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53346def-8d5b-459b-981c-4a3f27be229a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:48:08 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-d5ad9cbd-2223-4d5d-84c8-c23636caeffb tempest-AttachVolumeNegativeTest-577825985 None] Volume volume-a6e2c1d5-a6b9-4004-957a-95538b36bc89 (a6e2c1d5-a6b9-4004-957a-95538b36bc89): created successfully Nov 06 17:48:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d5ad9cbd-2223-4d5d-84c8-c23636caeffb tempest-AttachVolumeNegativeTest-577825985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53346def-8d5b-459b-981c-4a3f27be229a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:48:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d5ad9cbd-2223-4d5d-84c8-c23636caeffb tempest-AttachVolumeNegativeTest-577825985 None] Flow 'volume_create_manager' (800d8554-dd4a-42a4-8959-cff0880b7c0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:48:08 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-d5ad9cbd-2223-4d5d-84c8-c23636caeffb tempest-AttachVolumeNegativeTest-577825985 None] Created volume successfully. Nov 06 17:48:09 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5d9801a5-b0b7-4992-a388-ef1fcb3ba3ea tempest-GroupSnapshotsTest-200721168 None] Acquiring lock "cinder-quobyte-250b5bfa-ae6a-4d43-b7cc-d294f4003e44" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:48:09 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5d9801a5-b0b7-4992-a388-ef1fcb3ba3ea tempest-GroupSnapshotsTest-200721168 None] Lock "cinder-quobyte-250b5bfa-ae6a-4d43-b7cc-d294f4003e44" acquired by "delete_volume" :: waited 0.019s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:48:09 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[635ad435-e11a-441c-8db5-bdd5021d09b1]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:48:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5d9801a5-b0b7-4992-a388-ef1fcb3ba3ea tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-4a9d4b38-6055-4073-8694-cc8886bff641 req-7d72b69d-112f-49e0-95ef-fdb41d01b72d tempest-AttachVolumeTestJSON-401623914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:48:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-4a9d4b38-6055-4073-8694-cc8886bff641 req-7d72b69d-112f-49e0-95ef-fdb41d01b72d tempest-AttachVolumeTestJSON-401623914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:48:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-4a9d4b38-6055-4073-8694-cc8886bff641 req-7d72b69d-112f-49e0-95ef-fdb41d01b72d tempest-AttachVolumeTestJSON-401623914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:48:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-4a9d4b38-6055-4073-8694-cc8886bff641 req-7d72b69d-112f-49e0-95ef-fdb41d01b72d tempest-AttachVolumeTestJSON-401623914 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072', 'name': 'volume-d7ec1411-b6a4-43da-b1aa-2d0480b09606', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ee5e8908-4185-433e-bb12-b7822f95f1e8', 'enforce_multipath': True} {{(pid=87068) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 17:48:09 devstack sudo[92386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44 Nov 06 17:48:09 devstack sudo[92386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:09 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-4a9d4b38-6055-4073-8694-cc8886bff641 req-7d72b69d-112f-49e0-95ef-fdb41d01b72d tempest-AttachVolumeTestJSON-401623914 None] attachment_update completed successfully. Nov 06 17:48:09 devstack sudo[92386]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5d9801a5-b0b7-4992-a388-ef1fcb3ba3ea tempest-GroupSnapshotsTest-200721168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44" returned: 0 in 0.423s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5d9801a5-b0b7-4992-a388-ef1fcb3ba3ea tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:09 devstack sudo[92398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44 Nov 06 17:48:09 devstack sudo[92398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:10 devstack sudo[92398]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5d9801a5-b0b7-4992-a388-ef1fcb3ba3ea tempest-GroupSnapshotsTest-200721168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-250b5bfa-ae6a-4d43-b7cc-d294f4003e44" returned: 0 in 0.305s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:10 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5d9801a5-b0b7-4992-a388-ef1fcb3ba3ea tempest-GroupSnapshotsTest-200721168 None] Lock "cinder-quobyte-250b5bfa-ae6a-4d43-b7cc-d294f4003e44" released by "delete_volume" :: held 0.827s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:48:10 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-5d9801a5-b0b7-4992-a388-ef1fcb3ba3ea tempest-GroupSnapshotsTest-200721168 None] Created reservations ['90a7e36b-a473-4a86-9587-7bf7c4c233fa'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:48:10 devstack cinder-volume[87068]: WARNING cinder.db.api [None req-5d9801a5-b0b7-4992-a388-ef1fcb3ba3ea tempest-GroupSnapshotsTest-200721168 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1787856327'] Nov 06 17:48:10 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-5d9801a5-b0b7-4992-a388-ef1fcb3ba3ea tempest-GroupSnapshotsTest-200721168 None] Created reservations ['1e5c582f-db51-4d11-a558-cccbbe084644', '164b86a1-e6b8-49ef-ab8b-62d1c1b41dba', 'c1c0b6ba-5083-4e95-a763-042367551899', 'bcca2551-5d77-4fb4-a672-f1d1830e81df'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:48:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5d9801a5-b0b7-4992-a388-ef1fcb3ba3ea tempest-GroupSnapshotsTest-200721168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:48:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5d9801a5-b0b7-4992-a388-ef1fcb3ba3ea tempest-GroupSnapshotsTest-200721168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:48:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5d9801a5-b0b7-4992-a388-ef1fcb3ba3ea tempest-GroupSnapshotsTest-200721168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:48:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5d9801a5-b0b7-4992-a388-ef1fcb3ba3ea tempest-GroupSnapshotsTest-200721168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:48:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5d9801a5-b0b7-4992-a388-ef1fcb3ba3ea tempest-GroupSnapshotsTest-200721168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:48:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5d9801a5-b0b7-4992-a388-ef1fcb3ba3ea tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:10 devstack sudo[92410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:48:10 devstack sudo[92410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-08a4fbf4-4964-4d34-a6f9-eaa93d2cb218 req-b5758681-98eb-4b5d-a06f-d29a67db0b9f tempest-AttachVolumeNegativeTest-577825985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:48:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-08a4fbf4-4964-4d34-a6f9-eaa93d2cb218 req-b5758681-98eb-4b5d-a06f-d29a67db0b9f tempest-AttachVolumeNegativeTest-577825985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:48:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-08a4fbf4-4964-4d34-a6f9-eaa93d2cb218 req-b5758681-98eb-4b5d-a06f-d29a67db0b9f tempest-AttachVolumeNegativeTest-577825985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:48:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-08a4fbf4-4964-4d34-a6f9-eaa93d2cb218 req-b5758681-98eb-4b5d-a06f-d29a67db0b9f tempest-AttachVolumeNegativeTest-577825985 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072', 'name': 'volume-a6e2c1d5-a6b9-4004-957a-95538b36bc89', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b57ad4f4-9a67-47d2-861e-5cef1e2bb460', 'enforce_multipath': True} {{(pid=87068) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 17:48:10 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-08a4fbf4-4964-4d34-a6f9-eaa93d2cb218 req-b5758681-98eb-4b5d-a06f-d29a67db0b9f tempest-AttachVolumeNegativeTest-577825985 None] attachment_update completed successfully. Nov 06 17:48:10 devstack sudo[92410]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5d9801a5-b0b7-4992-a388-ef1fcb3ba3ea tempest-GroupSnapshotsTest-200721168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.280s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:10 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-5d9801a5-b0b7-4992-a388-ef1fcb3ba3ea tempest-GroupSnapshotsTest-200721168 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:48:10 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-5d9801a5-b0b7-4992-a388-ef1fcb3ba3ea tempest-GroupSnapshotsTest-200721168 None] Delete group completed successfully. Nov 06 17:48:11 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-77db24ff-c707-4017-9890-5c4c63eb6734 tempest-GroupSnapshotsTest-200721168 None] Group tempest-GroupSnapshotsTest-Group-2146119399: creating Nov 06 17:48:11 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-77db24ff-c707-4017-9890-5c4c63eb6734 tempest-GroupSnapshotsTest-200721168 None] Group tempest-GroupSnapshotsTest-Group-2146119399: created successfully Nov 06 17:48:11 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-77db24ff-c707-4017-9890-5c4c63eb6734 tempest-GroupSnapshotsTest-200721168 None] Create group completed successfully. Nov 06 17:48:12 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-3a40e980-b107-44f1-9a92-c61b44c64688 req-86c2f998-0a13-4047-b693-f4ef97395464 tempest-AttachVolumeTestJSON-401623914 None] Terminate volume connection completed successfully. Nov 06 17:48:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-3a40e980-b107-44f1-9a92-c61b44c64688 req-86c2f998-0a13-4047-b693-f4ef97395464 tempest-AttachVolumeTestJSON-401623914 None] Deleting attachment 4d8ca5b9-488c-4bd2-a4d3-9bb361bccf31. {{(pid=87068) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 17:48:12 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-92cbcca3-44ea-47b7-9fda-ecfce8dc3600 tempest-GroupSnapshotsTest-200721168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:48:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-92cbcca3-44ea-47b7-9fda-ecfce8dc3600 tempest-GroupSnapshotsTest-200721168 None] Flow 'volume_create_manager' (0115f9f5-42d0-432b-a561-53de89e04f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:48:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-92cbcca3-44ea-47b7-9fda-ecfce8dc3600 tempest-GroupSnapshotsTest-200721168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a23f315a-2f54-4c93-a8c0-f3268483fc9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:48:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-92cbcca3-44ea-47b7-9fda-ecfce8dc3600 tempest-GroupSnapshotsTest-200721168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a23f315a-2f54-4c93-a8c0-f3268483fc9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:48:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-116474030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=09ce2bed-1578-4259-8164-9b33e6caa7b0,host='devstack@QuobyteHD#QuobyteHD',id=6485a500-36b2-459d-a443-7a93421616bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc68bbf6525c4727a32d77d254bbbc75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:48:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:48:13Z,use_quota=True,user_id='e62775d7e794453ca97d7197939d35bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(376f6c25-2788-4423-8687-5e8ce4538cc0),volume_type_id=376f6c25-2788-4423-8687-5e8ce4538cc0)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:48:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-92cbcca3-44ea-47b7-9fda-ecfce8dc3600 tempest-GroupSnapshotsTest-200721168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9628b96d-9aba-425b-a330-97765c0085f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:48:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-92cbcca3-44ea-47b7-9fda-ecfce8dc3600 tempest-GroupSnapshotsTest-200721168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9628b96d-9aba-425b-a330-97765c0085f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:48:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-92cbcca3-44ea-47b7-9fda-ecfce8dc3600 tempest-GroupSnapshotsTest-200721168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c8a42af-95e7-4dae-b186-1bee64b4f3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:48:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-92cbcca3-44ea-47b7-9fda-ecfce8dc3600 tempest-GroupSnapshotsTest-200721168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c8a42af-95e7-4dae-b186-1bee64b4f3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6485a500-36b2-459d-a443-7a93421616bb', 'volume_name': 'volume-6485a500-36b2-459d-a443-7a93421616bb', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:48:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-92cbcca3-44ea-47b7-9fda-ecfce8dc3600 tempest-GroupSnapshotsTest-200721168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe73921b-647f-4c4b-bceb-6d096bd31141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:48:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-92cbcca3-44ea-47b7-9fda-ecfce8dc3600 tempest-GroupSnapshotsTest-200721168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe73921b-647f-4c4b-bceb-6d096bd31141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:48:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-92cbcca3-44ea-47b7-9fda-ecfce8dc3600 tempest-GroupSnapshotsTest-200721168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1b728ca-7915-4e30-a1c6-0ff05240fc55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:48:12 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-92cbcca3-44ea-47b7-9fda-ecfce8dc3600 tempest-GroupSnapshotsTest-200721168 None] Volume 6485a500-36b2-459d-a443-7a93421616bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6485a500-36b2-459d-a443-7a93421616bb', 'volume_size': 1} Nov 06 17:48:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-92cbcca3-44ea-47b7-9fda-ecfce8dc3600 tempest-GroupSnapshotsTest-200721168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:48:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-92cbcca3-44ea-47b7-9fda-ecfce8dc3600 tempest-GroupSnapshotsTest-200721168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:48:12 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-92cbcca3-44ea-47b7-9fda-ecfce8dc3600 tempest-GroupSnapshotsTest-200721168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=09ce2bed-1578-4259-8164-9b33e6caa7b0,created_at=2026-11-06T16:48:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-116474030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=09ce2bed-1578-4259-8164-9b33e6caa7b0,host='devstack@QuobyteHD#QuobyteHD',id=6485a500-36b2-459d-a443-7a93421616bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc68bbf6525c4727a32d77d254bbbc75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:48:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:48:13Z,use_quota=True,user_id='e62775d7e794453ca97d7197939d35bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(376f6c25-2788-4423-8687-5e8ce4538cc0),volume_type_id=376f6c25-2788-4423-8687-5e8ce4538cc0)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:48:12 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-92cbcca3-44ea-47b7-9fda-ecfce8dc3600 tempest-GroupSnapshotsTest-200721168 None] Creating volume 6485a500-36b2-459d-a443-7a93421616bb {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:48:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-92cbcca3-44ea-47b7-9fda-ecfce8dc3600 tempest-GroupSnapshotsTest-200721168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:48:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-92cbcca3-44ea-47b7-9fda-ecfce8dc3600 tempest-GroupSnapshotsTest-200721168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:48:12 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-92cbcca3-44ea-47b7-9fda-ecfce8dc3600 tempest-GroupSnapshotsTest-200721168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:48:12 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-92cbcca3-44ea-47b7-9fda-ecfce8dc3600 tempest-GroupSnapshotsTest-200721168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:48:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-92cbcca3-44ea-47b7-9fda-ecfce8dc3600 tempest-GroupSnapshotsTest-200721168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:48:12 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-92cbcca3-44ea-47b7-9fda-ecfce8dc3600 tempest-GroupSnapshotsTest-200721168 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:48:12 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-92cbcca3-44ea-47b7-9fda-ecfce8dc3600 tempest-GroupSnapshotsTest-200721168 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:48:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-92cbcca3-44ea-47b7-9fda-ecfce8dc3600 tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6485a500-36b2-459d-a443-7a93421616bb 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:12 devstack sudo[92423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6485a500-36b2-459d-a443-7a93421616bb 1073741824 Nov 06 17:48:12 devstack sudo[92423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:13 devstack sudo[92423]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-92cbcca3-44ea-47b7-9fda-ecfce8dc3600 tempest-GroupSnapshotsTest-200721168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6485a500-36b2-459d-a443-7a93421616bb 1073741824" returned: 0 in 0.567s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-92cbcca3-44ea-47b7-9fda-ecfce8dc3600 tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6485a500-36b2-459d-a443-7a93421616bb {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:13 devstack sudo[92431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6485a500-36b2-459d-a443-7a93421616bb Nov 06 17:48:13 devstack sudo[92431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:13 devstack sudo[92431]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-92cbcca3-44ea-47b7-9fda-ecfce8dc3600 tempest-GroupSnapshotsTest-200721168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6485a500-36b2-459d-a443-7a93421616bb" returned: 0 in 0.326s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:13 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-92cbcca3-44ea-47b7-9fda-ecfce8dc3600 tempest-GroupSnapshotsTest-200721168 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:48:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-92cbcca3-44ea-47b7-9fda-ecfce8dc3600 tempest-GroupSnapshotsTest-200721168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:48:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-92cbcca3-44ea-47b7-9fda-ecfce8dc3600 tempest-GroupSnapshotsTest-200721168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1b728ca-7915-4e30-a1c6-0ff05240fc55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6485a500-36b2-459d-a443-7a93421616bb', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:48:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-92cbcca3-44ea-47b7-9fda-ecfce8dc3600 tempest-GroupSnapshotsTest-200721168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb91484c-bdf1-4ef7-8b90-fa2abd029621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:48:13 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-92cbcca3-44ea-47b7-9fda-ecfce8dc3600 tempest-GroupSnapshotsTest-200721168 None] Volume volume-6485a500-36b2-459d-a443-7a93421616bb (6485a500-36b2-459d-a443-7a93421616bb): created successfully Nov 06 17:48:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-92cbcca3-44ea-47b7-9fda-ecfce8dc3600 tempest-GroupSnapshotsTest-200721168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb91484c-bdf1-4ef7-8b90-fa2abd029621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:48:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-92cbcca3-44ea-47b7-9fda-ecfce8dc3600 tempest-GroupSnapshotsTest-200721168 None] Flow 'volume_create_manager' (0115f9f5-42d0-432b-a561-53de89e04f43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:48:13 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-92cbcca3-44ea-47b7-9fda-ecfce8dc3600 tempest-GroupSnapshotsTest-200721168 None] Created volume successfully. Nov 06 17:48:14 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-aed06340-5d22-43a3-b114-94f5a4650c91 req-0f20e739-4ac6-4f35-82f5-0a8d008e6484 tempest-AttachVolumeTestJSON-401623914 None] Terminate volume connection completed successfully. Nov 06 17:48:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-aed06340-5d22-43a3-b114-94f5a4650c91 req-0f20e739-4ac6-4f35-82f5-0a8d008e6484 tempest-AttachVolumeTestJSON-401623914 None] Deleting attachment ee5e8908-4185-433e-bb12-b7822f95f1e8. {{(pid=87068) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 17:48:16 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-4260e5fe-67b9-467a-a86d-95084ec41600 tempest-GroupSnapshotsTest-200721168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:48:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4260e5fe-67b9-467a-a86d-95084ec41600 tempest-GroupSnapshotsTest-200721168 None] Flow 'volume_create_manager' (d3d7959f-7200-42f9-b3c1-4321460273e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:48:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4260e5fe-67b9-467a-a86d-95084ec41600 tempest-GroupSnapshotsTest-200721168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d86ca7d8-5536-4a7c-b797-12896d7587ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:48:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4260e5fe-67b9-467a-a86d-95084ec41600 tempest-GroupSnapshotsTest-200721168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d86ca7d8-5536-4a7c-b797-12896d7587ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:48:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1037941421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=09ce2bed-1578-4259-8164-9b33e6caa7b0,host='devstack@QuobyteHD#QuobyteHD',id=22fd7d1c-4c08-4a3a-921a-2da3d5851396,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc68bbf6525c4727a32d77d254bbbc75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:48:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:48:16Z,use_quota=True,user_id='e62775d7e794453ca97d7197939d35bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(376f6c25-2788-4423-8687-5e8ce4538cc0),volume_type_id=376f6c25-2788-4423-8687-5e8ce4538cc0)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:48:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4260e5fe-67b9-467a-a86d-95084ec41600 tempest-GroupSnapshotsTest-200721168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (642e07b2-812b-4c23-8197-28107e6677bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:48:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4260e5fe-67b9-467a-a86d-95084ec41600 tempest-GroupSnapshotsTest-200721168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (642e07b2-812b-4c23-8197-28107e6677bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:48:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4260e5fe-67b9-467a-a86d-95084ec41600 tempest-GroupSnapshotsTest-200721168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46a47ef8-f802-4932-a49d-1ee003598b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:48:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4260e5fe-67b9-467a-a86d-95084ec41600 tempest-GroupSnapshotsTest-200721168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46a47ef8-f802-4932-a49d-1ee003598b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22fd7d1c-4c08-4a3a-921a-2da3d5851396', 'volume_name': 'volume-22fd7d1c-4c08-4a3a-921a-2da3d5851396', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:48:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4260e5fe-67b9-467a-a86d-95084ec41600 tempest-GroupSnapshotsTest-200721168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0708598c-16f1-4fcb-bdb2-58aa41b97952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:48:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4260e5fe-67b9-467a-a86d-95084ec41600 tempest-GroupSnapshotsTest-200721168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0708598c-16f1-4fcb-bdb2-58aa41b97952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:48:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4260e5fe-67b9-467a-a86d-95084ec41600 tempest-GroupSnapshotsTest-200721168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8099adb3-168f-4692-ab29-a1452d867db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:48:16 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-4260e5fe-67b9-467a-a86d-95084ec41600 tempest-GroupSnapshotsTest-200721168 None] Volume 22fd7d1c-4c08-4a3a-921a-2da3d5851396: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22fd7d1c-4c08-4a3a-921a-2da3d5851396', 'volume_size': 1} Nov 06 17:48:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4260e5fe-67b9-467a-a86d-95084ec41600 tempest-GroupSnapshotsTest-200721168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:48:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4260e5fe-67b9-467a-a86d-95084ec41600 tempest-GroupSnapshotsTest-200721168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:48:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4260e5fe-67b9-467a-a86d-95084ec41600 tempest-GroupSnapshotsTest-200721168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=09ce2bed-1578-4259-8164-9b33e6caa7b0,created_at=2026-11-06T16:48:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1037941421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=09ce2bed-1578-4259-8164-9b33e6caa7b0,host='devstack@QuobyteHD#QuobyteHD',id=22fd7d1c-4c08-4a3a-921a-2da3d5851396,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc68bbf6525c4727a32d77d254bbbc75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:48:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:48:16Z,use_quota=True,user_id='e62775d7e794453ca97d7197939d35bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(376f6c25-2788-4423-8687-5e8ce4538cc0),volume_type_id=376f6c25-2788-4423-8687-5e8ce4538cc0)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:48:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-4260e5fe-67b9-467a-a86d-95084ec41600 tempest-GroupSnapshotsTest-200721168 None] Creating volume 22fd7d1c-4c08-4a3a-921a-2da3d5851396 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:48:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4260e5fe-67b9-467a-a86d-95084ec41600 tempest-GroupSnapshotsTest-200721168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:48:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4260e5fe-67b9-467a-a86d-95084ec41600 tempest-GroupSnapshotsTest-200721168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:48:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4260e5fe-67b9-467a-a86d-95084ec41600 tempest-GroupSnapshotsTest-200721168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:48:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4260e5fe-67b9-467a-a86d-95084ec41600 tempest-GroupSnapshotsTest-200721168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:48:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4260e5fe-67b9-467a-a86d-95084ec41600 tempest-GroupSnapshotsTest-200721168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:48:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4260e5fe-67b9-467a-a86d-95084ec41600 tempest-GroupSnapshotsTest-200721168 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:48:16 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-4260e5fe-67b9-467a-a86d-95084ec41600 tempest-GroupSnapshotsTest-200721168 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:48:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4260e5fe-67b9-467a-a86d-95084ec41600 tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-22fd7d1c-4c08-4a3a-921a-2da3d5851396 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:16 devstack sudo[92462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-22fd7d1c-4c08-4a3a-921a-2da3d5851396 1073741824 Nov 06 17:48:16 devstack sudo[92462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:17 devstack sudo[92462]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4260e5fe-67b9-467a-a86d-95084ec41600 tempest-GroupSnapshotsTest-200721168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-22fd7d1c-4c08-4a3a-921a-2da3d5851396 1073741824" returned: 0 in 0.661s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4260e5fe-67b9-467a-a86d-95084ec41600 tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-22fd7d1c-4c08-4a3a-921a-2da3d5851396 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:17 devstack sudo[92471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-22fd7d1c-4c08-4a3a-921a-2da3d5851396 Nov 06 17:48:17 devstack sudo[92471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:17 devstack sudo[92471]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4260e5fe-67b9-467a-a86d-95084ec41600 tempest-GroupSnapshotsTest-200721168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-22fd7d1c-4c08-4a3a-921a-2da3d5851396" returned: 0 in 0.300s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4260e5fe-67b9-467a-a86d-95084ec41600 tempest-GroupSnapshotsTest-200721168 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:48:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4260e5fe-67b9-467a-a86d-95084ec41600 tempest-GroupSnapshotsTest-200721168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:48:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4260e5fe-67b9-467a-a86d-95084ec41600 tempest-GroupSnapshotsTest-200721168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8099adb3-168f-4692-ab29-a1452d867db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22fd7d1c-4c08-4a3a-921a-2da3d5851396', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:48:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4260e5fe-67b9-467a-a86d-95084ec41600 tempest-GroupSnapshotsTest-200721168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40b50e65-9dee-47f5-ad54-0b0e7e555505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:48:17 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-4260e5fe-67b9-467a-a86d-95084ec41600 tempest-GroupSnapshotsTest-200721168 None] Volume volume-22fd7d1c-4c08-4a3a-921a-2da3d5851396 (22fd7d1c-4c08-4a3a-921a-2da3d5851396): created successfully Nov 06 17:48:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4260e5fe-67b9-467a-a86d-95084ec41600 tempest-GroupSnapshotsTest-200721168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40b50e65-9dee-47f5-ad54-0b0e7e555505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:48:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4260e5fe-67b9-467a-a86d-95084ec41600 tempest-GroupSnapshotsTest-200721168 None] Flow 'volume_create_manager' (d3d7959f-7200-42f9-b3c1-4321460273e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:48:17 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-4260e5fe-67b9-467a-a86d-95084ec41600 tempest-GroupSnapshotsTest-200721168 None] Created volume successfully. Nov 06 17:48:18 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-2fe4134f-e46c-4b38-9a55-61f3c3b55c35 tempest-GroupSnapshotsTest-200721168 None] Update group completed successfully. Nov 06 17:48:20 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-ae89f281-a999-4f8f-bd7e-5c8adf9822e9 tempest-GroupSnapshotsTest-200721168 None] Update group completed successfully. Nov 06 17:48:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-aa28ca5a-1950-4737-947b-3a48b9936014 req-f5a0690a-384c-4e49-b7af-11463865f5ed tempest-ServerActionsTestOtherA-1480259007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:48:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-aa28ca5a-1950-4737-947b-3a48b9936014 req-f5a0690a-384c-4e49-b7af-11463865f5ed tempest-ServerActionsTestOtherA-1480259007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:48:20 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-12c108f2-1911-490c-831a-add8354c03b9 tempest-AttachVolumeTestJSON-401623914 None] Acquiring lock "cinder-d7ec1411-b6a4-43da-b1aa-2d0480b09606-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:48:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-aa28ca5a-1950-4737-947b-3a48b9936014 req-f5a0690a-384c-4e49-b7af-11463865f5ed tempest-ServerActionsTestOtherA-1480259007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:48:20 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-12c108f2-1911-490c-831a-add8354c03b9 tempest-AttachVolumeTestJSON-401623914 None] Lock "cinder-d7ec1411-b6a4-43da-b1aa-2d0480b09606-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:48:20 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-aa28ca5a-1950-4737-947b-3a48b9936014 req-f5a0690a-384c-4e49-b7af-11463865f5ed tempest-ServerActionsTestOtherA-1480259007 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072', 'name': 'volume-459474e7-2a9c-4265-9f62-8b738b7531b7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c44e5ee5-6b83-4d6d-b962-3bc45931e7fc', 'enforce_multipath': True} {{(pid=87068) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 17:48:20 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-12c108f2-1911-490c-831a-add8354c03b9 tempest-AttachVolumeTestJSON-401623914 None] Acquiring lock "cinder-quobyte-d7ec1411-b6a4-43da-b1aa-2d0480b09606" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:48:20 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-12c108f2-1911-490c-831a-add8354c03b9 tempest-AttachVolumeTestJSON-401623914 None] Lock "cinder-quobyte-d7ec1411-b6a4-43da-b1aa-2d0480b09606" acquired by "delete_volume" :: waited 0.038s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:48:20 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[521ac993-506f-4d36-8013-fb0dbb6056f7]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:48:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-12c108f2-1911-490c-831a-add8354c03b9 tempest-AttachVolumeTestJSON-401623914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d7ec1411-b6a4-43da-b1aa-2d0480b09606 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:20 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-aa28ca5a-1950-4737-947b-3a48b9936014 req-f5a0690a-384c-4e49-b7af-11463865f5ed tempest-ServerActionsTestOtherA-1480259007 None] attachment_update completed successfully. Nov 06 17:48:20 devstack sudo[92508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d7ec1411-b6a4-43da-b1aa-2d0480b09606 Nov 06 17:48:20 devstack sudo[92508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:21 devstack sudo[92508]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-12c108f2-1911-490c-831a-add8354c03b9 tempest-AttachVolumeTestJSON-401623914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d7ec1411-b6a4-43da-b1aa-2d0480b09606" returned: 0 in 0.469s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-12c108f2-1911-490c-831a-add8354c03b9 tempest-AttachVolumeTestJSON-401623914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d7ec1411-b6a4-43da-b1aa-2d0480b09606 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:21 devstack sudo[92515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d7ec1411-b6a4-43da-b1aa-2d0480b09606 Nov 06 17:48:21 devstack sudo[92515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:21 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-6351615b-3819-434b-b583-c02643f19f59 tempest-GroupSnapshotsTest-200721168 None] Update group completed successfully. Nov 06 17:48:21 devstack sudo[92515]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-12c108f2-1911-490c-831a-add8354c03b9 tempest-AttachVolumeTestJSON-401623914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d7ec1411-b6a4-43da-b1aa-2d0480b09606" returned: 0 in 0.621s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-12c108f2-1911-490c-831a-add8354c03b9 tempest-AttachVolumeTestJSON-401623914 None] Lock "cinder-quobyte-d7ec1411-b6a4-43da-b1aa-2d0480b09606" released by "delete_volume" :: held 1.212s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:48:22 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-88b39004-b748-4782-9f96-60888f564079 tempest-GroupSnapshotsTest-200721168 None] Update group completed successfully. Nov 06 17:48:22 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-12c108f2-1911-490c-831a-add8354c03b9 tempest-AttachVolumeTestJSON-401623914 None] Created reservations ['d0a95d22-c079-4568-b575-24e275be9f77', '7d0e1650-4a18-4b80-bbc5-ef7e65561bef', 'c91723ae-48ba-42dc-940f-00c0219a5eb1', 'c06968ab-3838-4a3c-a3a5-1d2995e07a3a'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:48:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-12c108f2-1911-490c-831a-add8354c03b9 tempest-AttachVolumeTestJSON-401623914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:48:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-12c108f2-1911-490c-831a-add8354c03b9 tempest-AttachVolumeTestJSON-401623914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:48:22 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-12c108f2-1911-490c-831a-add8354c03b9 tempest-AttachVolumeTestJSON-401623914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:48:22 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-12c108f2-1911-490c-831a-add8354c03b9 tempest-AttachVolumeTestJSON-401623914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:48:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-12c108f2-1911-490c-831a-add8354c03b9 tempest-AttachVolumeTestJSON-401623914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:48:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-12c108f2-1911-490c-831a-add8354c03b9 tempest-AttachVolumeTestJSON-401623914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:22 devstack sudo[92560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:48:22 devstack sudo[92560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:22 devstack sudo[92560]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-12c108f2-1911-490c-831a-add8354c03b9 tempest-AttachVolumeTestJSON-401623914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.338s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:22 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-12c108f2-1911-490c-831a-add8354c03b9 tempest-AttachVolumeTestJSON-401623914 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:48:22 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-12c108f2-1911-490c-831a-add8354c03b9 tempest-AttachVolumeTestJSON-401623914 None] Deleted volume successfully. Nov 06 17:48:22 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-12c108f2-1911-490c-831a-add8354c03b9 tempest-AttachVolumeTestJSON-401623914 None] Lock "cinder-d7ec1411-b6a4-43da-b1aa-2d0480b09606-delete_volume" released by "delete_volume" :: held 2.082s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:48:22 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4b23ff95-aeec-43f4-96cd-dcd45be3d270 tempest-AttachVolumeTestJSON-401623914 None] Acquiring lock "cinder-9c938cbe-d6e4-4060-8e65-83931bd580f3-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:48:22 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4b23ff95-aeec-43f4-96cd-dcd45be3d270 tempest-AttachVolumeTestJSON-401623914 None] Lock "cinder-9c938cbe-d6e4-4060-8e65-83931bd580f3-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:48:23 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4b23ff95-aeec-43f4-96cd-dcd45be3d270 tempest-AttachVolumeTestJSON-401623914 None] Acquiring lock "cinder-quobyte-9c938cbe-d6e4-4060-8e65-83931bd580f3" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:48:23 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4b23ff95-aeec-43f4-96cd-dcd45be3d270 tempest-AttachVolumeTestJSON-401623914 None] Lock "cinder-quobyte-9c938cbe-d6e4-4060-8e65-83931bd580f3" acquired by "delete_volume" :: waited 0.020s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:48:23 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf43c34-4f1c-4be9-8463-aa0b6bbd01f4]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:48:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4b23ff95-aeec-43f4-96cd-dcd45be3d270 tempest-AttachVolumeTestJSON-401623914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9c938cbe-d6e4-4060-8e65-83931bd580f3 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:23 devstack sudo[92564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9c938cbe-d6e4-4060-8e65-83931bd580f3 Nov 06 17:48:23 devstack sudo[92564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:23 devstack sudo[92564]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4b23ff95-aeec-43f4-96cd-dcd45be3d270 tempest-AttachVolumeTestJSON-401623914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9c938cbe-d6e4-4060-8e65-83931bd580f3" returned: 0 in 0.593s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4b23ff95-aeec-43f4-96cd-dcd45be3d270 tempest-AttachVolumeTestJSON-401623914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9c938cbe-d6e4-4060-8e65-83931bd580f3 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:23 devstack sudo[92571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9c938cbe-d6e4-4060-8e65-83931bd580f3 Nov 06 17:48:23 devstack sudo[92571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:24 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-6f2d66f6-abd9-4b5d-911f-8b53005f2321 tempest-GroupSnapshotsTest-200721168 None] GroupSnapshot df59d89d-2884-46fa-afab-5f60929f0e5d: creating. Nov 06 17:48:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6f2d66f6-abd9-4b5d-911f-8b53005f2321 tempest-GroupSnapshotsTest-200721168 None] Group snapshot df59d89d-2884-46fa-afab-5f60929f0e5d: creating. {{(pid=87068) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 06 17:48:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6f2d66f6-abd9-4b5d-911f-8b53005f2321 tempest-GroupSnapshotsTest-200721168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:48:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6f2d66f6-abd9-4b5d-911f-8b53005f2321 tempest-GroupSnapshotsTest-200721168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:48:24 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-6f2d66f6-abd9-4b5d-911f-8b53005f2321 tempest-GroupSnapshotsTest-200721168 None] Creating offline snapshot 3059536a-e17b-4ec9-8e3d-8de72f7df3ed of volume 22fd7d1c-4c08-4a3a-921a-2da3d5851396 {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 17:48:24 devstack sudo[92571]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:24 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4abea455-a5ac-46b7-bb20-3afc45f6636a]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:48:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6f2d66f6-abd9-4b5d-911f-8b53005f2321 tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-22fd7d1c-4c08-4a3a-921a-2da3d5851396 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4b23ff95-aeec-43f4-96cd-dcd45be3d270 tempest-AttachVolumeTestJSON-401623914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9c938cbe-d6e4-4060-8e65-83931bd580f3" returned: 0 in 0.609s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:24 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4b23ff95-aeec-43f4-96cd-dcd45be3d270 tempest-AttachVolumeTestJSON-401623914 None] Lock "cinder-quobyte-9c938cbe-d6e4-4060-8e65-83931bd580f3" released by "delete_volume" :: held 1.272s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:48:24 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-4b23ff95-aeec-43f4-96cd-dcd45be3d270 tempest-AttachVolumeTestJSON-401623914 None] Created reservations ['40324e36-98bf-474f-b4a1-387291b65b77', '1483ad83-856a-4027-ba49-9975df6add7c', '8c5fd0e1-2b1a-460a-ba16-5ea3427e5dd0', '69a6fb9c-0f2f-4b69-8b27-7d2be8a917ab'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:48:24 devstack sudo[92577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-22fd7d1c-4c08-4a3a-921a-2da3d5851396 Nov 06 17:48:24 devstack sudo[92577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4b23ff95-aeec-43f4-96cd-dcd45be3d270 tempest-AttachVolumeTestJSON-401623914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:48:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4b23ff95-aeec-43f4-96cd-dcd45be3d270 tempest-AttachVolumeTestJSON-401623914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:48:24 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4b23ff95-aeec-43f4-96cd-dcd45be3d270 tempest-AttachVolumeTestJSON-401623914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:48:24 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4b23ff95-aeec-43f4-96cd-dcd45be3d270 tempest-AttachVolumeTestJSON-401623914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:48:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4b23ff95-aeec-43f4-96cd-dcd45be3d270 tempest-AttachVolumeTestJSON-401623914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:48:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4b23ff95-aeec-43f4-96cd-dcd45be3d270 tempest-AttachVolumeTestJSON-401623914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:24 devstack sudo[92603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:48:24 devstack sudo[92603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:24 devstack sudo[92577]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6f2d66f6-abd9-4b5d-911f-8b53005f2321 tempest-GroupSnapshotsTest-200721168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-22fd7d1c-4c08-4a3a-921a-2da3d5851396" returned: 0 in 0.518s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6f2d66f6-abd9-4b5d-911f-8b53005f2321 tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-22fd7d1c-4c08-4a3a-921a-2da3d5851396,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-22fd7d1c-4c08-4a3a-921a-2da3d5851396.3059536a-e17b-4ec9-8e3d-8de72f7df3ed 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:24 devstack sudo[92603]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4b23ff95-aeec-43f4-96cd-dcd45be3d270 tempest-AttachVolumeTestJSON-401623914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.287s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:24 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-4b23ff95-aeec-43f4-96cd-dcd45be3d270 tempest-AttachVolumeTestJSON-401623914 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:48:24 devstack sudo[92610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-22fd7d1c-4c08-4a3a-921a-2da3d5851396,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-22fd7d1c-4c08-4a3a-921a-2da3d5851396.3059536a-e17b-4ec9-8e3d-8de72f7df3ed 1G Nov 06 17:48:24 devstack sudo[92610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:24 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-4b23ff95-aeec-43f4-96cd-dcd45be3d270 tempest-AttachVolumeTestJSON-401623914 None] Deleted volume successfully. Nov 06 17:48:24 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4b23ff95-aeec-43f4-96cd-dcd45be3d270 tempest-AttachVolumeTestJSON-401623914 None] Lock "cinder-9c938cbe-d6e4-4060-8e65-83931bd580f3-delete_volume" released by "delete_volume" :: held 1.904s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:48:25 devstack sudo[92610]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6f2d66f6-abd9-4b5d-911f-8b53005f2321 tempest-GroupSnapshotsTest-200721168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-22fd7d1c-4c08-4a3a-921a-2da3d5851396,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-22fd7d1c-4c08-4a3a-921a-2da3d5851396.3059536a-e17b-4ec9-8e3d-8de72f7df3ed 1G" returned: 0 in 0.572s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6f2d66f6-abd9-4b5d-911f-8b53005f2321 tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22fd7d1c-4c08-4a3a-921a-2da3d5851396 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-22fd7d1c-4c08-4a3a-921a-2da3d5851396.3059536a-e17b-4ec9-8e3d-8de72f7df3ed {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:25 devstack sudo[92623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22fd7d1c-4c08-4a3a-921a-2da3d5851396 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-22fd7d1c-4c08-4a3a-921a-2da3d5851396.3059536a-e17b-4ec9-8e3d-8de72f7df3ed Nov 06 17:48:25 devstack sudo[92623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:25 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-144bd6d8-d161-4383-8564-593bc81dfec1 req-7493c96f-2ed4-4350-aea1-59d1bd0ff1de tempest-ServerActionsTestOtherA-1480259007 None] Terminate volume connection completed successfully. Nov 06 17:48:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-144bd6d8-d161-4383-8564-593bc81dfec1 req-7493c96f-2ed4-4350-aea1-59d1bd0ff1de tempest-ServerActionsTestOtherA-1480259007 None] Deleting attachment c44e5ee5-6b83-4d6d-b962-3bc45931e7fc. {{(pid=87068) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 17:48:25 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-dc57509c-393e-41fe-9d2f-e4274cd7e0d5 tempest-AttachVolumeTestJSON-401623914 None] Acquiring lock "cinder-1cfa4fd9-aed2-438c-aaf9-6abbd4054d67-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:48:25 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-dc57509c-393e-41fe-9d2f-e4274cd7e0d5 tempest-AttachVolumeTestJSON-401623914 None] Lock "cinder-1cfa4fd9-aed2-438c-aaf9-6abbd4054d67-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:48:25 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-dc57509c-393e-41fe-9d2f-e4274cd7e0d5 tempest-AttachVolumeTestJSON-401623914 None] Acquiring lock "cinder-quobyte-1cfa4fd9-aed2-438c-aaf9-6abbd4054d67" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:48:25 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-dc57509c-393e-41fe-9d2f-e4274cd7e0d5 tempest-AttachVolumeTestJSON-401623914 None] Lock "cinder-quobyte-1cfa4fd9-aed2-438c-aaf9-6abbd4054d67" acquired by "delete_volume" :: waited 0.042s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:48:25 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c4e816-5b68-45cd-93c9-f1787470524f]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:48:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-dc57509c-393e-41fe-9d2f-e4274cd7e0d5 tempest-AttachVolumeTestJSON-401623914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1cfa4fd9-aed2-438c-aaf9-6abbd4054d67 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:26 devstack sudo[92623]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6f2d66f6-abd9-4b5d-911f-8b53005f2321 tempest-GroupSnapshotsTest-200721168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22fd7d1c-4c08-4a3a-921a-2da3d5851396 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-22fd7d1c-4c08-4a3a-921a-2da3d5851396.3059536a-e17b-4ec9-8e3d-8de72f7df3ed" returned: 0 in 0.718s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:26 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-6f2d66f6-abd9-4b5d-911f-8b53005f2321 tempest-GroupSnapshotsTest-200721168 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-22fd7d1c-4c08-4a3a-921a-2da3d5851396.3059536a-e17b-4ec9-8e3d-8de72f7df3ed is being set with open permissions: ugo+rw: NotImplementedError Nov 06 17:48:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6f2d66f6-abd9-4b5d-911f-8b53005f2321 tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-22fd7d1c-4c08-4a3a-921a-2da3d5851396.3059536a-e17b-4ec9-8e3d-8de72f7df3ed {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:26 devstack sudo[92643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-22fd7d1c-4c08-4a3a-921a-2da3d5851396.3059536a-e17b-4ec9-8e3d-8de72f7df3ed Nov 06 17:48:26 devstack sudo[92643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:26 devstack sudo[92638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1cfa4fd9-aed2-438c-aaf9-6abbd4054d67 Nov 06 17:48:26 devstack sudo[92638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:26 devstack sudo[92643]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6f2d66f6-abd9-4b5d-911f-8b53005f2321 tempest-GroupSnapshotsTest-200721168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-22fd7d1c-4c08-4a3a-921a-2da3d5851396.3059536a-e17b-4ec9-8e3d-8de72f7df3ed" returned: 0 in 0.586s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6f2d66f6-abd9-4b5d-911f-8b53005f2321 tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-22fd7d1c-4c08-4a3a-921a-2da3d5851396.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:26 devstack sudo[92663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-22fd7d1c-4c08-4a3a-921a-2da3d5851396.info Nov 06 17:48:26 devstack sudo[92663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:26 devstack sudo[92638]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-dc57509c-393e-41fe-9d2f-e4274cd7e0d5 tempest-AttachVolumeTestJSON-401623914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1cfa4fd9-aed2-438c-aaf9-6abbd4054d67" returned: 0 in 0.968s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-dc57509c-393e-41fe-9d2f-e4274cd7e0d5 tempest-AttachVolumeTestJSON-401623914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1cfa4fd9-aed2-438c-aaf9-6abbd4054d67 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:26 devstack sudo[92665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1cfa4fd9-aed2-438c-aaf9-6abbd4054d67 Nov 06 17:48:26 devstack sudo[92665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-144bd6d8-d161-4383-8564-593bc81dfec1 req-1db4ab6a-0e1c-489a-8142-057ac12d90b0 tempest-ServerActionsTestOtherA-1480259007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:48:27 devstack sudo[92665]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-dc57509c-393e-41fe-9d2f-e4274cd7e0d5 tempest-AttachVolumeTestJSON-401623914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1cfa4fd9-aed2-438c-aaf9-6abbd4054d67" returned: 0 in 0.434s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:27 devstack sudo[92663]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:27 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-dc57509c-393e-41fe-9d2f-e4274cd7e0d5 tempest-AttachVolumeTestJSON-401623914 None] Lock "cinder-quobyte-1cfa4fd9-aed2-438c-aaf9-6abbd4054d67" released by "delete_volume" :: held 1.577s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:48:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6f2d66f6-abd9-4b5d-911f-8b53005f2321 tempest-GroupSnapshotsTest-200721168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-22fd7d1c-4c08-4a3a-921a-2da3d5851396.info" returned: 0 in 0.578s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:27 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-6f2d66f6-abd9-4b5d-911f-8b53005f2321 tempest-GroupSnapshotsTest-200721168 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-22fd7d1c-4c08-4a3a-921a-2da3d5851396.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 17:48:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6f2d66f6-abd9-4b5d-911f-8b53005f2321 tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-22fd7d1c-4c08-4a3a-921a-2da3d5851396.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:27 devstack sudo[92670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-22fd7d1c-4c08-4a3a-921a-2da3d5851396.info Nov 06 17:48:27 devstack sudo[92670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:27 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-dc57509c-393e-41fe-9d2f-e4274cd7e0d5 tempest-AttachVolumeTestJSON-401623914 None] Created reservations ['964418e5-0863-442e-b566-4260e717f0e4', 'b04e7a2a-2d57-446d-b398-f06cc9a98fc5', 'ec8b0104-04a8-4662-bb3c-9201634fa57b', 'f2dbdef8-5552-4090-9dd5-b38f2f866fd6'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:48:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-dc57509c-393e-41fe-9d2f-e4274cd7e0d5 tempest-AttachVolumeTestJSON-401623914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:48:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-dc57509c-393e-41fe-9d2f-e4274cd7e0d5 tempest-AttachVolumeTestJSON-401623914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:48:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-dc57509c-393e-41fe-9d2f-e4274cd7e0d5 tempest-AttachVolumeTestJSON-401623914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:48:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-dc57509c-393e-41fe-9d2f-e4274cd7e0d5 tempest-AttachVolumeTestJSON-401623914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:48:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-dc57509c-393e-41fe-9d2f-e4274cd7e0d5 tempest-AttachVolumeTestJSON-401623914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:48:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-dc57509c-393e-41fe-9d2f-e4274cd7e0d5 tempest-AttachVolumeTestJSON-401623914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:27 devstack sudo[92672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:48:27 devstack sudo[92672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:27 devstack sudo[92670]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6f2d66f6-abd9-4b5d-911f-8b53005f2321 tempest-GroupSnapshotsTest-200721168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-22fd7d1c-4c08-4a3a-921a-2da3d5851396.info" returned: 0 in 0.458s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6f2d66f6-abd9-4b5d-911f-8b53005f2321 tempest-GroupSnapshotsTest-200721168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.618s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:48:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6f2d66f6-abd9-4b5d-911f-8b53005f2321 tempest-GroupSnapshotsTest-200721168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:48:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6f2d66f6-abd9-4b5d-911f-8b53005f2321 tempest-GroupSnapshotsTest-200721168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:48:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-6f2d66f6-abd9-4b5d-911f-8b53005f2321 tempest-GroupSnapshotsTest-200721168 None] Creating offline snapshot e4ea70c1-8c77-4eda-a0e4-9287efa42a3b of volume 6485a500-36b2-459d-a443-7a93421616bb {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 17:48:27 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[76738da1-a0b8-4a91-bef4-c94044812523]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:48:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6f2d66f6-abd9-4b5d-911f-8b53005f2321 tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6485a500-36b2-459d-a443-7a93421616bb {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:27 devstack sudo[92672]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-dc57509c-393e-41fe-9d2f-e4274cd7e0d5 tempest-AttachVolumeTestJSON-401623914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.408s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:27 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-dc57509c-393e-41fe-9d2f-e4274cd7e0d5 tempest-AttachVolumeTestJSON-401623914 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:48:27 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-dc57509c-393e-41fe-9d2f-e4274cd7e0d5 tempest-AttachVolumeTestJSON-401623914 None] Deleted volume successfully. Nov 06 17:48:28 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-dc57509c-393e-41fe-9d2f-e4274cd7e0d5 tempest-AttachVolumeTestJSON-401623914 None] Lock "cinder-1cfa4fd9-aed2-438c-aaf9-6abbd4054d67-delete_volume" released by "delete_volume" :: held 2.452s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:48:28 devstack sudo[92676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6485a500-36b2-459d-a443-7a93421616bb Nov 06 17:48:28 devstack sudo[92676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:28 devstack sudo[92676]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6f2d66f6-abd9-4b5d-911f-8b53005f2321 tempest-GroupSnapshotsTest-200721168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6485a500-36b2-459d-a443-7a93421616bb" returned: 0 in 0.562s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6f2d66f6-abd9-4b5d-911f-8b53005f2321 tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6485a500-36b2-459d-a443-7a93421616bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6485a500-36b2-459d-a443-7a93421616bb.e4ea70c1-8c77-4eda-a0e4-9287efa42a3b 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:28 devstack sudo[92683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6485a500-36b2-459d-a443-7a93421616bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6485a500-36b2-459d-a443-7a93421616bb.e4ea70c1-8c77-4eda-a0e4-9287efa42a3b 1G Nov 06 17:48:28 devstack sudo[92683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:29 devstack sudo[92683]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6f2d66f6-abd9-4b5d-911f-8b53005f2321 tempest-GroupSnapshotsTest-200721168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6485a500-36b2-459d-a443-7a93421616bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6485a500-36b2-459d-a443-7a93421616bb.e4ea70c1-8c77-4eda-a0e4-9287efa42a3b 1G" returned: 0 in 0.643s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6f2d66f6-abd9-4b5d-911f-8b53005f2321 tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6485a500-36b2-459d-a443-7a93421616bb -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6485a500-36b2-459d-a443-7a93421616bb.e4ea70c1-8c77-4eda-a0e4-9287efa42a3b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:29 devstack sudo[92689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6485a500-36b2-459d-a443-7a93421616bb -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6485a500-36b2-459d-a443-7a93421616bb.e4ea70c1-8c77-4eda-a0e4-9287efa42a3b Nov 06 17:48:29 devstack sudo[92689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:29 devstack sudo[92689]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6f2d66f6-abd9-4b5d-911f-8b53005f2321 tempest-GroupSnapshotsTest-200721168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6485a500-36b2-459d-a443-7a93421616bb -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6485a500-36b2-459d-a443-7a93421616bb.e4ea70c1-8c77-4eda-a0e4-9287efa42a3b" returned: 0 in 0.441s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:29 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-6f2d66f6-abd9-4b5d-911f-8b53005f2321 tempest-GroupSnapshotsTest-200721168 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6485a500-36b2-459d-a443-7a93421616bb.e4ea70c1-8c77-4eda-a0e4-9287efa42a3b is being set with open permissions: ugo+rw: NotImplementedError Nov 06 17:48:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6f2d66f6-abd9-4b5d-911f-8b53005f2321 tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6485a500-36b2-459d-a443-7a93421616bb.e4ea70c1-8c77-4eda-a0e4-9287efa42a3b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:29 devstack sudo[92694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6485a500-36b2-459d-a443-7a93421616bb.e4ea70c1-8c77-4eda-a0e4-9287efa42a3b Nov 06 17:48:29 devstack sudo[92694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:29 devstack sudo[92694]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6f2d66f6-abd9-4b5d-911f-8b53005f2321 tempest-GroupSnapshotsTest-200721168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6485a500-36b2-459d-a443-7a93421616bb.e4ea70c1-8c77-4eda-a0e4-9287efa42a3b" returned: 0 in 0.263s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6f2d66f6-abd9-4b5d-911f-8b53005f2321 tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6485a500-36b2-459d-a443-7a93421616bb.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:29 devstack sudo[92697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6485a500-36b2-459d-a443-7a93421616bb.info Nov 06 17:48:29 devstack sudo[92697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:30 devstack sudo[92697]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6f2d66f6-abd9-4b5d-911f-8b53005f2321 tempest-GroupSnapshotsTest-200721168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6485a500-36b2-459d-a443-7a93421616bb.info" returned: 0 in 0.360s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:30 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-6f2d66f6-abd9-4b5d-911f-8b53005f2321 tempest-GroupSnapshotsTest-200721168 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6485a500-36b2-459d-a443-7a93421616bb.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 17:48:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6f2d66f6-abd9-4b5d-911f-8b53005f2321 tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6485a500-36b2-459d-a443-7a93421616bb.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:30 devstack sudo[92702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6485a500-36b2-459d-a443-7a93421616bb.info Nov 06 17:48:30 devstack sudo[92702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:30 devstack sudo[92702]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6f2d66f6-abd9-4b5d-911f-8b53005f2321 tempest-GroupSnapshotsTest-200721168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6485a500-36b2-459d-a443-7a93421616bb.info" returned: 0 in 0.317s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6f2d66f6-abd9-4b5d-911f-8b53005f2321 tempest-GroupSnapshotsTest-200721168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.707s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:48:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-144bd6d8-d161-4383-8564-593bc81dfec1 req-1db4ab6a-0e1c-489a-8142-057ac12d90b0 tempest-ServerActionsTestOtherA-1480259007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.626s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:48:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-144bd6d8-d161-4383-8564-593bc81dfec1 req-1db4ab6a-0e1c-489a-8142-057ac12d90b0 tempest-ServerActionsTestOtherA-1480259007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:48:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-144bd6d8-d161-4383-8564-593bc81dfec1 req-1db4ab6a-0e1c-489a-8142-057ac12d90b0 tempest-ServerActionsTestOtherA-1480259007 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072', 'name': 'volume-459474e7-2a9c-4265-9f62-8b738b7531b7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ea0fa0a4-62fc-4eb0-96c6-97ff9a28b4e6', 'enforce_multipath': True} {{(pid=87068) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 17:48:30 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-144bd6d8-d161-4383-8564-593bc81dfec1 req-1db4ab6a-0e1c-489a-8142-057ac12d90b0 tempest-ServerActionsTestOtherA-1480259007 None] attachment_update completed successfully. Nov 06 17:48:30 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-6f2d66f6-abd9-4b5d-911f-8b53005f2321 tempest-GroupSnapshotsTest-200721168 None] group_snapshot df59d89d-2884-46fa-afab-5f60929f0e5d: created successfully Nov 06 17:48:30 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-851660a0-1404-4f9f-b246-6da3f23c23eb tempest-GroupSnapshotsTest-200721168 None] group_snapshot df59d89d-2884-46fa-afab-5f60929f0e5d: deleting Nov 06 17:48:31 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=113,cinder:UPDATE=96,cinder:INSERT=21,cinder:DELETE=5 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 17:48:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-851660a0-1404-4f9f-b246-6da3f23c23eb tempest-GroupSnapshotsTest-200721168 None] group_snapshot df59d89d-2884-46fa-afab-5f60929f0e5d: deleting {{(pid=87068) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 06 17:48:31 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-851660a0-1404-4f9f-b246-6da3f23c23eb tempest-GroupSnapshotsTest-200721168 None] Acquiring lock "cinder-quobyte-22fd7d1c-4c08-4a3a-921a-2da3d5851396" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:48:31 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-851660a0-1404-4f9f-b246-6da3f23c23eb tempest-GroupSnapshotsTest-200721168 None] Lock "cinder-quobyte-22fd7d1c-4c08-4a3a-921a-2da3d5851396" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:48:31 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-851660a0-1404-4f9f-b246-6da3f23c23eb tempest-GroupSnapshotsTest-200721168 None] Acquiring lock "cinder-quobyte-3059536a-e17b-4ec9-8e3d-8de72f7df3ed" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:48:31 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-851660a0-1404-4f9f-b246-6da3f23c23eb tempest-GroupSnapshotsTest-200721168 None] Lock "cinder-quobyte-3059536a-e17b-4ec9-8e3d-8de72f7df3ed" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:48:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-851660a0-1404-4f9f-b246-6da3f23c23eb tempest-GroupSnapshotsTest-200721168 None] Deleting offline snapshot 3059536a-e17b-4ec9-8e3d-8de72f7df3ed of volume 22fd7d1c-4c08-4a3a-921a-2da3d5851396 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 17:48:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-851660a0-1404-4f9f-b246-6da3f23c23eb tempest-GroupSnapshotsTest-200721168 None] snapshot_file for this snap is: volume-22fd7d1c-4c08-4a3a-921a-2da3d5851396.3059536a-e17b-4ec9-8e3d-8de72f7df3ed {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 17:48:31 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3cacf7a-c181-4daf-8cf2-8fed56356f0f]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:48:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-851660a0-1404-4f9f-b246-6da3f23c23eb tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-22fd7d1c-4c08-4a3a-921a-2da3d5851396.3059536a-e17b-4ec9-8e3d-8de72f7df3ed {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:31 devstack sudo[92706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-22fd7d1c-4c08-4a3a-921a-2da3d5851396.3059536a-e17b-4ec9-8e3d-8de72f7df3ed Nov 06 17:48:31 devstack sudo[92706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:31 devstack sudo[92706]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-851660a0-1404-4f9f-b246-6da3f23c23eb tempest-GroupSnapshotsTest-200721168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-22fd7d1c-4c08-4a3a-921a-2da3d5851396.3059536a-e17b-4ec9-8e3d-8de72f7df3ed" returned: 0 in 0.709s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-851660a0-1404-4f9f-b246-6da3f23c23eb tempest-GroupSnapshotsTest-200721168 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22fd7d1c-4c08-4a3a-921a-2da3d5851396(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 17:48:31 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ead0666-fedb-46a9-a6c8-8b398ce6d736]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:48:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-851660a0-1404-4f9f-b246-6da3f23c23eb tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-22fd7d1c-4c08-4a3a-921a-2da3d5851396 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:32 devstack sudo[92721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-22fd7d1c-4c08-4a3a-921a-2da3d5851396 Nov 06 17:48:32 devstack sudo[92721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:32 devstack sudo[92721]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-851660a0-1404-4f9f-b246-6da3f23c23eb tempest-GroupSnapshotsTest-200721168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-22fd7d1c-4c08-4a3a-921a-2da3d5851396" returned: 0 in 0.614s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-851660a0-1404-4f9f-b246-6da3f23c23eb tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-22fd7d1c-4c08-4a3a-921a-2da3d5851396.3059536a-e17b-4ec9-8e3d-8de72f7df3ed {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:32 devstack sudo[92742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-22fd7d1c-4c08-4a3a-921a-2da3d5851396.3059536a-e17b-4ec9-8e3d-8de72f7df3ed Nov 06 17:48:32 devstack sudo[92742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:33 devstack sudo[92742]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-851660a0-1404-4f9f-b246-6da3f23c23eb tempest-GroupSnapshotsTest-200721168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-22fd7d1c-4c08-4a3a-921a-2da3d5851396.3059536a-e17b-4ec9-8e3d-8de72f7df3ed" returned: 0 in 0.853s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-851660a0-1404-4f9f-b246-6da3f23c23eb tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-22fd7d1c-4c08-4a3a-921a-2da3d5851396.3059536a-e17b-4ec9-8e3d-8de72f7df3ed {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:33 devstack sudo[92777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-22fd7d1c-4c08-4a3a-921a-2da3d5851396.3059536a-e17b-4ec9-8e3d-8de72f7df3ed Nov 06 17:48:33 devstack sudo[92777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:33 devstack sudo[92777]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-851660a0-1404-4f9f-b246-6da3f23c23eb tempest-GroupSnapshotsTest-200721168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-22fd7d1c-4c08-4a3a-921a-2da3d5851396.3059536a-e17b-4ec9-8e3d-8de72f7df3ed" returned: 0 in 0.538s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:33 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-851660a0-1404-4f9f-b246-6da3f23c23eb tempest-GroupSnapshotsTest-200721168 None] Lock "cinder-quobyte-3059536a-e17b-4ec9-8e3d-8de72f7df3ed" released by "_delete_snapshot" :: held 2.871s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:48:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-851660a0-1404-4f9f-b246-6da3f23c23eb tempest-GroupSnapshotsTest-200721168 None] Lock "cinder-quobyte-22fd7d1c-4c08-4a3a-921a-2da3d5851396" released by "delete_snapshot" :: held 2.915s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:48:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-851660a0-1404-4f9f-b246-6da3f23c23eb tempest-GroupSnapshotsTest-200721168 None] Acquiring lock "cinder-quobyte-6485a500-36b2-459d-a443-7a93421616bb" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:48:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-851660a0-1404-4f9f-b246-6da3f23c23eb tempest-GroupSnapshotsTest-200721168 None] Lock "cinder-quobyte-6485a500-36b2-459d-a443-7a93421616bb" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:48:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-851660a0-1404-4f9f-b246-6da3f23c23eb tempest-GroupSnapshotsTest-200721168 None] Acquiring lock "cinder-quobyte-e4ea70c1-8c77-4eda-a0e4-9287efa42a3b" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:48:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-851660a0-1404-4f9f-b246-6da3f23c23eb tempest-GroupSnapshotsTest-200721168 None] Lock "cinder-quobyte-e4ea70c1-8c77-4eda-a0e4-9287efa42a3b" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:48:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-851660a0-1404-4f9f-b246-6da3f23c23eb tempest-GroupSnapshotsTest-200721168 None] Deleting offline snapshot e4ea70c1-8c77-4eda-a0e4-9287efa42a3b of volume 6485a500-36b2-459d-a443-7a93421616bb {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 17:48:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-851660a0-1404-4f9f-b246-6da3f23c23eb tempest-GroupSnapshotsTest-200721168 None] snapshot_file for this snap is: volume-6485a500-36b2-459d-a443-7a93421616bb.e4ea70c1-8c77-4eda-a0e4-9287efa42a3b {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 17:48:34 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f0fa10-e9e6-432d-9b5c-f79007a01d01]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:48:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-851660a0-1404-4f9f-b246-6da3f23c23eb tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6485a500-36b2-459d-a443-7a93421616bb.e4ea70c1-8c77-4eda-a0e4-9287efa42a3b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:34 devstack sudo[92781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6485a500-36b2-459d-a443-7a93421616bb.e4ea70c1-8c77-4eda-a0e4-9287efa42a3b Nov 06 17:48:34 devstack sudo[92781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:35 devstack sudo[92781]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-851660a0-1404-4f9f-b246-6da3f23c23eb tempest-GroupSnapshotsTest-200721168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6485a500-36b2-459d-a443-7a93421616bb.e4ea70c1-8c77-4eda-a0e4-9287efa42a3b" returned: 0 in 1.025s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:35 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-851660a0-1404-4f9f-b246-6da3f23c23eb tempest-GroupSnapshotsTest-200721168 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6485a500-36b2-459d-a443-7a93421616bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 17:48:35 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[70fa877d-6c3e-4c74-bea4-33c7b3d72cf6]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:48:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-851660a0-1404-4f9f-b246-6da3f23c23eb tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6485a500-36b2-459d-a443-7a93421616bb {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:35 devstack sudo[92803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6485a500-36b2-459d-a443-7a93421616bb Nov 06 17:48:35 devstack sudo[92803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:35 devstack sudo[92803]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-851660a0-1404-4f9f-b246-6da3f23c23eb tempest-GroupSnapshotsTest-200721168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6485a500-36b2-459d-a443-7a93421616bb" returned: 0 in 0.680s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-851660a0-1404-4f9f-b246-6da3f23c23eb tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6485a500-36b2-459d-a443-7a93421616bb.e4ea70c1-8c77-4eda-a0e4-9287efa42a3b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:36 devstack sudo[92826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6485a500-36b2-459d-a443-7a93421616bb.e4ea70c1-8c77-4eda-a0e4-9287efa42a3b Nov 06 17:48:36 devstack sudo[92826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:36 devstack sudo[92826]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-851660a0-1404-4f9f-b246-6da3f23c23eb tempest-GroupSnapshotsTest-200721168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6485a500-36b2-459d-a443-7a93421616bb.e4ea70c1-8c77-4eda-a0e4-9287efa42a3b" returned: 0 in 0.592s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-851660a0-1404-4f9f-b246-6da3f23c23eb tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6485a500-36b2-459d-a443-7a93421616bb.e4ea70c1-8c77-4eda-a0e4-9287efa42a3b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:36 devstack sudo[92839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6485a500-36b2-459d-a443-7a93421616bb.e4ea70c1-8c77-4eda-a0e4-9287efa42a3b Nov 06 17:48:36 devstack sudo[92839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:36 devstack sudo[92839]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-851660a0-1404-4f9f-b246-6da3f23c23eb tempest-GroupSnapshotsTest-200721168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6485a500-36b2-459d-a443-7a93421616bb.e4ea70c1-8c77-4eda-a0e4-9287efa42a3b" returned: 0 in 0.422s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-851660a0-1404-4f9f-b246-6da3f23c23eb tempest-GroupSnapshotsTest-200721168 None] Lock "cinder-quobyte-e4ea70c1-8c77-4eda-a0e4-9287efa42a3b" released by "_delete_snapshot" :: held 2.887s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:48:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-851660a0-1404-4f9f-b246-6da3f23c23eb tempest-GroupSnapshotsTest-200721168 None] Lock "cinder-quobyte-6485a500-36b2-459d-a443-7a93421616bb" released by "delete_snapshot" :: held 2.953s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:48:37 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=129,cinder:UPDATE=93,cinder:INSERT=16,cinder:DELETE=5 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 17:48:37 devstack cinder-volume[87068]: WARNING cinder.quota [None req-851660a0-1404-4f9f-b246-6da3f23c23eb tempest-GroupSnapshotsTest-200721168 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-361107839 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-361107839, it is now deprecated. Please use the default quota class for default quota. Nov 06 17:48:37 devstack cinder-volume[87068]: WARNING cinder.quota [None req-851660a0-1404-4f9f-b246-6da3f23c23eb tempest-GroupSnapshotsTest-200721168 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-361107839 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-361107839, it is now deprecated. Please use the default quota class for default quota. Nov 06 17:48:37 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-851660a0-1404-4f9f-b246-6da3f23c23eb tempest-GroupSnapshotsTest-200721168 None] Created reservations ['c22e8356-4c79-4bd4-bedc-2e553defb059', '2de5a62a-b634-4938-b62a-fbdd72eb2665', '52cdbff9-18f4-43e5-89dc-11aa748ae486', '0269c726-2c91-4789-9a3b-fbe0f007fd5f'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:48:37 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-851660a0-1404-4f9f-b246-6da3f23c23eb tempest-GroupSnapshotsTest-200721168 None] Created reservations ['766817db-c46e-488e-9cf2-fd55abdbf526', '09cca6b9-140f-4dce-97bf-cecb8a6055b1', '6eb0f762-df44-4483-81c0-84df32d043fb', 'c8275588-5d03-4d80-aeb1-422fe0164466'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:48:37 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-851660a0-1404-4f9f-b246-6da3f23c23eb tempest-GroupSnapshotsTest-200721168 None] group_snapshot df59d89d-2884-46fa-afab-5f60929f0e5d: deleted successfully Nov 06 17:48:38 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-43a058d6-9a8d-4c0e-8ad1-730aef7e1514 tempest-GroupSnapshotsTest-200721168 None] Acquiring lock "cinder-quobyte-22fd7d1c-4c08-4a3a-921a-2da3d5851396" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:48:38 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-43a058d6-9a8d-4c0e-8ad1-730aef7e1514 tempest-GroupSnapshotsTest-200721168 None] Lock "cinder-quobyte-22fd7d1c-4c08-4a3a-921a-2da3d5851396" acquired by "delete_volume" :: waited 0.027s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:48:38 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f32efd-93f5-4f72-83b9-32c5bf651769]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:48:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-43a058d6-9a8d-4c0e-8ad1-730aef7e1514 tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-22fd7d1c-4c08-4a3a-921a-2da3d5851396 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:38 devstack sudo[92842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-22fd7d1c-4c08-4a3a-921a-2da3d5851396 Nov 06 17:48:38 devstack sudo[92842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:39 devstack sudo[92842]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-43a058d6-9a8d-4c0e-8ad1-730aef7e1514 tempest-GroupSnapshotsTest-200721168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-22fd7d1c-4c08-4a3a-921a-2da3d5851396" returned: 0 in 0.408s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-43a058d6-9a8d-4c0e-8ad1-730aef7e1514 tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-22fd7d1c-4c08-4a3a-921a-2da3d5851396 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:39 devstack sudo[92847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-22fd7d1c-4c08-4a3a-921a-2da3d5851396 Nov 06 17:48:39 devstack sudo[92847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:39 devstack sudo[92847]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-43a058d6-9a8d-4c0e-8ad1-730aef7e1514 tempest-GroupSnapshotsTest-200721168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-22fd7d1c-4c08-4a3a-921a-2da3d5851396" returned: 0 in 0.276s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:39 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-43a058d6-9a8d-4c0e-8ad1-730aef7e1514 tempest-GroupSnapshotsTest-200721168 None] Lock "cinder-quobyte-22fd7d1c-4c08-4a3a-921a-2da3d5851396" released by "delete_volume" :: held 0.795s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:48:39 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-43a058d6-9a8d-4c0e-8ad1-730aef7e1514 tempest-GroupSnapshotsTest-200721168 None] Acquiring lock "cinder-quobyte-6485a500-36b2-459d-a443-7a93421616bb" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:48:39 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-43a058d6-9a8d-4c0e-8ad1-730aef7e1514 tempest-GroupSnapshotsTest-200721168 None] Lock "cinder-quobyte-6485a500-36b2-459d-a443-7a93421616bb" acquired by "delete_volume" :: waited 0.015s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:48:39 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82d6186-7d4d-4eae-b223-6b15225ed762]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:48:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-43a058d6-9a8d-4c0e-8ad1-730aef7e1514 tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6485a500-36b2-459d-a443-7a93421616bb {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:39 devstack sudo[92850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6485a500-36b2-459d-a443-7a93421616bb Nov 06 17:48:39 devstack sudo[92850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:39 devstack sudo[92850]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-43a058d6-9a8d-4c0e-8ad1-730aef7e1514 tempest-GroupSnapshotsTest-200721168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6485a500-36b2-459d-a443-7a93421616bb" returned: 0 in 0.376s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-43a058d6-9a8d-4c0e-8ad1-730aef7e1514 tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6485a500-36b2-459d-a443-7a93421616bb {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:39 devstack sudo[92856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6485a500-36b2-459d-a443-7a93421616bb Nov 06 17:48:39 devstack sudo[92856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:40 devstack sudo[92856]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-43a058d6-9a8d-4c0e-8ad1-730aef7e1514 tempest-GroupSnapshotsTest-200721168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6485a500-36b2-459d-a443-7a93421616bb" returned: 0 in 0.304s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-43a058d6-9a8d-4c0e-8ad1-730aef7e1514 tempest-GroupSnapshotsTest-200721168 None] Lock "cinder-quobyte-6485a500-36b2-459d-a443-7a93421616bb" released by "delete_volume" :: held 0.761s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:48:40 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [req-5ad12e1b-c2db-4c1b-9924-a258be03a30c req-e3b283cb-d68c-4f04-a649-76545cf1048e tempest-VolumesSnapshotsTestJSON-373053661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:48:40 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-5ad12e1b-c2db-4c1b-9924-a258be03a30c req-e3b283cb-d68c-4f04-a649-76545cf1048e tempest-VolumesSnapshotsTestJSON-373053661 None] Flow 'volume_create_manager' (35baf5e4-4aba-4f85-b0d6-bc79cca6a291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:48:40 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-5ad12e1b-c2db-4c1b-9924-a258be03a30c req-e3b283cb-d68c-4f04-a649-76545cf1048e tempest-VolumesSnapshotsTestJSON-373053661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc280a2e-b1f9-47bc-a8f4-f2fea0a3cfe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:48:40 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-5ad12e1b-c2db-4c1b-9924-a258be03a30c req-e3b283cb-d68c-4f04-a649-76545cf1048e tempest-VolumesSnapshotsTestJSON-373053661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc280a2e-b1f9-47bc-a8f4-f2fea0a3cfe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:48:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-856995315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=759375f1-e3e5-4ad6-afdb-9f5477548675,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36c5bbddde5244dc8d4333b0343975fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:48:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:48:40Z,use_quota=True,user_id='30e630292df74850bd6f89d410eff267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:48:40 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-5ad12e1b-c2db-4c1b-9924-a258be03a30c req-e3b283cb-d68c-4f04-a649-76545cf1048e tempest-VolumesSnapshotsTestJSON-373053661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (590be284-a6b1-40cd-9ea4-fc259d5046e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:48:40 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-5ad12e1b-c2db-4c1b-9924-a258be03a30c req-e3b283cb-d68c-4f04-a649-76545cf1048e tempest-VolumesSnapshotsTestJSON-373053661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (590be284-a6b1-40cd-9ea4-fc259d5046e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:48:40 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-5ad12e1b-c2db-4c1b-9924-a258be03a30c req-e3b283cb-d68c-4f04-a649-76545cf1048e tempest-VolumesSnapshotsTestJSON-373053661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6b1ac9f-204a-4d27-a35f-985bdf78a76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:48:40 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-5ad12e1b-c2db-4c1b-9924-a258be03a30c req-e3b283cb-d68c-4f04-a649-76545cf1048e tempest-VolumesSnapshotsTestJSON-373053661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6b1ac9f-204a-4d27-a35f-985bdf78a76b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '759375f1-e3e5-4ad6-afdb-9f5477548675', 'volume_name': 'volume-759375f1-e3e5-4ad6-afdb-9f5477548675', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:48:40 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-5ad12e1b-c2db-4c1b-9924-a258be03a30c req-e3b283cb-d68c-4f04-a649-76545cf1048e tempest-VolumesSnapshotsTestJSON-373053661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc97234f-3bda-4d58-9617-0584394335ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:48:40 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-5ad12e1b-c2db-4c1b-9924-a258be03a30c req-e3b283cb-d68c-4f04-a649-76545cf1048e tempest-VolumesSnapshotsTestJSON-373053661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc97234f-3bda-4d58-9617-0584394335ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:48:40 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-5ad12e1b-c2db-4c1b-9924-a258be03a30c req-e3b283cb-d68c-4f04-a649-76545cf1048e tempest-VolumesSnapshotsTestJSON-373053661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f2225b2-cde6-439a-a79c-082e0224bd9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:48:40 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [req-5ad12e1b-c2db-4c1b-9924-a258be03a30c req-e3b283cb-d68c-4f04-a649-76545cf1048e tempest-VolumesSnapshotsTestJSON-373053661 None] Volume 759375f1-e3e5-4ad6-afdb-9f5477548675: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-759375f1-e3e5-4ad6-afdb-9f5477548675', 'volume_size': 1} Nov 06 17:48:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-5ad12e1b-c2db-4c1b-9924-a258be03a30c req-e3b283cb-d68c-4f04-a649-76545cf1048e tempest-VolumesSnapshotsTestJSON-373053661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:48:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-5ad12e1b-c2db-4c1b-9924-a258be03a30c req-e3b283cb-d68c-4f04-a649-76545cf1048e tempest-VolumesSnapshotsTestJSON-373053661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:48:40 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [req-5ad12e1b-c2db-4c1b-9924-a258be03a30c req-e3b283cb-d68c-4f04-a649-76545cf1048e tempest-VolumesSnapshotsTestJSON-373053661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:48:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-856995315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=759375f1-e3e5-4ad6-afdb-9f5477548675,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36c5bbddde5244dc8d4333b0343975fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:48:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:48:40Z,use_quota=True,user_id='30e630292df74850bd6f89d410eff267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:48:40 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [req-5ad12e1b-c2db-4c1b-9924-a258be03a30c req-e3b283cb-d68c-4f04-a649-76545cf1048e tempest-VolumesSnapshotsTestJSON-373053661 None] Creating volume 759375f1-e3e5-4ad6-afdb-9f5477548675 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:48:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-5ad12e1b-c2db-4c1b-9924-a258be03a30c req-e3b283cb-d68c-4f04-a649-76545cf1048e tempest-VolumesSnapshotsTestJSON-373053661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:48:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-5ad12e1b-c2db-4c1b-9924-a258be03a30c req-e3b283cb-d68c-4f04-a649-76545cf1048e tempest-VolumesSnapshotsTestJSON-373053661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:48:40 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [req-5ad12e1b-c2db-4c1b-9924-a258be03a30c req-e3b283cb-d68c-4f04-a649-76545cf1048e tempest-VolumesSnapshotsTestJSON-373053661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:48:40 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [req-5ad12e1b-c2db-4c1b-9924-a258be03a30c req-e3b283cb-d68c-4f04-a649-76545cf1048e tempest-VolumesSnapshotsTestJSON-373053661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:48:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-5ad12e1b-c2db-4c1b-9924-a258be03a30c req-e3b283cb-d68c-4f04-a649-76545cf1048e tempest-VolumesSnapshotsTestJSON-373053661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:48:40 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [req-5ad12e1b-c2db-4c1b-9924-a258be03a30c req-e3b283cb-d68c-4f04-a649-76545cf1048e tempest-VolumesSnapshotsTestJSON-373053661 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:48:40 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [req-5ad12e1b-c2db-4c1b-9924-a258be03a30c req-e3b283cb-d68c-4f04-a649-76545cf1048e tempest-VolumesSnapshotsTestJSON-373053661 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:48:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-5ad12e1b-c2db-4c1b-9924-a258be03a30c req-e3b283cb-d68c-4f04-a649-76545cf1048e tempest-VolumesSnapshotsTestJSON-373053661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-759375f1-e3e5-4ad6-afdb-9f5477548675 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:40 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-43a058d6-9a8d-4c0e-8ad1-730aef7e1514 tempest-GroupSnapshotsTest-200721168 None] Created reservations ['fdc03946-52db-455c-9341-364647071396'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:48:40 devstack sudo[92860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-759375f1-e3e5-4ad6-afdb-9f5477548675 1073741824 Nov 06 17:48:40 devstack sudo[92860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:40 devstack cinder-volume[87068]: WARNING cinder.quota [None req-43a058d6-9a8d-4c0e-8ad1-730aef7e1514 tempest-GroupSnapshotsTest-200721168 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-361107839 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-361107839, it is now deprecated. Please use the default quota class for default quota. Nov 06 17:48:40 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-43a058d6-9a8d-4c0e-8ad1-730aef7e1514 tempest-GroupSnapshotsTest-200721168 None] Created reservations ['6a0b9c1f-b85b-4fc4-be40-a5a24c400039', 'deb590b6-df06-4b39-b321-1ac7bf25cb24', '4eb0d907-49fb-40e6-b328-40923290d7e1', '14df3f3d-7890-45ff-ab61-05b0723f91e4'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:48:40 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-43a058d6-9a8d-4c0e-8ad1-730aef7e1514 tempest-GroupSnapshotsTest-200721168 None] Created reservations ['ce58fbae-efe5-475b-8ecf-bb729d772b8e', '42481df9-b389-4a5d-bb12-f9b254b97446', 'ec24b002-d905-4460-8fa4-6372dc2eb88e', 'dd14dfc6-4be9-4ffd-8273-9648cb825406'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:48:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-43a058d6-9a8d-4c0e-8ad1-730aef7e1514 tempest-GroupSnapshotsTest-200721168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:48:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-43a058d6-9a8d-4c0e-8ad1-730aef7e1514 tempest-GroupSnapshotsTest-200721168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:48:40 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-43a058d6-9a8d-4c0e-8ad1-730aef7e1514 tempest-GroupSnapshotsTest-200721168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:48:40 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-43a058d6-9a8d-4c0e-8ad1-730aef7e1514 tempest-GroupSnapshotsTest-200721168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:48:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-43a058d6-9a8d-4c0e-8ad1-730aef7e1514 tempest-GroupSnapshotsTest-200721168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:48:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-43a058d6-9a8d-4c0e-8ad1-730aef7e1514 tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:40 devstack sudo[92865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:48:40 devstack sudo[92865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:40 devstack sudo[92860]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-5ad12e1b-c2db-4c1b-9924-a258be03a30c req-e3b283cb-d68c-4f04-a649-76545cf1048e tempest-VolumesSnapshotsTestJSON-373053661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-759375f1-e3e5-4ad6-afdb-9f5477548675 1073741824" returned: 0 in 0.471s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-5ad12e1b-c2db-4c1b-9924-a258be03a30c req-e3b283cb-d68c-4f04-a649-76545cf1048e tempest-VolumesSnapshotsTestJSON-373053661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-759375f1-e3e5-4ad6-afdb-9f5477548675 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:40 devstack sudo[92868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-759375f1-e3e5-4ad6-afdb-9f5477548675 Nov 06 17:48:40 devstack sudo[92868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:40 devstack sudo[92865]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-43a058d6-9a8d-4c0e-8ad1-730aef7e1514 tempest-GroupSnapshotsTest-200721168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.295s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:40 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-43a058d6-9a8d-4c0e-8ad1-730aef7e1514 tempest-GroupSnapshotsTest-200721168 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:48:40 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-43a058d6-9a8d-4c0e-8ad1-730aef7e1514 tempest-GroupSnapshotsTest-200721168 None] Delete group completed successfully. Nov 06 17:48:41 devstack sudo[92868]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-5ad12e1b-c2db-4c1b-9924-a258be03a30c req-e3b283cb-d68c-4f04-a649-76545cf1048e tempest-VolumesSnapshotsTestJSON-373053661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-759375f1-e3e5-4ad6-afdb-9f5477548675" returned: 0 in 0.274s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:41 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [req-5ad12e1b-c2db-4c1b-9924-a258be03a30c req-e3b283cb-d68c-4f04-a649-76545cf1048e tempest-VolumesSnapshotsTestJSON-373053661 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:48:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-5ad12e1b-c2db-4c1b-9924-a258be03a30c req-e3b283cb-d68c-4f04-a649-76545cf1048e tempest-VolumesSnapshotsTestJSON-373053661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:48:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-5ad12e1b-c2db-4c1b-9924-a258be03a30c req-e3b283cb-d68c-4f04-a649-76545cf1048e tempest-VolumesSnapshotsTestJSON-373053661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f2225b2-cde6-439a-a79c-082e0224bd9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-759375f1-e3e5-4ad6-afdb-9f5477548675', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:48:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-5ad12e1b-c2db-4c1b-9924-a258be03a30c req-e3b283cb-d68c-4f04-a649-76545cf1048e tempest-VolumesSnapshotsTestJSON-373053661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff02768b-de1c-4820-a20c-458a380c0449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:48:41 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [req-5ad12e1b-c2db-4c1b-9924-a258be03a30c req-e3b283cb-d68c-4f04-a649-76545cf1048e tempest-VolumesSnapshotsTestJSON-373053661 None] Volume volume-759375f1-e3e5-4ad6-afdb-9f5477548675 (759375f1-e3e5-4ad6-afdb-9f5477548675): created successfully Nov 06 17:48:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-5ad12e1b-c2db-4c1b-9924-a258be03a30c req-e3b283cb-d68c-4f04-a649-76545cf1048e tempest-VolumesSnapshotsTestJSON-373053661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff02768b-de1c-4820-a20c-458a380c0449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:48:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-5ad12e1b-c2db-4c1b-9924-a258be03a30c req-e3b283cb-d68c-4f04-a649-76545cf1048e tempest-VolumesSnapshotsTestJSON-373053661 None] Flow 'volume_create_manager' (35baf5e4-4aba-4f85-b0d6-bc79cca6a291) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:48:41 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-5ad12e1b-c2db-4c1b-9924-a258be03a30c req-e3b283cb-d68c-4f04-a649-76545cf1048e tempest-VolumesSnapshotsTestJSON-373053661 None] Created volume successfully. Nov 06 17:48:41 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-26a321ea-2b04-433d-9857-aba1f6aac1d6 tempest-GroupSnapshotsTest-200721168 None] Group tempest-GroupSnapshotsTest-Group-1030403030: creating Nov 06 17:48:41 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-26a321ea-2b04-433d-9857-aba1f6aac1d6 tempest-GroupSnapshotsTest-200721168 None] Group tempest-GroupSnapshotsTest-Group-1030403030: created successfully Nov 06 17:48:41 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-26a321ea-2b04-433d-9857-aba1f6aac1d6 tempest-GroupSnapshotsTest-200721168 None] Create group completed successfully. Nov 06 17:48:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-00ea1700-4ee3-4659-be4e-aa6d5dacb1ee req-dc0e9e59-cbf1-4ef8-89cc-d6a66a38c459 tempest-VolumesSnapshotsTestJSON-373053661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:48:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-00ea1700-4ee3-4659-be4e-aa6d5dacb1ee req-dc0e9e59-cbf1-4ef8-89cc-d6a66a38c459 tempest-VolumesSnapshotsTestJSON-373053661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:48:41 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [req-00ea1700-4ee3-4659-be4e-aa6d5dacb1ee req-dc0e9e59-cbf1-4ef8-89cc-d6a66a38c459 tempest-VolumesSnapshotsTestJSON-373053661 None] Creating offline snapshot 2e468fa1-29f7-48c4-9efb-05c176602fd6 of volume 759375f1-e3e5-4ad6-afdb-9f5477548675 {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 17:48:41 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d24668-c3e5-4a31-bee7-50b040514c29]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:48:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-00ea1700-4ee3-4659-be4e-aa6d5dacb1ee req-dc0e9e59-cbf1-4ef8-89cc-d6a66a38c459 tempest-VolumesSnapshotsTestJSON-373053661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-759375f1-e3e5-4ad6-afdb-9f5477548675 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:41 devstack sudo[92872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-759375f1-e3e5-4ad6-afdb-9f5477548675 Nov 06 17:48:41 devstack sudo[92872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:42 devstack sudo[92872]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-00ea1700-4ee3-4659-be4e-aa6d5dacb1ee req-dc0e9e59-cbf1-4ef8-89cc-d6a66a38c459 tempest-VolumesSnapshotsTestJSON-373053661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-759375f1-e3e5-4ad6-afdb-9f5477548675" returned: 0 in 0.369s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-00ea1700-4ee3-4659-be4e-aa6d5dacb1ee req-dc0e9e59-cbf1-4ef8-89cc-d6a66a38c459 tempest-VolumesSnapshotsTestJSON-373053661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-759375f1-e3e5-4ad6-afdb-9f5477548675,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-759375f1-e3e5-4ad6-afdb-9f5477548675.2e468fa1-29f7-48c4-9efb-05c176602fd6 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:42 devstack sudo[92877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-759375f1-e3e5-4ad6-afdb-9f5477548675,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-759375f1-e3e5-4ad6-afdb-9f5477548675.2e468fa1-29f7-48c4-9efb-05c176602fd6 1G Nov 06 17:48:42 devstack sudo[92877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:42 devstack sudo[92877]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-00ea1700-4ee3-4659-be4e-aa6d5dacb1ee req-dc0e9e59-cbf1-4ef8-89cc-d6a66a38c459 tempest-VolumesSnapshotsTestJSON-373053661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-759375f1-e3e5-4ad6-afdb-9f5477548675,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-759375f1-e3e5-4ad6-afdb-9f5477548675.2e468fa1-29f7-48c4-9efb-05c176602fd6 1G" returned: 0 in 0.392s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-00ea1700-4ee3-4659-be4e-aa6d5dacb1ee req-dc0e9e59-cbf1-4ef8-89cc-d6a66a38c459 tempest-VolumesSnapshotsTestJSON-373053661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-759375f1-e3e5-4ad6-afdb-9f5477548675 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-759375f1-e3e5-4ad6-afdb-9f5477548675.2e468fa1-29f7-48c4-9efb-05c176602fd6 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:42 devstack sudo[92897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-759375f1-e3e5-4ad6-afdb-9f5477548675 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-759375f1-e3e5-4ad6-afdb-9f5477548675.2e468fa1-29f7-48c4-9efb-05c176602fd6 Nov 06 17:48:42 devstack sudo[92897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:42 devstack sudo[92897]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-00ea1700-4ee3-4659-be4e-aa6d5dacb1ee req-dc0e9e59-cbf1-4ef8-89cc-d6a66a38c459 tempest-VolumesSnapshotsTestJSON-373053661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-759375f1-e3e5-4ad6-afdb-9f5477548675 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-759375f1-e3e5-4ad6-afdb-9f5477548675.2e468fa1-29f7-48c4-9efb-05c176602fd6" returned: 0 in 0.487s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:42 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [req-00ea1700-4ee3-4659-be4e-aa6d5dacb1ee req-dc0e9e59-cbf1-4ef8-89cc-d6a66a38c459 tempest-VolumesSnapshotsTestJSON-373053661 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-759375f1-e3e5-4ad6-afdb-9f5477548675.2e468fa1-29f7-48c4-9efb-05c176602fd6 is being set with open permissions: ugo+rw Nov 06 17:48:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-00ea1700-4ee3-4659-be4e-aa6d5dacb1ee req-dc0e9e59-cbf1-4ef8-89cc-d6a66a38c459 tempest-VolumesSnapshotsTestJSON-373053661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-759375f1-e3e5-4ad6-afdb-9f5477548675.2e468fa1-29f7-48c4-9efb-05c176602fd6 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:42 devstack sudo[92924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-759375f1-e3e5-4ad6-afdb-9f5477548675.2e468fa1-29f7-48c4-9efb-05c176602fd6 Nov 06 17:48:42 devstack sudo[92924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:43 devstack sudo[92924]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-00ea1700-4ee3-4659-be4e-aa6d5dacb1ee req-dc0e9e59-cbf1-4ef8-89cc-d6a66a38c459 tempest-VolumesSnapshotsTestJSON-373053661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-759375f1-e3e5-4ad6-afdb-9f5477548675.2e468fa1-29f7-48c4-9efb-05c176602fd6" returned: 0 in 0.371s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:43 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-90e98671-1eed-41e8-8079-365ce780dcb8 tempest-GroupSnapshotsTest-200721168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:48:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-90e98671-1eed-41e8-8079-365ce780dcb8 tempest-GroupSnapshotsTest-200721168 None] Flow 'volume_create_manager' (08650a35-1051-4a85-8099-2436d2ac31c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:48:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-90e98671-1eed-41e8-8079-365ce780dcb8 tempest-GroupSnapshotsTest-200721168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (534392ee-b6f9-42f2-b226-09b1f792c25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:48:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-90e98671-1eed-41e8-8079-365ce780dcb8 tempest-GroupSnapshotsTest-200721168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (534392ee-b6f9-42f2-b226-09b1f792c25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1854635021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9066309a-458f-4e87-874d-a73a36ee96ff,host='devstack@QuobyteHD#QuobyteHD',id=34f2fadf-f4cb-44a8-a650-531e00f9c211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc68bbf6525c4727a32d77d254bbbc75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:48:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:48:43Z,use_quota=True,user_id='e62775d7e794453ca97d7197939d35bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3d43fa20-4c26-46f1-b97b-4d34b21aeca3),volume_type_id=3d43fa20-4c26-46f1-b97b-4d34b21aeca3)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:48:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-90e98671-1eed-41e8-8079-365ce780dcb8 tempest-GroupSnapshotsTest-200721168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58336f9e-1867-42cf-9f91-eb0b1194c225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:48:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-90e98671-1eed-41e8-8079-365ce780dcb8 tempest-GroupSnapshotsTest-200721168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58336f9e-1867-42cf-9f91-eb0b1194c225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:48:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-90e98671-1eed-41e8-8079-365ce780dcb8 tempest-GroupSnapshotsTest-200721168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c8ef691-2b33-4e26-90fe-778a3e03b7ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:48:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-90e98671-1eed-41e8-8079-365ce780dcb8 tempest-GroupSnapshotsTest-200721168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c8ef691-2b33-4e26-90fe-778a3e03b7ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34f2fadf-f4cb-44a8-a650-531e00f9c211', 'volume_name': 'volume-34f2fadf-f4cb-44a8-a650-531e00f9c211', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:48:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-90e98671-1eed-41e8-8079-365ce780dcb8 tempest-GroupSnapshotsTest-200721168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2167546-e4e9-463e-b59e-1b721673d4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:48:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-90e98671-1eed-41e8-8079-365ce780dcb8 tempest-GroupSnapshotsTest-200721168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2167546-e4e9-463e-b59e-1b721673d4a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:48:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-90e98671-1eed-41e8-8079-365ce780dcb8 tempest-GroupSnapshotsTest-200721168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e69eb03-2b79-4404-bc00-9b1aa83f24f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:48:43 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-90e98671-1eed-41e8-8079-365ce780dcb8 tempest-GroupSnapshotsTest-200721168 None] Volume 34f2fadf-f4cb-44a8-a650-531e00f9c211: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34f2fadf-f4cb-44a8-a650-531e00f9c211', 'volume_size': 1} Nov 06 17:48:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-90e98671-1eed-41e8-8079-365ce780dcb8 tempest-GroupSnapshotsTest-200721168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:48:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-00ea1700-4ee3-4659-be4e-aa6d5dacb1ee req-dc0e9e59-cbf1-4ef8-89cc-d6a66a38c459 tempest-VolumesSnapshotsTestJSON-373053661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-759375f1-e3e5-4ad6-afdb-9f5477548675.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:43 devstack sudo[92927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-759375f1-e3e5-4ad6-afdb-9f5477548675.info Nov 06 17:48:43 devstack sudo[92927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:43 devstack sudo[92927]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-00ea1700-4ee3-4659-be4e-aa6d5dacb1ee req-dc0e9e59-cbf1-4ef8-89cc-d6a66a38c459 tempest-VolumesSnapshotsTestJSON-373053661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-759375f1-e3e5-4ad6-afdb-9f5477548675.info" returned: 0 in 0.333s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:43 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [req-00ea1700-4ee3-4659-be4e-aa6d5dacb1ee req-dc0e9e59-cbf1-4ef8-89cc-d6a66a38c459 tempest-VolumesSnapshotsTestJSON-373053661 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-759375f1-e3e5-4ad6-afdb-9f5477548675.info is being set with open permissions: ugo+rw Nov 06 17:48:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-00ea1700-4ee3-4659-be4e-aa6d5dacb1ee req-dc0e9e59-cbf1-4ef8-89cc-d6a66a38c459 tempest-VolumesSnapshotsTestJSON-373053661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-759375f1-e3e5-4ad6-afdb-9f5477548675.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:43 devstack sudo[92930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-759375f1-e3e5-4ad6-afdb-9f5477548675.info Nov 06 17:48:43 devstack sudo[92930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:44 devstack sudo[92930]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-00ea1700-4ee3-4659-be4e-aa6d5dacb1ee req-dc0e9e59-cbf1-4ef8-89cc-d6a66a38c459 tempest-VolumesSnapshotsTestJSON-373053661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-759375f1-e3e5-4ad6-afdb-9f5477548675.info" returned: 0 in 0.307s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-00ea1700-4ee3-4659-be4e-aa6d5dacb1ee req-dc0e9e59-cbf1-4ef8-89cc-d6a66a38c459 tempest-VolumesSnapshotsTestJSON-373053661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.453s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:48:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-90e98671-1eed-41e8-8079-365ce780dcb8 tempest-GroupSnapshotsTest-200721168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.674s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:48:44 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-90e98671-1eed-41e8-8079-365ce780dcb8 tempest-GroupSnapshotsTest-200721168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9066309a-458f-4e87-874d-a73a36ee96ff,created_at=2026-11-06T16:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1854635021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9066309a-458f-4e87-874d-a73a36ee96ff,host='devstack@QuobyteHD#QuobyteHD',id=34f2fadf-f4cb-44a8-a650-531e00f9c211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc68bbf6525c4727a32d77d254bbbc75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:48:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:48:43Z,use_quota=True,user_id='e62775d7e794453ca97d7197939d35bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3d43fa20-4c26-46f1-b97b-4d34b21aeca3),volume_type_id=3d43fa20-4c26-46f1-b97b-4d34b21aeca3)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:48:44 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-90e98671-1eed-41e8-8079-365ce780dcb8 tempest-GroupSnapshotsTest-200721168 None] Creating volume 34f2fadf-f4cb-44a8-a650-531e00f9c211 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:48:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-90e98671-1eed-41e8-8079-365ce780dcb8 tempest-GroupSnapshotsTest-200721168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:48:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-90e98671-1eed-41e8-8079-365ce780dcb8 tempest-GroupSnapshotsTest-200721168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:48:44 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-90e98671-1eed-41e8-8079-365ce780dcb8 tempest-GroupSnapshotsTest-200721168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:48:44 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-90e98671-1eed-41e8-8079-365ce780dcb8 tempest-GroupSnapshotsTest-200721168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:48:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-90e98671-1eed-41e8-8079-365ce780dcb8 tempest-GroupSnapshotsTest-200721168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:48:44 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-90e98671-1eed-41e8-8079-365ce780dcb8 tempest-GroupSnapshotsTest-200721168 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:48:44 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-90e98671-1eed-41e8-8079-365ce780dcb8 tempest-GroupSnapshotsTest-200721168 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:48:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-90e98671-1eed-41e8-8079-365ce780dcb8 tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-34f2fadf-f4cb-44a8-a650-531e00f9c211 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:44 devstack sudo[92933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-34f2fadf-f4cb-44a8-a650-531e00f9c211 1073741824 Nov 06 17:48:44 devstack sudo[92933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:44 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-00ea1700-4ee3-4659-be4e-aa6d5dacb1ee req-dc0e9e59-cbf1-4ef8-89cc-d6a66a38c459 tempest-VolumesSnapshotsTestJSON-373053661 None] Create snapshot completed successfully Nov 06 17:48:44 devstack sudo[92933]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-90e98671-1eed-41e8-8079-365ce780dcb8 tempest-GroupSnapshotsTest-200721168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-34f2fadf-f4cb-44a8-a650-531e00f9c211 1073741824" returned: 0 in 0.514s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-90e98671-1eed-41e8-8079-365ce780dcb8 tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-34f2fadf-f4cb-44a8-a650-531e00f9c211 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:44 devstack sudo[92939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-34f2fadf-f4cb-44a8-a650-531e00f9c211 Nov 06 17:48:44 devstack sudo[92939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:44 devstack sudo[92939]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-90e98671-1eed-41e8-8079-365ce780dcb8 tempest-GroupSnapshotsTest-200721168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-34f2fadf-f4cb-44a8-a650-531e00f9c211" returned: 0 in 0.254s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:44 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-90e98671-1eed-41e8-8079-365ce780dcb8 tempest-GroupSnapshotsTest-200721168 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:48:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-90e98671-1eed-41e8-8079-365ce780dcb8 tempest-GroupSnapshotsTest-200721168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:48:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-90e98671-1eed-41e8-8079-365ce780dcb8 tempest-GroupSnapshotsTest-200721168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e69eb03-2b79-4404-bc00-9b1aa83f24f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34f2fadf-f4cb-44a8-a650-531e00f9c211', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:48:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-90e98671-1eed-41e8-8079-365ce780dcb8 tempest-GroupSnapshotsTest-200721168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57f2d2b9-b43e-4829-933d-98cc20be01f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:48:44 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-90e98671-1eed-41e8-8079-365ce780dcb8 tempest-GroupSnapshotsTest-200721168 None] Volume volume-34f2fadf-f4cb-44a8-a650-531e00f9c211 (34f2fadf-f4cb-44a8-a650-531e00f9c211): created successfully Nov 06 17:48:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-90e98671-1eed-41e8-8079-365ce780dcb8 tempest-GroupSnapshotsTest-200721168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57f2d2b9-b43e-4829-933d-98cc20be01f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:48:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-90e98671-1eed-41e8-8079-365ce780dcb8 tempest-GroupSnapshotsTest-200721168 None] Flow 'volume_create_manager' (08650a35-1051-4a85-8099-2436d2ac31c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:48:44 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-90e98671-1eed-41e8-8079-365ce780dcb8 tempest-GroupSnapshotsTest-200721168 None] Created volume successfully. Nov 06 17:48:45 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-895acb8b-ff2e-4bed-933f-a4c42082f490 req-4fec8865-50c1-4e3e-8aa1-1f5882758dd5 tempest-VolumesSnapshotsTestJSON-373053661 None] Acquiring lock "cinder-2e468fa1-29f7-48c4-9efb-05c176602fd6-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:48:45 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-895acb8b-ff2e-4bed-933f-a4c42082f490 req-4fec8865-50c1-4e3e-8aa1-1f5882758dd5 tempest-VolumesSnapshotsTestJSON-373053661 None] Lock "cinder-2e468fa1-29f7-48c4-9efb-05c176602fd6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:48:45 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-895acb8b-ff2e-4bed-933f-a4c42082f490 req-4fec8865-50c1-4e3e-8aa1-1f5882758dd5 tempest-VolumesSnapshotsTestJSON-373053661 None] Acquiring lock "cinder-quobyte-759375f1-e3e5-4ad6-afdb-9f5477548675" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:48:45 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-895acb8b-ff2e-4bed-933f-a4c42082f490 req-4fec8865-50c1-4e3e-8aa1-1f5882758dd5 tempest-VolumesSnapshotsTestJSON-373053661 None] Lock "cinder-quobyte-759375f1-e3e5-4ad6-afdb-9f5477548675" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:48:45 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-895acb8b-ff2e-4bed-933f-a4c42082f490 req-4fec8865-50c1-4e3e-8aa1-1f5882758dd5 tempest-VolumesSnapshotsTestJSON-373053661 None] Acquiring lock "cinder-quobyte-2e468fa1-29f7-48c4-9efb-05c176602fd6" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:48:45 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-895acb8b-ff2e-4bed-933f-a4c42082f490 req-4fec8865-50c1-4e3e-8aa1-1f5882758dd5 tempest-VolumesSnapshotsTestJSON-373053661 None] Lock "cinder-quobyte-2e468fa1-29f7-48c4-9efb-05c176602fd6" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:48:45 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [req-895acb8b-ff2e-4bed-933f-a4c42082f490 req-4fec8865-50c1-4e3e-8aa1-1f5882758dd5 tempest-VolumesSnapshotsTestJSON-373053661 None] Deleting offline snapshot 2e468fa1-29f7-48c4-9efb-05c176602fd6 of volume 759375f1-e3e5-4ad6-afdb-9f5477548675 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 17:48:45 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [req-895acb8b-ff2e-4bed-933f-a4c42082f490 req-4fec8865-50c1-4e3e-8aa1-1f5882758dd5 tempest-VolumesSnapshotsTestJSON-373053661 None] snapshot_file for this snap is: volume-759375f1-e3e5-4ad6-afdb-9f5477548675.2e468fa1-29f7-48c4-9efb-05c176602fd6 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 17:48:45 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[76dc5463-96b9-4d6b-8a14-e0ccefadd17a]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:48:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-895acb8b-ff2e-4bed-933f-a4c42082f490 req-4fec8865-50c1-4e3e-8aa1-1f5882758dd5 tempest-VolumesSnapshotsTestJSON-373053661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-759375f1-e3e5-4ad6-afdb-9f5477548675.2e468fa1-29f7-48c4-9efb-05c176602fd6 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:45 devstack sudo[92942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-759375f1-e3e5-4ad6-afdb-9f5477548675.2e468fa1-29f7-48c4-9efb-05c176602fd6 Nov 06 17:48:45 devstack sudo[92942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:45 devstack sudo[92942]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-895acb8b-ff2e-4bed-933f-a4c42082f490 req-4fec8865-50c1-4e3e-8aa1-1f5882758dd5 tempest-VolumesSnapshotsTestJSON-373053661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-759375f1-e3e5-4ad6-afdb-9f5477548675.2e468fa1-29f7-48c4-9efb-05c176602fd6" returned: 0 in 0.449s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:45 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [req-895acb8b-ff2e-4bed-933f-a4c42082f490 req-4fec8865-50c1-4e3e-8aa1-1f5882758dd5 tempest-VolumesSnapshotsTestJSON-373053661 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-759375f1-e3e5-4ad6-afdb-9f5477548675(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 17:48:45 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[501ec31d-6058-422a-9766-2d4992752eeb]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:48:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-895acb8b-ff2e-4bed-933f-a4c42082f490 req-4fec8865-50c1-4e3e-8aa1-1f5882758dd5 tempest-VolumesSnapshotsTestJSON-373053661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-759375f1-e3e5-4ad6-afdb-9f5477548675 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:45 devstack sudo[92947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-759375f1-e3e5-4ad6-afdb-9f5477548675 Nov 06 17:48:45 devstack sudo[92947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:45 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-0d9ca21c-6128-4fb4-8f01-cfd69fe75218 tempest-GroupSnapshotsTest-200721168 None] GroupSnapshot 368a0a55-7089-4323-9b93-d1fbb19f6bdf: creating. Nov 06 17:48:45 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0d9ca21c-6128-4fb4-8f01-cfd69fe75218 tempest-GroupSnapshotsTest-200721168 None] Group snapshot 368a0a55-7089-4323-9b93-d1fbb19f6bdf: creating. {{(pid=87068) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 06 17:48:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0d9ca21c-6128-4fb4-8f01-cfd69fe75218 tempest-GroupSnapshotsTest-200721168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:48:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0d9ca21c-6128-4fb4-8f01-cfd69fe75218 tempest-GroupSnapshotsTest-200721168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:48:46 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-0d9ca21c-6128-4fb4-8f01-cfd69fe75218 tempest-GroupSnapshotsTest-200721168 None] Creating offline snapshot 456f2613-2203-45f4-bd9c-974efbbb1566 of volume 34f2fadf-f4cb-44a8-a650-531e00f9c211 {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 17:48:46 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf0b2c7-0e23-4b00-9fd4-f0756d3a942f]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:48:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0d9ca21c-6128-4fb4-8f01-cfd69fe75218 tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-34f2fadf-f4cb-44a8-a650-531e00f9c211 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:46 devstack sudo[92947]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-895acb8b-ff2e-4bed-933f-a4c42082f490 req-4fec8865-50c1-4e3e-8aa1-1f5882758dd5 tempest-VolumesSnapshotsTestJSON-373053661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-759375f1-e3e5-4ad6-afdb-9f5477548675" returned: 0 in 0.400s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-895acb8b-ff2e-4bed-933f-a4c42082f490 req-4fec8865-50c1-4e3e-8aa1-1f5882758dd5 tempest-VolumesSnapshotsTestJSON-373053661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-759375f1-e3e5-4ad6-afdb-9f5477548675.2e468fa1-29f7-48c4-9efb-05c176602fd6 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:46 devstack sudo[92953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-759375f1-e3e5-4ad6-afdb-9f5477548675.2e468fa1-29f7-48c4-9efb-05c176602fd6 Nov 06 17:48:46 devstack sudo[92953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:46 devstack sudo[92951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-34f2fadf-f4cb-44a8-a650-531e00f9c211 Nov 06 17:48:46 devstack sudo[92951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:46 devstack sudo[92951]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0d9ca21c-6128-4fb4-8f01-cfd69fe75218 tempest-GroupSnapshotsTest-200721168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-34f2fadf-f4cb-44a8-a650-531e00f9c211" returned: 0 in 0.420s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0d9ca21c-6128-4fb4-8f01-cfd69fe75218 tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-34f2fadf-f4cb-44a8-a650-531e00f9c211,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-34f2fadf-f4cb-44a8-a650-531e00f9c211.456f2613-2203-45f4-bd9c-974efbbb1566 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:46 devstack sudo[92953]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:46 devstack sudo[92963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-34f2fadf-f4cb-44a8-a650-531e00f9c211,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-34f2fadf-f4cb-44a8-a650-531e00f9c211.456f2613-2203-45f4-bd9c-974efbbb1566 1G Nov 06 17:48:46 devstack sudo[92963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-895acb8b-ff2e-4bed-933f-a4c42082f490 req-4fec8865-50c1-4e3e-8aa1-1f5882758dd5 tempest-VolumesSnapshotsTestJSON-373053661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-759375f1-e3e5-4ad6-afdb-9f5477548675.2e468fa1-29f7-48c4-9efb-05c176602fd6" returned: 0 in 0.384s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-895acb8b-ff2e-4bed-933f-a4c42082f490 req-4fec8865-50c1-4e3e-8aa1-1f5882758dd5 tempest-VolumesSnapshotsTestJSON-373053661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-759375f1-e3e5-4ad6-afdb-9f5477548675.2e468fa1-29f7-48c4-9efb-05c176602fd6 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:46 devstack sudo[92965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-759375f1-e3e5-4ad6-afdb-9f5477548675.2e468fa1-29f7-48c4-9efb-05c176602fd6 Nov 06 17:48:46 devstack sudo[92965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:46 devstack sudo[92965]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-895acb8b-ff2e-4bed-933f-a4c42082f490 req-4fec8865-50c1-4e3e-8aa1-1f5882758dd5 tempest-VolumesSnapshotsTestJSON-373053661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-759375f1-e3e5-4ad6-afdb-9f5477548675.2e468fa1-29f7-48c4-9efb-05c176602fd6" returned: 0 in 0.269s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:46 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-895acb8b-ff2e-4bed-933f-a4c42082f490 req-4fec8865-50c1-4e3e-8aa1-1f5882758dd5 tempest-VolumesSnapshotsTestJSON-373053661 None] Lock "cinder-quobyte-2e468fa1-29f7-48c4-9efb-05c176602fd6" released by "_delete_snapshot" :: held 1.646s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:48:46 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-895acb8b-ff2e-4bed-933f-a4c42082f490 req-4fec8865-50c1-4e3e-8aa1-1f5882758dd5 tempest-VolumesSnapshotsTestJSON-373053661 None] Lock "cinder-quobyte-759375f1-e3e5-4ad6-afdb-9f5477548675" released by "delete_snapshot" :: held 1.681s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:48:46 devstack cinder-volume[87068]: WARNING cinder.quota [req-895acb8b-ff2e-4bed-933f-a4c42082f490 req-4fec8865-50c1-4e3e-8aa1-1f5882758dd5 tempest-VolumesSnapshotsTestJSON-373053661 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 06 17:48:46 devstack cinder-volume[87068]: DEBUG cinder.quota [req-895acb8b-ff2e-4bed-933f-a4c42082f490 req-4fec8865-50c1-4e3e-8aa1-1f5882758dd5 tempest-VolumesSnapshotsTestJSON-373053661 None] Created reservations ['879339b9-e70d-4e7f-8290-4c4aa89951e6', '4780dff7-41a2-47ef-a5b6-21be93fa2969', 'f35dad64-d4c8-4179-b80e-019d7cd20a8b', '305cea96-97c1-43dd-9032-27aa96c5aaf8'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:48:46 devstack sudo[92963]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0d9ca21c-6128-4fb4-8f01-cfd69fe75218 tempest-GroupSnapshotsTest-200721168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-34f2fadf-f4cb-44a8-a650-531e00f9c211,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-34f2fadf-f4cb-44a8-a650-531e00f9c211.456f2613-2203-45f4-bd9c-974efbbb1566 1G" returned: 0 in 0.486s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0d9ca21c-6128-4fb4-8f01-cfd69fe75218 tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34f2fadf-f4cb-44a8-a650-531e00f9c211 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-34f2fadf-f4cb-44a8-a650-531e00f9c211.456f2613-2203-45f4-bd9c-974efbbb1566 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:46 devstack sudo[92972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34f2fadf-f4cb-44a8-a650-531e00f9c211 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-34f2fadf-f4cb-44a8-a650-531e00f9c211.456f2613-2203-45f4-bd9c-974efbbb1566 Nov 06 17:48:46 devstack sudo[92972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:46 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-895acb8b-ff2e-4bed-933f-a4c42082f490 req-4fec8865-50c1-4e3e-8aa1-1f5882758dd5 tempest-VolumesSnapshotsTestJSON-373053661 None] Delete snapshot completed successfully. Nov 06 17:48:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-895acb8b-ff2e-4bed-933f-a4c42082f490 req-4fec8865-50c1-4e3e-8aa1-1f5882758dd5 tempest-VolumesSnapshotsTestJSON-373053661 None] Lock "cinder-2e468fa1-29f7-48c4-9efb-05c176602fd6-delete_snapshot" released by "delete_snapshot" :: held 1.899s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:48:47 devstack sudo[92972]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0d9ca21c-6128-4fb4-8f01-cfd69fe75218 tempest-GroupSnapshotsTest-200721168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34f2fadf-f4cb-44a8-a650-531e00f9c211 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-34f2fadf-f4cb-44a8-a650-531e00f9c211.456f2613-2203-45f4-bd9c-974efbbb1566" returned: 0 in 0.352s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:47 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-0d9ca21c-6128-4fb4-8f01-cfd69fe75218 tempest-GroupSnapshotsTest-200721168 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-34f2fadf-f4cb-44a8-a650-531e00f9c211.456f2613-2203-45f4-bd9c-974efbbb1566 is being set with open permissions: ugo+rw: NotImplementedError Nov 06 17:48:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0d9ca21c-6128-4fb4-8f01-cfd69fe75218 tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-34f2fadf-f4cb-44a8-a650-531e00f9c211.456f2613-2203-45f4-bd9c-974efbbb1566 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:47 devstack sudo[92977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-34f2fadf-f4cb-44a8-a650-531e00f9c211.456f2613-2203-45f4-bd9c-974efbbb1566 Nov 06 17:48:47 devstack sudo[92977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-8c137eba-fe52-44cb-9286-6afb8fdf2f0f req-cf319de2-a1da-42af-a6ac-a49423e7b8a8 tempest-VolumesSnapshotsTestJSON-373053661 None] Acquiring lock "cinder-759375f1-e3e5-4ad6-afdb-9f5477548675-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:48:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-8c137eba-fe52-44cb-9286-6afb8fdf2f0f req-cf319de2-a1da-42af-a6ac-a49423e7b8a8 tempest-VolumesSnapshotsTestJSON-373053661 None] Lock "cinder-759375f1-e3e5-4ad6-afdb-9f5477548675-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:48:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-8c137eba-fe52-44cb-9286-6afb8fdf2f0f req-cf319de2-a1da-42af-a6ac-a49423e7b8a8 tempest-VolumesSnapshotsTestJSON-373053661 None] Acquiring lock "cinder-quobyte-759375f1-e3e5-4ad6-afdb-9f5477548675" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:48:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-8c137eba-fe52-44cb-9286-6afb8fdf2f0f req-cf319de2-a1da-42af-a6ac-a49423e7b8a8 tempest-VolumesSnapshotsTestJSON-373053661 None] Lock "cinder-quobyte-759375f1-e3e5-4ad6-afdb-9f5477548675" acquired by "delete_volume" :: waited 0.027s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:48:47 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a1f2f7-4c33-40c9-9ea8-e6f4ccf26d79]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:48:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-8c137eba-fe52-44cb-9286-6afb8fdf2f0f req-cf319de2-a1da-42af-a6ac-a49423e7b8a8 tempest-VolumesSnapshotsTestJSON-373053661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-759375f1-e3e5-4ad6-afdb-9f5477548675 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:47 devstack sudo[92977]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0d9ca21c-6128-4fb4-8f01-cfd69fe75218 tempest-GroupSnapshotsTest-200721168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-34f2fadf-f4cb-44a8-a650-531e00f9c211.456f2613-2203-45f4-bd9c-974efbbb1566" returned: 0 in 0.328s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:47 devstack sudo[92979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-759375f1-e3e5-4ad6-afdb-9f5477548675 Nov 06 17:48:47 devstack sudo[92979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0d9ca21c-6128-4fb4-8f01-cfd69fe75218 tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-34f2fadf-f4cb-44a8-a650-531e00f9c211.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:47 devstack sudo[92987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-34f2fadf-f4cb-44a8-a650-531e00f9c211.info Nov 06 17:48:47 devstack sudo[92987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:47 devstack sudo[92979]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:47 devstack sudo[92987]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0d9ca21c-6128-4fb4-8f01-cfd69fe75218 tempest-GroupSnapshotsTest-200721168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-34f2fadf-f4cb-44a8-a650-531e00f9c211.info" returned: 0 in 0.291s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-8c137eba-fe52-44cb-9286-6afb8fdf2f0f req-cf319de2-a1da-42af-a6ac-a49423e7b8a8 tempest-VolumesSnapshotsTestJSON-373053661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-759375f1-e3e5-4ad6-afdb-9f5477548675" returned: 0 in 0.420s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:47 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-0d9ca21c-6128-4fb4-8f01-cfd69fe75218 tempest-GroupSnapshotsTest-200721168 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-34f2fadf-f4cb-44a8-a650-531e00f9c211.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 17:48:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0d9ca21c-6128-4fb4-8f01-cfd69fe75218 tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-34f2fadf-f4cb-44a8-a650-531e00f9c211.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-8c137eba-fe52-44cb-9286-6afb8fdf2f0f req-cf319de2-a1da-42af-a6ac-a49423e7b8a8 tempest-VolumesSnapshotsTestJSON-373053661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-759375f1-e3e5-4ad6-afdb-9f5477548675 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:47 devstack sudo[93017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-34f2fadf-f4cb-44a8-a650-531e00f9c211.info Nov 06 17:48:47 devstack sudo[93017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:47 devstack sudo[93018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-759375f1-e3e5-4ad6-afdb-9f5477548675 Nov 06 17:48:47 devstack sudo[93018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:48 devstack sudo[93017]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0d9ca21c-6128-4fb4-8f01-cfd69fe75218 tempest-GroupSnapshotsTest-200721168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-34f2fadf-f4cb-44a8-a650-531e00f9c211.info" returned: 0 in 0.283s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0d9ca21c-6128-4fb4-8f01-cfd69fe75218 tempest-GroupSnapshotsTest-200721168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.267s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:48:48 devstack sudo[93018]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-8c137eba-fe52-44cb-9286-6afb8fdf2f0f req-cf319de2-a1da-42af-a6ac-a49423e7b8a8 tempest-VolumesSnapshotsTestJSON-373053661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-759375f1-e3e5-4ad6-afdb-9f5477548675" returned: 0 in 0.365s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:48 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-8c137eba-fe52-44cb-9286-6afb8fdf2f0f req-cf319de2-a1da-42af-a6ac-a49423e7b8a8 tempest-VolumesSnapshotsTestJSON-373053661 None] Lock "cinder-quobyte-759375f1-e3e5-4ad6-afdb-9f5477548675" released by "delete_volume" :: held 0.888s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:48:48 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-0d9ca21c-6128-4fb4-8f01-cfd69fe75218 tempest-GroupSnapshotsTest-200721168 None] group_snapshot 368a0a55-7089-4323-9b93-d1fbb19f6bdf: created successfully Nov 06 17:48:48 devstack cinder-volume[87068]: DEBUG cinder.quota [req-8c137eba-fe52-44cb-9286-6afb8fdf2f0f req-cf319de2-a1da-42af-a6ac-a49423e7b8a8 tempest-VolumesSnapshotsTestJSON-373053661 None] Created reservations ['d68ed10d-2f4a-4ecf-977c-362600cae29c', 'ff83832a-aecf-43d4-b86b-9007c5e6b179', '0b521da6-dd4c-4235-b483-0f9daa800666', 'f1083ddc-dd3f-4667-9ad4-0a30d7dc9791'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:48:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-8c137eba-fe52-44cb-9286-6afb8fdf2f0f req-cf319de2-a1da-42af-a6ac-a49423e7b8a8 tempest-VolumesSnapshotsTestJSON-373053661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:48:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-8c137eba-fe52-44cb-9286-6afb8fdf2f0f req-cf319de2-a1da-42af-a6ac-a49423e7b8a8 tempest-VolumesSnapshotsTestJSON-373053661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:48:48 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [req-8c137eba-fe52-44cb-9286-6afb8fdf2f0f req-cf319de2-a1da-42af-a6ac-a49423e7b8a8 tempest-VolumesSnapshotsTestJSON-373053661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:48:48 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [req-8c137eba-fe52-44cb-9286-6afb8fdf2f0f req-cf319de2-a1da-42af-a6ac-a49423e7b8a8 tempest-VolumesSnapshotsTestJSON-373053661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:48:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-8c137eba-fe52-44cb-9286-6afb8fdf2f0f req-cf319de2-a1da-42af-a6ac-a49423e7b8a8 tempest-VolumesSnapshotsTestJSON-373053661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:48:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-8c137eba-fe52-44cb-9286-6afb8fdf2f0f req-cf319de2-a1da-42af-a6ac-a49423e7b8a8 tempest-VolumesSnapshotsTestJSON-373053661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:48 devstack sudo[93025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:48:48 devstack sudo[93025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:48 devstack sudo[93025]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-8c137eba-fe52-44cb-9286-6afb8fdf2f0f req-cf319de2-a1da-42af-a6ac-a49423e7b8a8 tempest-VolumesSnapshotsTestJSON-373053661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.355s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:48 devstack cinder-volume[87068]: DEBUG cinder.manager [req-8c137eba-fe52-44cb-9286-6afb8fdf2f0f req-cf319de2-a1da-42af-a6ac-a49423e7b8a8 tempest-VolumesSnapshotsTestJSON-373053661 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:48:48 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-8c137eba-fe52-44cb-9286-6afb8fdf2f0f req-cf319de2-a1da-42af-a6ac-a49423e7b8a8 tempest-VolumesSnapshotsTestJSON-373053661 None] Deleted volume successfully. Nov 06 17:48:48 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-8c137eba-fe52-44cb-9286-6afb8fdf2f0f req-cf319de2-a1da-42af-a6ac-a49423e7b8a8 tempest-VolumesSnapshotsTestJSON-373053661 None] Lock "cinder-759375f1-e3e5-4ad6-afdb-9f5477548675-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:48:49 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-001330b3-a752-4ec4-904d-53aba67a46e5 tempest-GroupSnapshotsTest-200721168 None] group_snapshot 368a0a55-7089-4323-9b93-d1fbb19f6bdf: deleting Nov 06 17:48:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-001330b3-a752-4ec4-904d-53aba67a46e5 tempest-GroupSnapshotsTest-200721168 None] group_snapshot 368a0a55-7089-4323-9b93-d1fbb19f6bdf: deleting {{(pid=87068) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 06 17:48:49 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-001330b3-a752-4ec4-904d-53aba67a46e5 tempest-GroupSnapshotsTest-200721168 None] Acquiring lock "cinder-quobyte-34f2fadf-f4cb-44a8-a650-531e00f9c211" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:48:49 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-001330b3-a752-4ec4-904d-53aba67a46e5 tempest-GroupSnapshotsTest-200721168 None] Lock "cinder-quobyte-34f2fadf-f4cb-44a8-a650-531e00f9c211" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:48:49 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-001330b3-a752-4ec4-904d-53aba67a46e5 tempest-GroupSnapshotsTest-200721168 None] Acquiring lock "cinder-quobyte-456f2613-2203-45f4-bd9c-974efbbb1566" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:48:49 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-001330b3-a752-4ec4-904d-53aba67a46e5 tempest-GroupSnapshotsTest-200721168 None] Lock "cinder-quobyte-456f2613-2203-45f4-bd9c-974efbbb1566" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:48:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-001330b3-a752-4ec4-904d-53aba67a46e5 tempest-GroupSnapshotsTest-200721168 None] Deleting offline snapshot 456f2613-2203-45f4-bd9c-974efbbb1566 of volume 34f2fadf-f4cb-44a8-a650-531e00f9c211 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 17:48:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-001330b3-a752-4ec4-904d-53aba67a46e5 tempest-GroupSnapshotsTest-200721168 None] snapshot_file for this snap is: volume-34f2fadf-f4cb-44a8-a650-531e00f9c211.456f2613-2203-45f4-bd9c-974efbbb1566 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 17:48:49 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5478eb73-1e5d-4234-96ad-5472f35e8c37]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:48:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-001330b3-a752-4ec4-904d-53aba67a46e5 tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-34f2fadf-f4cb-44a8-a650-531e00f9c211.456f2613-2203-45f4-bd9c-974efbbb1566 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:49 devstack sudo[93052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-34f2fadf-f4cb-44a8-a650-531e00f9c211.456f2613-2203-45f4-bd9c-974efbbb1566 Nov 06 17:48:49 devstack sudo[93052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:50 devstack sudo[93052]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-001330b3-a752-4ec4-904d-53aba67a46e5 tempest-GroupSnapshotsTest-200721168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-34f2fadf-f4cb-44a8-a650-531e00f9c211.456f2613-2203-45f4-bd9c-974efbbb1566" returned: 0 in 0.489s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:50 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-001330b3-a752-4ec4-904d-53aba67a46e5 tempest-GroupSnapshotsTest-200721168 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34f2fadf-f4cb-44a8-a650-531e00f9c211(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 17:48:50 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[276a73dc-b67c-4b8d-b927-f3723d367baa]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:48:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-001330b3-a752-4ec4-904d-53aba67a46e5 tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-34f2fadf-f4cb-44a8-a650-531e00f9c211 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:50 devstack sudo[93061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-34f2fadf-f4cb-44a8-a650-531e00f9c211 Nov 06 17:48:50 devstack sudo[93061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:50 devstack sudo[93061]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-001330b3-a752-4ec4-904d-53aba67a46e5 tempest-GroupSnapshotsTest-200721168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-34f2fadf-f4cb-44a8-a650-531e00f9c211" returned: 0 in 0.566s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-001330b3-a752-4ec4-904d-53aba67a46e5 tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-34f2fadf-f4cb-44a8-a650-531e00f9c211.456f2613-2203-45f4-bd9c-974efbbb1566 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:50 devstack sudo[93069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-34f2fadf-f4cb-44a8-a650-531e00f9c211.456f2613-2203-45f4-bd9c-974efbbb1566 Nov 06 17:48:50 devstack sudo[93069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:51 devstack sudo[93069]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-001330b3-a752-4ec4-904d-53aba67a46e5 tempest-GroupSnapshotsTest-200721168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-34f2fadf-f4cb-44a8-a650-531e00f9c211.456f2613-2203-45f4-bd9c-974efbbb1566" returned: 0 in 0.416s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-001330b3-a752-4ec4-904d-53aba67a46e5 tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-34f2fadf-f4cb-44a8-a650-531e00f9c211.456f2613-2203-45f4-bd9c-974efbbb1566 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:51 devstack sudo[93083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-34f2fadf-f4cb-44a8-a650-531e00f9c211.456f2613-2203-45f4-bd9c-974efbbb1566 Nov 06 17:48:51 devstack sudo[93083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:51 devstack sudo[93083]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-001330b3-a752-4ec4-904d-53aba67a46e5 tempest-GroupSnapshotsTest-200721168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-34f2fadf-f4cb-44a8-a650-531e00f9c211.456f2613-2203-45f4-bd9c-974efbbb1566" returned: 0 in 0.317s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:51 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-001330b3-a752-4ec4-904d-53aba67a46e5 tempest-GroupSnapshotsTest-200721168 None] Lock "cinder-quobyte-456f2613-2203-45f4-bd9c-974efbbb1566" released by "_delete_snapshot" :: held 2.007s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:48:51 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-001330b3-a752-4ec4-904d-53aba67a46e5 tempest-GroupSnapshotsTest-200721168 None] Lock "cinder-quobyte-34f2fadf-f4cb-44a8-a650-531e00f9c211" released by "delete_snapshot" :: held 2.047s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:48:51 devstack cinder-volume[87068]: WARNING cinder.quota [None req-001330b3-a752-4ec4-904d-53aba67a46e5 tempest-GroupSnapshotsTest-200721168 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1800599551 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1800599551, it is now deprecated. Please use the default quota class for default quota. Nov 06 17:48:51 devstack cinder-volume[87068]: WARNING cinder.quota [None req-001330b3-a752-4ec4-904d-53aba67a46e5 tempest-GroupSnapshotsTest-200721168 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1800599551 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1800599551, it is now deprecated. Please use the default quota class for default quota. Nov 06 17:48:51 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-001330b3-a752-4ec4-904d-53aba67a46e5 tempest-GroupSnapshotsTest-200721168 None] Created reservations ['5f50b278-f19d-4e87-814d-054ede573db4', 'c0a81b77-fbf4-492f-95a2-4c447b750557', 'a63f3399-1014-44a1-80d1-e77cd354eedb', '7d118b1b-a2c7-4a76-8a3e-c5732b5bdcd9'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:48:51 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-001330b3-a752-4ec4-904d-53aba67a46e5 tempest-GroupSnapshotsTest-200721168 None] group_snapshot 368a0a55-7089-4323-9b93-d1fbb19f6bdf: deleted successfully Nov 06 17:48:53 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6fe67bb5-3480-4abd-92c6-a8568775af8a tempest-GroupSnapshotsTest-200721168 None] Acquiring lock "cinder-quobyte-34f2fadf-f4cb-44a8-a650-531e00f9c211" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:48:53 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6fe67bb5-3480-4abd-92c6-a8568775af8a tempest-GroupSnapshotsTest-200721168 None] Lock "cinder-quobyte-34f2fadf-f4cb-44a8-a650-531e00f9c211" acquired by "delete_volume" :: waited 0.039s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:48:53 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5109edba-6686-421d-b0ee-a9b20eddc7d9]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:48:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6fe67bb5-3480-4abd-92c6-a8568775af8a tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-34f2fadf-f4cb-44a8-a650-531e00f9c211 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:53 devstack sudo[93108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-34f2fadf-f4cb-44a8-a650-531e00f9c211 Nov 06 17:48:53 devstack sudo[93108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:53 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-6047c3b8-6751-40f3-be82-e67892e4a38a req-5f31cc0b-e5f1-469b-b0c4-5eae163f3908 tempest-AttachVolumeNegativeTest-577825985 None] Terminate volume connection completed successfully. Nov 06 17:48:53 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-6047c3b8-6751-40f3-be82-e67892e4a38a req-5f31cc0b-e5f1-469b-b0c4-5eae163f3908 tempest-AttachVolumeNegativeTest-577825985 None] Deleting attachment b57ad4f4-9a67-47d2-861e-5cef1e2bb460. {{(pid=87068) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 17:48:53 devstack sudo[93108]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6fe67bb5-3480-4abd-92c6-a8568775af8a tempest-GroupSnapshotsTest-200721168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-34f2fadf-f4cb-44a8-a650-531e00f9c211" returned: 0 in 0.432s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6fe67bb5-3480-4abd-92c6-a8568775af8a tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-34f2fadf-f4cb-44a8-a650-531e00f9c211 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:53 devstack sudo[93115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-34f2fadf-f4cb-44a8-a650-531e00f9c211 Nov 06 17:48:53 devstack sudo[93115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:54 devstack sudo[93115]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6fe67bb5-3480-4abd-92c6-a8568775af8a tempest-GroupSnapshotsTest-200721168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-34f2fadf-f4cb-44a8-a650-531e00f9c211" returned: 0 in 0.286s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:54 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6fe67bb5-3480-4abd-92c6-a8568775af8a tempest-GroupSnapshotsTest-200721168 None] Lock "cinder-quobyte-34f2fadf-f4cb-44a8-a650-531e00f9c211" released by "delete_volume" :: held 0.815s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:48:54 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-6fe67bb5-3480-4abd-92c6-a8568775af8a tempest-GroupSnapshotsTest-200721168 None] Created reservations ['c0355bcd-8448-42de-8e34-76c972190e60'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:48:54 devstack cinder-volume[87068]: WARNING cinder.quota [None req-6fe67bb5-3480-4abd-92c6-a8568775af8a tempest-GroupSnapshotsTest-200721168 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1800599551 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1800599551, it is now deprecated. Please use the default quota class for default quota. Nov 06 17:48:54 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-6fe67bb5-3480-4abd-92c6-a8568775af8a tempest-GroupSnapshotsTest-200721168 None] Created reservations ['c78fbdea-d816-4866-afb2-99d548567c0a', '1039d457-72cf-4139-bcb2-7b878b5756b8', 'c961404b-287e-4c1c-8fca-8fb95cc204d2', '69e1d02a-d704-428a-8d42-7e3c164664af'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:48:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6fe67bb5-3480-4abd-92c6-a8568775af8a tempest-GroupSnapshotsTest-200721168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:48:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6fe67bb5-3480-4abd-92c6-a8568775af8a tempest-GroupSnapshotsTest-200721168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:48:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-6fe67bb5-3480-4abd-92c6-a8568775af8a tempest-GroupSnapshotsTest-200721168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:48:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-6fe67bb5-3480-4abd-92c6-a8568775af8a tempest-GroupSnapshotsTest-200721168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:48:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6fe67bb5-3480-4abd-92c6-a8568775af8a tempest-GroupSnapshotsTest-200721168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:48:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6fe67bb5-3480-4abd-92c6-a8568775af8a tempest-GroupSnapshotsTest-200721168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:54 devstack sudo[93118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:48:54 devstack sudo[93118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:54 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 17:48:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:48:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:48:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:48:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:48:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:48:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:54 devstack sudo[93120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:48:54 devstack sudo[93120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:54 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-8de983bc-8f61-434c-8132-23e512522b1b tempest-GroupSnapshotsV319Test-1657968361 None] Group tempest-GroupSnapshotsV319Test-Group-1590762145: creating Nov 06 17:48:54 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-8de983bc-8f61-434c-8132-23e512522b1b tempest-GroupSnapshotsV319Test-1657968361 None] Group tempest-GroupSnapshotsV319Test-Group-1590762145: created successfully Nov 06 17:48:54 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-8de983bc-8f61-434c-8132-23e512522b1b tempest-GroupSnapshotsV319Test-1657968361 None] Create group completed successfully. Nov 06 17:48:54 devstack sudo[93118]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6fe67bb5-3480-4abd-92c6-a8568775af8a tempest-GroupSnapshotsTest-200721168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.437s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:54 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-6fe67bb5-3480-4abd-92c6-a8568775af8a tempest-GroupSnapshotsTest-200721168 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:48:54 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-6fe67bb5-3480-4abd-92c6-a8568775af8a tempest-GroupSnapshotsTest-200721168 None] Delete group completed successfully. Nov 06 17:48:54 devstack sudo[93120]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.451s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:54 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:48:54 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running periodic task VolumeManager._thread_info {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 17:48:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] thread count: 8 {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 17:48:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] thread info: [<_MainThread(MainThread, started 133940619505792)>, , , , , , , ] {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 17:48:56 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9c807b6-2db2-4f55-897c-98106f3c26fb tempest-GroupSnapshotsV319Test-1657968361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:48:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b9c807b6-2db2-4f55-897c-98106f3c26fb tempest-GroupSnapshotsV319Test-1657968361 None] Flow 'volume_create_manager' (e5e854c6-813e-46c8-af3b-9021aa644cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:48:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b9c807b6-2db2-4f55-897c-98106f3c26fb tempest-GroupSnapshotsV319Test-1657968361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01725893-81fd-4b55-a029-f5d4fe074e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:48:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b9c807b6-2db2-4f55-897c-98106f3c26fb tempest-GroupSnapshotsV319Test-1657968361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01725893-81fd-4b55-a029-f5d4fe074e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:48:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-705435460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3e6fe419-7d83-4c24-8402-19efecc0f082,host='devstack@QuobyteHD#QuobyteHD',id=7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07199872130441888063052e2870c1b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:48:57Z,use_quota=True,user_id='4e865194b0a84c2dbc22dd07396796d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c1764e7-ca65-4b20-b97e-ce264cbeabb7),volume_type_id=3c1764e7-ca65-4b20-b97e-ce264cbeabb7)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:48:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b9c807b6-2db2-4f55-897c-98106f3c26fb tempest-GroupSnapshotsV319Test-1657968361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (931a157f-934f-4c75-8551-10f2603a2d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:48:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b9c807b6-2db2-4f55-897c-98106f3c26fb tempest-GroupSnapshotsV319Test-1657968361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (931a157f-934f-4c75-8551-10f2603a2d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:48:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b9c807b6-2db2-4f55-897c-98106f3c26fb tempest-GroupSnapshotsV319Test-1657968361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9e62e5b-4e67-4dfe-b7c0-c22f3871dd02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:48:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b9c807b6-2db2-4f55-897c-98106f3c26fb tempest-GroupSnapshotsV319Test-1657968361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9e62e5b-4e67-4dfe-b7c0-c22f3871dd02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9', 'volume_name': 'volume-7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:48:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b9c807b6-2db2-4f55-897c-98106f3c26fb tempest-GroupSnapshotsV319Test-1657968361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e45d86c1-a105-41d8-91ee-a7a4568e02f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:48:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b9c807b6-2db2-4f55-897c-98106f3c26fb tempest-GroupSnapshotsV319Test-1657968361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e45d86c1-a105-41d8-91ee-a7a4568e02f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:48:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b9c807b6-2db2-4f55-897c-98106f3c26fb tempest-GroupSnapshotsV319Test-1657968361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13679a30-4032-4a51-8bfc-bd6769066b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:48:56 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-b9c807b6-2db2-4f55-897c-98106f3c26fb tempest-GroupSnapshotsV319Test-1657968361 None] Volume 7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9', 'volume_size': 1} Nov 06 17:48:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b9c807b6-2db2-4f55-897c-98106f3c26fb tempest-GroupSnapshotsV319Test-1657968361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:48:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b9c807b6-2db2-4f55-897c-98106f3c26fb tempest-GroupSnapshotsV319Test-1657968361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:48:56 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b9c807b6-2db2-4f55-897c-98106f3c26fb tempest-GroupSnapshotsV319Test-1657968361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3e6fe419-7d83-4c24-8402-19efecc0f082,created_at=2026-11-06T16:48:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-705435460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3e6fe419-7d83-4c24-8402-19efecc0f082,host='devstack@QuobyteHD#QuobyteHD',id=7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07199872130441888063052e2870c1b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:48:57Z,use_quota=True,user_id='4e865194b0a84c2dbc22dd07396796d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c1764e7-ca65-4b20-b97e-ce264cbeabb7),volume_type_id=3c1764e7-ca65-4b20-b97e-ce264cbeabb7)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:48:56 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-b9c807b6-2db2-4f55-897c-98106f3c26fb tempest-GroupSnapshotsV319Test-1657968361 None] Creating volume 7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:48:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b9c807b6-2db2-4f55-897c-98106f3c26fb tempest-GroupSnapshotsV319Test-1657968361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:48:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b9c807b6-2db2-4f55-897c-98106f3c26fb tempest-GroupSnapshotsV319Test-1657968361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:48:56 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b9c807b6-2db2-4f55-897c-98106f3c26fb tempest-GroupSnapshotsV319Test-1657968361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:48:56 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b9c807b6-2db2-4f55-897c-98106f3c26fb tempest-GroupSnapshotsV319Test-1657968361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:48:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b9c807b6-2db2-4f55-897c-98106f3c26fb tempest-GroupSnapshotsV319Test-1657968361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:48:56 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b9c807b6-2db2-4f55-897c-98106f3c26fb tempest-GroupSnapshotsV319Test-1657968361 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:48:56 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-b9c807b6-2db2-4f55-897c-98106f3c26fb tempest-GroupSnapshotsV319Test-1657968361 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:48:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b9c807b6-2db2-4f55-897c-98106f3c26fb tempest-GroupSnapshotsV319Test-1657968361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:56 devstack sudo[93148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9 1073741824 Nov 06 17:48:56 devstack sudo[93148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:57 devstack sudo[93148]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b9c807b6-2db2-4f55-897c-98106f3c26fb tempest-GroupSnapshotsV319Test-1657968361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9 1073741824" returned: 0 in 0.545s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b9c807b6-2db2-4f55-897c-98106f3c26fb tempest-GroupSnapshotsV319Test-1657968361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:57 devstack sudo[93154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9 Nov 06 17:48:57 devstack sudo[93154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:48:57 devstack sudo[93154]: pam_unix(sudo:session): session closed for user root Nov 06 17:48:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b9c807b6-2db2-4f55-897c-98106f3c26fb tempest-GroupSnapshotsV319Test-1657968361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9" returned: 0 in 0.513s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:48:57 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b9c807b6-2db2-4f55-897c-98106f3c26fb tempest-GroupSnapshotsV319Test-1657968361 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:48:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b9c807b6-2db2-4f55-897c-98106f3c26fb tempest-GroupSnapshotsV319Test-1657968361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:48:57 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b9c807b6-2db2-4f55-897c-98106f3c26fb tempest-GroupSnapshotsV319Test-1657968361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13679a30-4032-4a51-8bfc-bd6769066b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:48:57 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b9c807b6-2db2-4f55-897c-98106f3c26fb tempest-GroupSnapshotsV319Test-1657968361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f2aa138-334c-4dee-a7ae-3d67dbbcaa2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:48:57 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-b9c807b6-2db2-4f55-897c-98106f3c26fb tempest-GroupSnapshotsV319Test-1657968361 None] Volume volume-7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9 (7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9): created successfully Nov 06 17:48:57 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b9c807b6-2db2-4f55-897c-98106f3c26fb tempest-GroupSnapshotsV319Test-1657968361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f2aa138-334c-4dee-a7ae-3d67dbbcaa2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:48:57 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b9c807b6-2db2-4f55-897c-98106f3c26fb tempest-GroupSnapshotsV319Test-1657968361 None] Flow 'volume_create_manager' (e5e854c6-813e-46c8-af3b-9021aa644cd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:48:58 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-b9c807b6-2db2-4f55-897c-98106f3c26fb tempest-GroupSnapshotsV319Test-1657968361 None] Created volume successfully. Nov 06 17:48:59 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-78fcdf40-e045-4467-bb40-5daba1dbe41e tempest-GroupSnapshotsV319Test-1657968361 None] GroupSnapshot de3c3b84-f612-4c44-8cd2-f9100ca052d5: creating. Nov 06 17:48:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-78fcdf40-e045-4467-bb40-5daba1dbe41e tempest-GroupSnapshotsV319Test-1657968361 None] Group snapshot de3c3b84-f612-4c44-8cd2-f9100ca052d5: creating. {{(pid=87068) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 06 17:48:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-78fcdf40-e045-4467-bb40-5daba1dbe41e tempest-GroupSnapshotsV319Test-1657968361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:48:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-78fcdf40-e045-4467-bb40-5daba1dbe41e tempest-GroupSnapshotsV319Test-1657968361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:48:59 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-78fcdf40-e045-4467-bb40-5daba1dbe41e tempest-GroupSnapshotsV319Test-1657968361 None] Creating offline snapshot d06672b2-ebb5-400b-8448-adbe6af9218e of volume 7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9 {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 17:48:59 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db32d76-3bf3-4026-b27b-7168fdfe7ac5]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:48:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-78fcdf40-e045-4467-bb40-5daba1dbe41e tempest-GroupSnapshotsV319Test-1657968361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:48:59 devstack sudo[93162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9 Nov 06 17:48:59 devstack sudo[93162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:49:00 devstack sudo[93162]: pam_unix(sudo:session): session closed for user root Nov 06 17:49:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-78fcdf40-e045-4467-bb40-5daba1dbe41e tempest-GroupSnapshotsV319Test-1657968361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9" returned: 0 in 0.467s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:49:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-78fcdf40-e045-4467-bb40-5daba1dbe41e tempest-GroupSnapshotsV319Test-1657968361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9.d06672b2-ebb5-400b-8448-adbe6af9218e 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:49:00 devstack sudo[93169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9.d06672b2-ebb5-400b-8448-adbe6af9218e 1G Nov 06 17:49:00 devstack sudo[93169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:49:00 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-46404e00-307f-400b-b4f5-a28b46a8bcf8 req-d8946e10-938d-4507-9723-f3e141c8ed81 tempest-ServerActionsTestOtherA-1480259007 None] Terminate volume connection completed successfully. Nov 06 17:49:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-46404e00-307f-400b-b4f5-a28b46a8bcf8 req-d8946e10-938d-4507-9723-f3e141c8ed81 tempest-ServerActionsTestOtherA-1480259007 None] Deleting attachment ea0fa0a4-62fc-4eb0-96c6-97ff9a28b4e6. {{(pid=87068) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 17:49:00 devstack sudo[93169]: pam_unix(sudo:session): session closed for user root Nov 06 17:49:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-78fcdf40-e045-4467-bb40-5daba1dbe41e tempest-GroupSnapshotsV319Test-1657968361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9.d06672b2-ebb5-400b-8448-adbe6af9218e 1G" returned: 0 in 0.630s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:49:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-78fcdf40-e045-4467-bb40-5daba1dbe41e tempest-GroupSnapshotsV319Test-1657968361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9.d06672b2-ebb5-400b-8448-adbe6af9218e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:49:00 devstack sudo[93178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9.d06672b2-ebb5-400b-8448-adbe6af9218e Nov 06 17:49:00 devstack sudo[93178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:49:01 devstack sudo[93178]: pam_unix(sudo:session): session closed for user root Nov 06 17:49:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-78fcdf40-e045-4467-bb40-5daba1dbe41e tempest-GroupSnapshotsV319Test-1657968361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9.d06672b2-ebb5-400b-8448-adbe6af9218e" returned: 0 in 0.384s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:49:01 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-78fcdf40-e045-4467-bb40-5daba1dbe41e tempest-GroupSnapshotsV319Test-1657968361 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9.d06672b2-ebb5-400b-8448-adbe6af9218e is being set with open permissions: ugo+rw: NotImplementedError Nov 06 17:49:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-78fcdf40-e045-4467-bb40-5daba1dbe41e tempest-GroupSnapshotsV319Test-1657968361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9.d06672b2-ebb5-400b-8448-adbe6af9218e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:49:01 devstack sudo[93184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9.d06672b2-ebb5-400b-8448-adbe6af9218e Nov 06 17:49:01 devstack sudo[93184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:49:01 devstack sudo[93184]: pam_unix(sudo:session): session closed for user root Nov 06 17:49:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-78fcdf40-e045-4467-bb40-5daba1dbe41e tempest-GroupSnapshotsV319Test-1657968361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9.d06672b2-ebb5-400b-8448-adbe6af9218e" returned: 0 in 0.341s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:49:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-78fcdf40-e045-4467-bb40-5daba1dbe41e tempest-GroupSnapshotsV319Test-1657968361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:49:01 devstack sudo[93187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9.info Nov 06 17:49:01 devstack sudo[93187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:49:02 devstack sudo[93187]: pam_unix(sudo:session): session closed for user root Nov 06 17:49:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-78fcdf40-e045-4467-bb40-5daba1dbe41e tempest-GroupSnapshotsV319Test-1657968361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9.info" returned: 0 in 0.360s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:49:02 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-78fcdf40-e045-4467-bb40-5daba1dbe41e tempest-GroupSnapshotsV319Test-1657968361 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 17:49:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-78fcdf40-e045-4467-bb40-5daba1dbe41e tempest-GroupSnapshotsV319Test-1657968361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:49:02 devstack sudo[93191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9.info Nov 06 17:49:02 devstack sudo[93191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:49:02 devstack sudo[93191]: pam_unix(sudo:session): session closed for user root Nov 06 17:49:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-78fcdf40-e045-4467-bb40-5daba1dbe41e tempest-GroupSnapshotsV319Test-1657968361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9.info" returned: 0 in 0.335s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:49:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-78fcdf40-e045-4467-bb40-5daba1dbe41e tempest-GroupSnapshotsV319Test-1657968361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.677s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:49:02 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-78fcdf40-e045-4467-bb40-5daba1dbe41e tempest-GroupSnapshotsV319Test-1657968361 None] group_snapshot de3c3b84-f612-4c44-8cd2-f9100ca052d5: created successfully Nov 06 17:49:03 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-105be184-8724-41d1-89c6-3949df1cfb58 tempest-GroupSnapshotsV319Test-1657968361 None] group_snapshot de3c3b84-f612-4c44-8cd2-f9100ca052d5: deleting Nov 06 17:49:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-105be184-8724-41d1-89c6-3949df1cfb58 tempest-GroupSnapshotsV319Test-1657968361 None] group_snapshot de3c3b84-f612-4c44-8cd2-f9100ca052d5: deleting {{(pid=87068) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 06 17:49:03 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-105be184-8724-41d1-89c6-3949df1cfb58 tempest-GroupSnapshotsV319Test-1657968361 None] Acquiring lock "cinder-quobyte-7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:49:03 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-105be184-8724-41d1-89c6-3949df1cfb58 tempest-GroupSnapshotsV319Test-1657968361 None] Lock "cinder-quobyte-7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:49:03 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-105be184-8724-41d1-89c6-3949df1cfb58 tempest-GroupSnapshotsV319Test-1657968361 None] Acquiring lock "cinder-quobyte-d06672b2-ebb5-400b-8448-adbe6af9218e" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:49:03 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-105be184-8724-41d1-89c6-3949df1cfb58 tempest-GroupSnapshotsV319Test-1657968361 None] Lock "cinder-quobyte-d06672b2-ebb5-400b-8448-adbe6af9218e" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:49:03 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-105be184-8724-41d1-89c6-3949df1cfb58 tempest-GroupSnapshotsV319Test-1657968361 None] Deleting offline snapshot d06672b2-ebb5-400b-8448-adbe6af9218e of volume 7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 17:49:03 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-105be184-8724-41d1-89c6-3949df1cfb58 tempest-GroupSnapshotsV319Test-1657968361 None] snapshot_file for this snap is: volume-7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9.d06672b2-ebb5-400b-8448-adbe6af9218e {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 17:49:04 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9bd679-8f08-4365-b589-a22df92442b0]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:49:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-105be184-8724-41d1-89c6-3949df1cfb58 tempest-GroupSnapshotsV319Test-1657968361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9.d06672b2-ebb5-400b-8448-adbe6af9218e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:49:04 devstack sudo[93219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9.d06672b2-ebb5-400b-8448-adbe6af9218e Nov 06 17:49:04 devstack sudo[93219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:49:04 devstack sudo[93219]: pam_unix(sudo:session): session closed for user root Nov 06 17:49:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-105be184-8724-41d1-89c6-3949df1cfb58 tempest-GroupSnapshotsV319Test-1657968361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9.d06672b2-ebb5-400b-8448-adbe6af9218e" returned: 0 in 0.503s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:49:04 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-105be184-8724-41d1-89c6-3949df1cfb58 tempest-GroupSnapshotsV319Test-1657968361 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 17:49:04 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9fbb762-8c9a-4358-9ce8-c7f444f377f5]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:49:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-105be184-8724-41d1-89c6-3949df1cfb58 tempest-GroupSnapshotsV319Test-1657968361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:49:04 devstack sudo[93228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9 Nov 06 17:49:04 devstack sudo[93228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:49:05 devstack sudo[93228]: pam_unix(sudo:session): session closed for user root Nov 06 17:49:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-105be184-8724-41d1-89c6-3949df1cfb58 tempest-GroupSnapshotsV319Test-1657968361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9" returned: 0 in 0.561s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:49:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-105be184-8724-41d1-89c6-3949df1cfb58 tempest-GroupSnapshotsV319Test-1657968361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9.d06672b2-ebb5-400b-8448-adbe6af9218e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:49:05 devstack sudo[93234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9.d06672b2-ebb5-400b-8448-adbe6af9218e Nov 06 17:49:05 devstack sudo[93234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:49:05 devstack sudo[93234]: pam_unix(sudo:session): session closed for user root Nov 06 17:49:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-105be184-8724-41d1-89c6-3949df1cfb58 tempest-GroupSnapshotsV319Test-1657968361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9.d06672b2-ebb5-400b-8448-adbe6af9218e" returned: 0 in 0.407s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:49:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-105be184-8724-41d1-89c6-3949df1cfb58 tempest-GroupSnapshotsV319Test-1657968361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9.d06672b2-ebb5-400b-8448-adbe6af9218e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:49:05 devstack sudo[93241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9.d06672b2-ebb5-400b-8448-adbe6af9218e Nov 06 17:49:05 devstack sudo[93241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:49:05 devstack sudo[93241]: pam_unix(sudo:session): session closed for user root Nov 06 17:49:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-105be184-8724-41d1-89c6-3949df1cfb58 tempest-GroupSnapshotsV319Test-1657968361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9.d06672b2-ebb5-400b-8448-adbe6af9218e" returned: 0 in 0.346s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:49:05 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-105be184-8724-41d1-89c6-3949df1cfb58 tempest-GroupSnapshotsV319Test-1657968361 None] Lock "cinder-quobyte-d06672b2-ebb5-400b-8448-adbe6af9218e" released by "_delete_snapshot" :: held 2.028s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:49:06 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-105be184-8724-41d1-89c6-3949df1cfb58 tempest-GroupSnapshotsV319Test-1657968361 None] Lock "cinder-quobyte-7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9" released by "delete_snapshot" :: held 2.075s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:49:06 devstack cinder-volume[87068]: WARNING cinder.quota [None req-105be184-8724-41d1-89c6-3949df1cfb58 tempest-GroupSnapshotsV319Test-1657968361 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2017197815 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2017197815, it is now deprecated. Please use the default quota class for default quota. Nov 06 17:49:06 devstack cinder-volume[87068]: WARNING cinder.quota [None req-105be184-8724-41d1-89c6-3949df1cfb58 tempest-GroupSnapshotsV319Test-1657968361 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-2017197815 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-2017197815, it is now deprecated. Please use the default quota class for default quota. Nov 06 17:49:06 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-105be184-8724-41d1-89c6-3949df1cfb58 tempest-GroupSnapshotsV319Test-1657968361 None] Created reservations ['585a5656-fef5-4c8d-b3aa-60fbb24ecffa', '3140920a-1942-4a13-9414-ec672336839f', '1dd303f5-0110-462f-9595-fa61dddc5172', 'd862158e-23a8-4e01-bfbd-6601a5b0e411'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:49:06 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-105be184-8724-41d1-89c6-3949df1cfb58 tempest-GroupSnapshotsV319Test-1657968361 None] group_snapshot de3c3b84-f612-4c44-8cd2-f9100ca052d5: deleted successfully Nov 06 17:49:07 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f89ea498-b446-42f6-a7a6-1ba150ea949d tempest-GroupSnapshotsV319Test-1657968361 None] Acquiring lock "cinder-quobyte-7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:49:07 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f89ea498-b446-42f6-a7a6-1ba150ea949d tempest-GroupSnapshotsV319Test-1657968361 None] Lock "cinder-quobyte-7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9" acquired by "delete_volume" :: waited 0.023s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:49:07 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57cf5d5-5568-48b9-92a1-8de805fdb6b5]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:49:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f89ea498-b446-42f6-a7a6-1ba150ea949d tempest-GroupSnapshotsV319Test-1657968361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:49:08 devstack sudo[93259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9 Nov 06 17:49:08 devstack sudo[93259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:49:08 devstack sudo[93259]: pam_unix(sudo:session): session closed for user root Nov 06 17:49:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f89ea498-b446-42f6-a7a6-1ba150ea949d tempest-GroupSnapshotsV319Test-1657968361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9" returned: 0 in 0.445s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:49:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f89ea498-b446-42f6-a7a6-1ba150ea949d tempest-GroupSnapshotsV319Test-1657968361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:49:08 devstack sudo[93264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9 Nov 06 17:49:08 devstack sudo[93264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:49:08 devstack sudo[93264]: pam_unix(sudo:session): session closed for user root Nov 06 17:49:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f89ea498-b446-42f6-a7a6-1ba150ea949d tempest-GroupSnapshotsV319Test-1657968361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9" returned: 0 in 0.345s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:49:08 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f89ea498-b446-42f6-a7a6-1ba150ea949d tempest-GroupSnapshotsV319Test-1657968361 None] Lock "cinder-quobyte-7692d1f5-e4d1-47f8-8d2a-28a19bbb16b9" released by "delete_volume" :: held 0.898s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:49:08 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-f89ea498-b446-42f6-a7a6-1ba150ea949d tempest-GroupSnapshotsV319Test-1657968361 None] Created reservations ['c6c43a66-3f26-4ab8-bf48-042fdb8da89c'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:49:08 devstack cinder-volume[87068]: WARNING cinder.quota [None req-f89ea498-b446-42f6-a7a6-1ba150ea949d tempest-GroupSnapshotsV319Test-1657968361 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-2017197815 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-2017197815, it is now deprecated. Please use the default quota class for default quota. Nov 06 17:49:08 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-f89ea498-b446-42f6-a7a6-1ba150ea949d tempest-GroupSnapshotsV319Test-1657968361 None] Created reservations ['2f6c3eef-aa9e-4388-9fd4-27c585ab0795', '23043db1-bc65-421b-9005-c343dd39c551', '61cddaac-27bb-4806-95bc-a4838e2562e2', 'af6c53ab-810a-4c4b-84a3-bbf59702ff43'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:49:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f89ea498-b446-42f6-a7a6-1ba150ea949d tempest-GroupSnapshotsV319Test-1657968361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:49:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f89ea498-b446-42f6-a7a6-1ba150ea949d tempest-GroupSnapshotsV319Test-1657968361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:49:09 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f89ea498-b446-42f6-a7a6-1ba150ea949d tempest-GroupSnapshotsV319Test-1657968361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:49:09 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f89ea498-b446-42f6-a7a6-1ba150ea949d tempest-GroupSnapshotsV319Test-1657968361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:49:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f89ea498-b446-42f6-a7a6-1ba150ea949d tempest-GroupSnapshotsV319Test-1657968361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:49:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f89ea498-b446-42f6-a7a6-1ba150ea949d tempest-GroupSnapshotsV319Test-1657968361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:49:09 devstack sudo[93268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:49:09 devstack sudo[93268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:49:09 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:49:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] Flow 'volume_create_manager' (1afae992-93f2-4a52-b23f-49f11bb23fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:49:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dffb123-1914-4ec8-9717-912de40d2843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:49:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dffb123-1914-4ec8-9717-912de40d2843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:49:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-900669038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d1939d4-3ffe-40ee-9bf8-49c5d298eb18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0c73c13fe8543f19021e9a4d51ecd4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:49:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:49:09Z,use_quota=True,user_id='6321867b95d34ba6b8f5d17ccfe205f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:49:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55c8411c-2557-4416-887c-60d70882ea55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:49:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55c8411c-2557-4416-887c-60d70882ea55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:49:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bce22bb3-be65-40f0-9b34-822290358d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:49:09 devstack cinder-volume[87068]: DEBUG cinder.image.glance [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] Creating Keystone auth plugin from conf {{(pid=87068) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 17:49:09 devstack sudo[93268]: pam_unix(sudo:session): session closed for user root Nov 06 17:49:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f89ea498-b446-42f6-a7a6-1ba150ea949d tempest-GroupSnapshotsV319Test-1657968361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.589s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:49:09 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-f89ea498-b446-42f6-a7a6-1ba150ea949d tempest-GroupSnapshotsV319Test-1657968361 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:49:09 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-f89ea498-b446-42f6-a7a6-1ba150ea949d tempest-GroupSnapshotsV319Test-1657968361 None] Delete group completed successfully. Nov 06 17:49:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bce22bb3-be65-40f0-9b34-822290358d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6d1939d4-3ffe-40ee-9bf8-49c5d298eb18', 'volume_name': 'volume-6d1939d4-3ffe-40ee-9bf8-49c5d298eb18', 'volume_size': 1, 'image_id': '514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '344c8ba807084eedb5afd931913d7a80', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'created_at': datetime.datetime(2026, 11, 6, 16, 39, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 16, 39, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/514846ea-e0c6-4037-8ba4-bcd35ce3fba9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:49:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (212948a8-9c42-4388-b5d7-c95f86bc5c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:49:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (212948a8-9c42-4388-b5d7-c95f86bc5c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:49:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93fbda7e-d159-4beb-b9f2-4da21d1753d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:49:10 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] Volume 6d1939d4-3ffe-40ee-9bf8-49c5d298eb18: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6d1939d4-3ffe-40ee-9bf8-49c5d298eb18', 'volume_size': 1, 'image_id': '514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '344c8ba807084eedb5afd931913d7a80', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'created_at': datetime.datetime(2026, 11, 6, 16, 39, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 16, 39, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/514846ea-e0c6-4037-8ba4-bcd35ce3fba9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 17:49:10 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] Trying to clone 6d1939d4-3ffe-40ee-9bf8-49c5d298eb18 from image 514846ea-e0c6-4037-8ba4-bcd35ce3fba9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'metadata': {}}]). {{(pid=87068) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 17:49:11 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_5ee8oc2ldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87068) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 06 17:49:11 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] Image download 20.69 MB at 20.69 MB/s Nov 06 17:49:11 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3efeb35-6c73-4061-9cbc-0d691cdcee89]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:49:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_5ee8oc2ldevstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:49:11 devstack sudo[93362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_5ee8oc2ldevstack@QuobyteHD Nov 06 17:49:11 devstack sudo[93362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:49:12 devstack sudo[93362]: pam_unix(sudo:session): session closed for user root Nov 06 17:49:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_5ee8oc2ldevstack@QuobyteHD" returned: 0 in 0.588s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:49:12 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] Temporary image 514846ea-e0c6-4037-8ba4-bcd35ce3fba9 is fetched for user 6321867b95d34ba6b8f5d17ccfe205f5. {{(pid=87068) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 06 17:49:12 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0336e6d6-03ad-4a2d-a6e1-0c2d642b2129]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:49:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_5ee8oc2ldevstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:49:12 devstack sudo[93369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_5ee8oc2ldevstack@QuobyteHD Nov 06 17:49:12 devstack sudo[93369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:49:12 devstack sudo[93369]: pam_unix(sudo:session): session closed for user root Nov 06 17:49:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_5ee8oc2ldevstack@QuobyteHD" returned: 0 in 0.445s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:49:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:49:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:49:12 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:49:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-900669038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d1939d4-3ffe-40ee-9bf8-49c5d298eb18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0c73c13fe8543f19021e9a4d51ecd4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:49:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:49:09Z,use_quota=True,user_id='6321867b95d34ba6b8f5d17ccfe205f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:49:12 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] Creating volume 6d1939d4-3ffe-40ee-9bf8-49c5d298eb18 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:49:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:49:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:49:12 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:49:12 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:49:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:49:12 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:49:12 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:49:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6d1939d4-3ffe-40ee-9bf8-49c5d298eb18 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:49:12 devstack sudo[93375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6d1939d4-3ffe-40ee-9bf8-49c5d298eb18 1073741824 Nov 06 17:49:12 devstack sudo[93375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:49:13 devstack sudo[93375]: pam_unix(sudo:session): session closed for user root Nov 06 17:49:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6d1939d4-3ffe-40ee-9bf8-49c5d298eb18 1073741824" returned: 0 in 0.720s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:49:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6d1939d4-3ffe-40ee-9bf8-49c5d298eb18 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:49:13 devstack sudo[93381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6d1939d4-3ffe-40ee-9bf8-49c5d298eb18 Nov 06 17:49:13 devstack sudo[93381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:49:14 devstack sudo[93381]: pam_unix(sudo:session): session closed for user root Nov 06 17:49:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6d1939d4-3ffe-40ee-9bf8-49c5d298eb18" returned: 0 in 0.628s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:49:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] <== create_volume: return (1420ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:49:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.429s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:49:14 devstack cinder-volume[87068]: DEBUG cinder.volume.volume_utils [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] Attempting download of 514846ea-e0c6-4037-8ba4-bcd35ce3fba9 ((None, [{'url': 'file:///opt/stack/data/glance/images/514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'metadata': {}}])) to volume 6d1939d4-3ffe-40ee-9bf8-49c5d298eb18. {{(pid=87068) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 17:49:14 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9ef1c5-728f-42e6-bc49-8ec6c9e6c480]: (4, 'raw') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:49:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_4eblk1c3 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:49:14 devstack sudo[93385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_4eblk1c3 Nov 06 17:49:14 devstack sudo[93385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:49:14 devstack sudo[93385]: pam_unix(sudo:session): session closed for user root Nov 06 17:49:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_4eblk1c3" returned: 0 in 0.529s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:49:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_4eblk1c3 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:49:14 devstack sudo[93389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_4eblk1c3 Nov 06 17:49:14 devstack sudo[93389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:49:15 devstack sudo[93389]: pam_unix(sudo:session): session closed for user root Nov 06 17:49:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_4eblk1c3" returned: 1 in 0.602s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:49:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_4eblk1c3' failed. Not Retrying. {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 17:49:15 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a653ad-399f-4ac6-902d-bd244d8012ae]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:49:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_5ee8oc2ldevstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:49:15 devstack sudo[93394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_5ee8oc2ldevstack@QuobyteHD Nov 06 17:49:15 devstack sudo[93394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:49:15 devstack sudo[93394]: pam_unix(sudo:session): session closed for user root Nov 06 17:49:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_5ee8oc2ldevstack@QuobyteHD" returned: 0 in 0.619s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:49:16 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] 514846ea-e0c6-4037-8ba4-bcd35ce3fba9 was qcow2, converting to qcow2 {{(pid=87068) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 06 17:49:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_5ee8oc2ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6d1939d4-3ffe-40ee-9bf8-49c5d298eb18 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:49:16 devstack sudo[93401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_5ee8oc2ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6d1939d4-3ffe-40ee-9bf8-49c5d298eb18 Nov 06 17:49:16 devstack sudo[93401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:49:18 devstack sudo[93401]: pam_unix(sudo:session): session closed for user root Nov 06 17:49:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_5ee8oc2ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6d1939d4-3ffe-40ee-9bf8-49c5d298eb18" returned: 0 in 2.440s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:49:18 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_5ee8oc2ldevstack@QuobyteHD, size 112.00 MB, duration 2.44 sec, destination /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6d1939d4-3ffe-40ee-9bf8-49c5d298eb18 {{(pid=87068) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 17:49:18 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] Converted 112.00 MB image at 45.88 MB/s Nov 06 17:49:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6d1939d4-3ffe-40ee-9bf8-49c5d298eb18 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:49:18 devstack sudo[93409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6d1939d4-3ffe-40ee-9bf8-49c5d298eb18 1G Nov 06 17:49:18 devstack sudo[93409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:49:18 devstack sudo[93409]: pam_unix(sudo:session): session closed for user root Nov 06 17:49:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6d1939d4-3ffe-40ee-9bf8-49c5d298eb18 1G" returned: 0 in 0.401s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:49:18 devstack cinder-volume[87068]: DEBUG cinder.volume.volume_utils [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] Downloaded image 514846ea-e0c6-4037-8ba4-bcd35ce3fba9 ((None, [{'url': 'file:///opt/stack/data/glance/images/514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'metadata': {}}])) to volume 6d1939d4-3ffe-40ee-9bf8-49c5d298eb18 successfully. {{(pid=87068) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 17:49:18 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] Temporary image 514846ea-e0c6-4037-8ba4-bcd35ce3fba9 for user 6321867b95d34ba6b8f5d17ccfe205f5 is deleted. {{(pid=87068) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 06 17:49:18 devstack cinder-volume[87068]: DEBUG cinder.volume.volume_utils [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] Marking volume 6d1939d4-3ffe-40ee-9bf8-49c5d298eb18 as bootable. {{(pid=87068) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 17:49:18 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] Copying metadata from image 514846ea-e0c6-4037-8ba4-bcd35ce3fba9 to 6d1939d4-3ffe-40ee-9bf8-49c5d298eb18. {{(pid=87068) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 17:49:18 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] Creating volume glance metadata for volume 6d1939d4-3ffe-40ee-9bf8-49c5d298eb18 backed by image 514846ea-e0c6-4037-8ba4-bcd35ce3fba9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87068) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 17:49:19 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93fbda7e-d159-4beb-b9f2-4da21d1753d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d1939d4-3ffe-40ee-9bf8-49c5d298eb18', 'volume_size': 1, 'image_id': '514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '344c8ba807084eedb5afd931913d7a80', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'created_at': datetime.datetime(2026, 11, 6, 16, 39, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 16, 39, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/514846ea-e0c6-4037-8ba4-bcd35ce3fba9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:49:19 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b1f8ede-2408-4664-a518-d4162d8d9c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:49:19 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] Volume volume-6d1939d4-3ffe-40ee-9bf8-49c5d298eb18 (6d1939d4-3ffe-40ee-9bf8-49c5d298eb18): created successfully Nov 06 17:49:19 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b1f8ede-2408-4664-a518-d4162d8d9c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:49:19 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] Flow 'volume_create_manager' (1afae992-93f2-4a52-b23f-49f11bb23fab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:49:19 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-cccf73a1-5011-418c-935e-be53ec0fca1b tempest-ServerActionsTestOtherA-1480259007 None] Created volume successfully. Nov 06 17:49:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-4bed71e7-09d1-4b2f-a8a3-6b2f16df2a16 req-c0d28983-e9fd-4cc0-93df-df2e9f3588f8 tempest-ServerActionsTestOtherA-1480259007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:49:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-4bed71e7-09d1-4b2f-a8a3-6b2f16df2a16 req-c0d28983-e9fd-4cc0-93df-df2e9f3588f8 tempest-ServerActionsTestOtherA-1480259007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:49:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-4bed71e7-09d1-4b2f-a8a3-6b2f16df2a16 req-c0d28983-e9fd-4cc0-93df-df2e9f3588f8 tempest-ServerActionsTestOtherA-1480259007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:49:22 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-4bed71e7-09d1-4b2f-a8a3-6b2f16df2a16 req-c0d28983-e9fd-4cc0-93df-df2e9f3588f8 tempest-ServerActionsTestOtherA-1480259007 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072', 'name': 'volume-6d1939d4-3ffe-40ee-9bf8-49c5d298eb18', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8bbea91d-be5f-419e-b646-ab2456d1eb7d', 'enforce_multipath': True} {{(pid=87068) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 17:49:23 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-4bed71e7-09d1-4b2f-a8a3-6b2f16df2a16 req-c0d28983-e9fd-4cc0-93df-df2e9f3588f8 tempest-ServerActionsTestOtherA-1480259007 None] attachment_update completed successfully. Nov 06 17:49:28 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-b79e4fea-ed84-4cad-8391-0d6be97ca142 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:49:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b79e4fea-ed84-4cad-8391-0d6be97ca142 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Flow 'volume_create_manager' (e8d2c8a7-c995-4bda-b60c-35c3cb2882d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:49:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b79e4fea-ed84-4cad-8391-0d6be97ca142 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87b8dce7-d45c-469c-a10f-5c034e8017cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:49:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b79e4fea-ed84-4cad-8391-0d6be97ca142 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87b8dce7-d45c-469c-a10f-5c034e8017cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:49:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1109790640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f97df955-02b4-4288-9ec3-eab168b91ee2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b481bfa114c41a89ed51d797cea77b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:49:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:49:28Z,use_quota=True,user_id='f9f98fca166a4343913905eb2b89cb2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:49:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b79e4fea-ed84-4cad-8391-0d6be97ca142 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b982fa57-3ee5-4c2b-8abb-49b4512e598b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:49:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b79e4fea-ed84-4cad-8391-0d6be97ca142 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b982fa57-3ee5-4c2b-8abb-49b4512e598b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:49:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b79e4fea-ed84-4cad-8391-0d6be97ca142 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd678c1f-ac53-4b6d-ae6e-6fe6470a5bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:49:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b79e4fea-ed84-4cad-8391-0d6be97ca142 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd678c1f-ac53-4b6d-ae6e-6fe6470a5bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f97df955-02b4-4288-9ec3-eab168b91ee2', 'volume_name': 'volume-f97df955-02b4-4288-9ec3-eab168b91ee2', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:49:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b79e4fea-ed84-4cad-8391-0d6be97ca142 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e56d1f57-9e63-42b0-9976-23560e2d8237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:49:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b79e4fea-ed84-4cad-8391-0d6be97ca142 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e56d1f57-9e63-42b0-9976-23560e2d8237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:49:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b79e4fea-ed84-4cad-8391-0d6be97ca142 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78688475-5227-4250-96dd-d40f42646d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:49:28 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-b79e4fea-ed84-4cad-8391-0d6be97ca142 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Volume f97df955-02b4-4288-9ec3-eab168b91ee2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f97df955-02b4-4288-9ec3-eab168b91ee2', 'volume_size': 1} Nov 06 17:49:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b79e4fea-ed84-4cad-8391-0d6be97ca142 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:49:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b79e4fea-ed84-4cad-8391-0d6be97ca142 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:49:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b79e4fea-ed84-4cad-8391-0d6be97ca142 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:49:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1109790640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f97df955-02b4-4288-9ec3-eab168b91ee2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b481bfa114c41a89ed51d797cea77b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:49:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:49:28Z,use_quota=True,user_id='f9f98fca166a4343913905eb2b89cb2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:49:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-b79e4fea-ed84-4cad-8391-0d6be97ca142 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Creating volume f97df955-02b4-4288-9ec3-eab168b91ee2 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:49:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b79e4fea-ed84-4cad-8391-0d6be97ca142 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:49:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b79e4fea-ed84-4cad-8391-0d6be97ca142 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:49:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b79e4fea-ed84-4cad-8391-0d6be97ca142 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:49:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b79e4fea-ed84-4cad-8391-0d6be97ca142 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:49:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b79e4fea-ed84-4cad-8391-0d6be97ca142 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:49:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b79e4fea-ed84-4cad-8391-0d6be97ca142 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:49:28 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-b79e4fea-ed84-4cad-8391-0d6be97ca142 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:49:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b79e4fea-ed84-4cad-8391-0d6be97ca142 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f97df955-02b4-4288-9ec3-eab168b91ee2 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:49:28 devstack sudo[93908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f97df955-02b4-4288-9ec3-eab168b91ee2 1073741824 Nov 06 17:49:28 devstack sudo[93908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:49:29 devstack sudo[93908]: pam_unix(sudo:session): session closed for user root Nov 06 17:49:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b79e4fea-ed84-4cad-8391-0d6be97ca142 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f97df955-02b4-4288-9ec3-eab168b91ee2 1073741824" returned: 0 in 0.721s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:49:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b79e4fea-ed84-4cad-8391-0d6be97ca142 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f97df955-02b4-4288-9ec3-eab168b91ee2 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:49:29 devstack sudo[93916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f97df955-02b4-4288-9ec3-eab168b91ee2 Nov 06 17:49:29 devstack sudo[93916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:49:29 devstack sudo[93916]: pam_unix(sudo:session): session closed for user root Nov 06 17:49:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b79e4fea-ed84-4cad-8391-0d6be97ca142 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f97df955-02b4-4288-9ec3-eab168b91ee2" returned: 0 in 0.343s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:49:29 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b79e4fea-ed84-4cad-8391-0d6be97ca142 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:49:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b79e4fea-ed84-4cad-8391-0d6be97ca142 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:49:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b79e4fea-ed84-4cad-8391-0d6be97ca142 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78688475-5227-4250-96dd-d40f42646d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f97df955-02b4-4288-9ec3-eab168b91ee2', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:49:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b79e4fea-ed84-4cad-8391-0d6be97ca142 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7782cdda-1c63-49b6-862a-e985d7e16d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:49:29 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-41466a24-4a1c-4721-b5fd-80e7e15eccd4 tempest-GroupsTest-1140657678 None] Group tempest-Group1-1835535260: creating Nov 06 17:49:29 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-b79e4fea-ed84-4cad-8391-0d6be97ca142 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Volume volume-f97df955-02b4-4288-9ec3-eab168b91ee2 (f97df955-02b4-4288-9ec3-eab168b91ee2): created successfully Nov 06 17:49:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b79e4fea-ed84-4cad-8391-0d6be97ca142 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7782cdda-1c63-49b6-862a-e985d7e16d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:49:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b79e4fea-ed84-4cad-8391-0d6be97ca142 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Flow 'volume_create_manager' (e8d2c8a7-c995-4bda-b60c-35c3cb2882d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:49:29 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-b79e4fea-ed84-4cad-8391-0d6be97ca142 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Created volume successfully. Nov 06 17:49:29 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-41466a24-4a1c-4721-b5fd-80e7e15eccd4 tempest-GroupsTest-1140657678 None] Group tempest-Group1-1835535260: created successfully Nov 06 17:49:29 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-41466a24-4a1c-4721-b5fd-80e7e15eccd4 tempest-GroupsTest-1140657678 None] Create group completed successfully. Nov 06 17:49:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-54ae54b5-e510-4aa5-b6fd-6dab57dfa344 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:49:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-54ae54b5-e510-4aa5-b6fd-6dab57dfa344 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:49:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-54ae54b5-e510-4aa5-b6fd-6dab57dfa344 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Creating offline snapshot 662228a2-927c-4d8e-b7ac-eafee0dfb093 of volume f97df955-02b4-4288-9ec3-eab168b91ee2 {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 17:49:30 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[335d61a2-45e2-486e-8e82-f8703e2c95d7]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:49:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-54ae54b5-e510-4aa5-b6fd-6dab57dfa344 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f97df955-02b4-4288-9ec3-eab168b91ee2 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:49:31 devstack sudo[93920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f97df955-02b4-4288-9ec3-eab168b91ee2 Nov 06 17:49:31 devstack sudo[93920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:49:31 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-47106fff-8d8f-4e54-abd1-fe5b985383a0 tempest-GroupsTest-1140657678 None] Group tempest-Group2-1658244287: creating Nov 06 17:49:31 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=116,cinder:UPDATE=107,cinder:INSERT=37,cinder:DELETE=3 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 17:49:31 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-47106fff-8d8f-4e54-abd1-fe5b985383a0 tempest-GroupsTest-1140657678 None] Group tempest-Group2-1658244287: created successfully Nov 06 17:49:31 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-47106fff-8d8f-4e54-abd1-fe5b985383a0 tempest-GroupsTest-1140657678 None] Create group completed successfully. Nov 06 17:49:31 devstack sudo[93920]: pam_unix(sudo:session): session closed for user root Nov 06 17:49:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-54ae54b5-e510-4aa5-b6fd-6dab57dfa344 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f97df955-02b4-4288-9ec3-eab168b91ee2" returned: 0 in 0.633s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:49:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-54ae54b5-e510-4aa5-b6fd-6dab57dfa344 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f97df955-02b4-4288-9ec3-eab168b91ee2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f97df955-02b4-4288-9ec3-eab168b91ee2.662228a2-927c-4d8e-b7ac-eafee0dfb093 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:49:31 devstack sudo[93925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f97df955-02b4-4288-9ec3-eab168b91ee2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f97df955-02b4-4288-9ec3-eab168b91ee2.662228a2-927c-4d8e-b7ac-eafee0dfb093 1G Nov 06 17:49:31 devstack sudo[93925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:49:32 devstack sudo[93925]: pam_unix(sudo:session): session closed for user root Nov 06 17:49:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-54ae54b5-e510-4aa5-b6fd-6dab57dfa344 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f97df955-02b4-4288-9ec3-eab168b91ee2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f97df955-02b4-4288-9ec3-eab168b91ee2.662228a2-927c-4d8e-b7ac-eafee0dfb093 1G" returned: 0 in 0.679s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:49:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-54ae54b5-e510-4aa5-b6fd-6dab57dfa344 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f97df955-02b4-4288-9ec3-eab168b91ee2 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f97df955-02b4-4288-9ec3-eab168b91ee2.662228a2-927c-4d8e-b7ac-eafee0dfb093 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:49:32 devstack sudo[93932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f97df955-02b4-4288-9ec3-eab168b91ee2 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f97df955-02b4-4288-9ec3-eab168b91ee2.662228a2-927c-4d8e-b7ac-eafee0dfb093 Nov 06 17:49:32 devstack sudo[93932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:49:32 devstack sudo[93932]: pam_unix(sudo:session): session closed for user root Nov 06 17:49:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-54ae54b5-e510-4aa5-b6fd-6dab57dfa344 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f97df955-02b4-4288-9ec3-eab168b91ee2 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f97df955-02b4-4288-9ec3-eab168b91ee2.662228a2-927c-4d8e-b7ac-eafee0dfb093" returned: 0 in 0.479s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:49:32 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-54ae54b5-e510-4aa5-b6fd-6dab57dfa344 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f97df955-02b4-4288-9ec3-eab168b91ee2.662228a2-927c-4d8e-b7ac-eafee0dfb093 is being set with open permissions: ugo+rw Nov 06 17:49:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-54ae54b5-e510-4aa5-b6fd-6dab57dfa344 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f97df955-02b4-4288-9ec3-eab168b91ee2.662228a2-927c-4d8e-b7ac-eafee0dfb093 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:49:32 devstack sudo[93938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f97df955-02b4-4288-9ec3-eab168b91ee2.662228a2-927c-4d8e-b7ac-eafee0dfb093 Nov 06 17:49:32 devstack sudo[93938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:49:33 devstack sudo[93938]: pam_unix(sudo:session): session closed for user root Nov 06 17:49:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-54ae54b5-e510-4aa5-b6fd-6dab57dfa344 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f97df955-02b4-4288-9ec3-eab168b91ee2.662228a2-927c-4d8e-b7ac-eafee0dfb093" returned: 0 in 0.437s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:49:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-54ae54b5-e510-4aa5-b6fd-6dab57dfa344 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f97df955-02b4-4288-9ec3-eab168b91ee2.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:49:33 devstack sudo[93943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f97df955-02b4-4288-9ec3-eab168b91ee2.info Nov 06 17:49:33 devstack sudo[93943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:49:33 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-c39ae5a6-cd7a-41d9-b8b5-6af84bf8a939 tempest-GroupsTest-1140657678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:49:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c39ae5a6-cd7a-41d9-b8b5-6af84bf8a939 tempest-GroupsTest-1140657678 None] Flow 'volume_create_manager' (a36652e0-6426-4d12-83b7-a8158052a4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:49:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c39ae5a6-cd7a-41d9-b8b5-6af84bf8a939 tempest-GroupsTest-1140657678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a586f582-5af7-4849-8651-efe6d6f61ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:49:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c39ae5a6-cd7a-41d9-b8b5-6af84bf8a939 tempest-GroupsTest-1140657678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a586f582-5af7-4849-8651-efe6d6f61ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:49:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1442867764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8b739e33-eec8-4d24-b23d-9dfe1678afa7,host='devstack@QuobyteHD#QuobyteHD',id=6f88e556-57bb-4abd-a8c0-6fa09b3ea4fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7cedfd1a95f433bb3b8967ee1c61320',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:49:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:49:34Z,use_quota=True,user_id='77b54e1507594eb4a3675cb844aca78a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd5d4601-911c-4347-93be-f0351e0db1d3),volume_type_id=fd5d4601-911c-4347-93be-f0351e0db1d3)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:49:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c39ae5a6-cd7a-41d9-b8b5-6af84bf8a939 tempest-GroupsTest-1140657678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (310b30b6-a96a-4ad1-ba69-25afa220d21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:49:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c39ae5a6-cd7a-41d9-b8b5-6af84bf8a939 tempest-GroupsTest-1140657678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (310b30b6-a96a-4ad1-ba69-25afa220d21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:49:34 devstack sudo[93943]: pam_unix(sudo:session): session closed for user root Nov 06 17:49:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c39ae5a6-cd7a-41d9-b8b5-6af84bf8a939 tempest-GroupsTest-1140657678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fa3a7e5-471a-42e8-89ef-1f94ca8f4546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:49:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c39ae5a6-cd7a-41d9-b8b5-6af84bf8a939 tempest-GroupsTest-1140657678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fa3a7e5-471a-42e8-89ef-1f94ca8f4546) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f88e556-57bb-4abd-a8c0-6fa09b3ea4fe', 'volume_name': 'volume-6f88e556-57bb-4abd-a8c0-6fa09b3ea4fe', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:49:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c39ae5a6-cd7a-41d9-b8b5-6af84bf8a939 tempest-GroupsTest-1140657678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c4f396d-2dcb-4e93-8cf0-05499f6a2431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:49:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c39ae5a6-cd7a-41d9-b8b5-6af84bf8a939 tempest-GroupsTest-1140657678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c4f396d-2dcb-4e93-8cf0-05499f6a2431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:49:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c39ae5a6-cd7a-41d9-b8b5-6af84bf8a939 tempest-GroupsTest-1140657678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0df1cf1-75a9-463f-9bfb-79051f4300b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:49:34 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-c39ae5a6-cd7a-41d9-b8b5-6af84bf8a939 tempest-GroupsTest-1140657678 None] Volume 6f88e556-57bb-4abd-a8c0-6fa09b3ea4fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f88e556-57bb-4abd-a8c0-6fa09b3ea4fe', 'volume_size': 1} Nov 06 17:49:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c39ae5a6-cd7a-41d9-b8b5-6af84bf8a939 tempest-GroupsTest-1140657678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:49:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-54ae54b5-e510-4aa5-b6fd-6dab57dfa344 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f97df955-02b4-4288-9ec3-eab168b91ee2.info" returned: 0 in 0.812s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:49:34 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-54ae54b5-e510-4aa5-b6fd-6dab57dfa344 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f97df955-02b4-4288-9ec3-eab168b91ee2.info is being set with open permissions: ugo+rw Nov 06 17:49:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-54ae54b5-e510-4aa5-b6fd-6dab57dfa344 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f97df955-02b4-4288-9ec3-eab168b91ee2.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:49:34 devstack sudo[93946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f97df955-02b4-4288-9ec3-eab168b91ee2.info Nov 06 17:49:34 devstack sudo[93946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:49:34 devstack sudo[93946]: pam_unix(sudo:session): session closed for user root Nov 06 17:49:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-54ae54b5-e510-4aa5-b6fd-6dab57dfa344 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f97df955-02b4-4288-9ec3-eab168b91ee2.info" returned: 0 in 0.467s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:49:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-54ae54b5-e510-4aa5-b6fd-6dab57dfa344 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.741s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:49:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c39ae5a6-cd7a-41d9-b8b5-6af84bf8a939 tempest-GroupsTest-1140657678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.517s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:49:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c39ae5a6-cd7a-41d9-b8b5-6af84bf8a939 tempest-GroupsTest-1140657678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8b739e33-eec8-4d24-b23d-9dfe1678afa7,created_at=2026-11-06T16:49:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1442867764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8b739e33-eec8-4d24-b23d-9dfe1678afa7,host='devstack@QuobyteHD#QuobyteHD',id=6f88e556-57bb-4abd-a8c0-6fa09b3ea4fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7cedfd1a95f433bb3b8967ee1c61320',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:49:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:49:34Z,use_quota=True,user_id='77b54e1507594eb4a3675cb844aca78a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd5d4601-911c-4347-93be-f0351e0db1d3),volume_type_id=fd5d4601-911c-4347-93be-f0351e0db1d3)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:49:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-c39ae5a6-cd7a-41d9-b8b5-6af84bf8a939 tempest-GroupsTest-1140657678 None] Creating volume 6f88e556-57bb-4abd-a8c0-6fa09b3ea4fe {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:49:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c39ae5a6-cd7a-41d9-b8b5-6af84bf8a939 tempest-GroupsTest-1140657678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:49:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c39ae5a6-cd7a-41d9-b8b5-6af84bf8a939 tempest-GroupsTest-1140657678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:49:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c39ae5a6-cd7a-41d9-b8b5-6af84bf8a939 tempest-GroupsTest-1140657678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:49:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c39ae5a6-cd7a-41d9-b8b5-6af84bf8a939 tempest-GroupsTest-1140657678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:49:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c39ae5a6-cd7a-41d9-b8b5-6af84bf8a939 tempest-GroupsTest-1140657678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:49:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c39ae5a6-cd7a-41d9-b8b5-6af84bf8a939 tempest-GroupsTest-1140657678 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:49:34 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-c39ae5a6-cd7a-41d9-b8b5-6af84bf8a939 tempest-GroupsTest-1140657678 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:49:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c39ae5a6-cd7a-41d9-b8b5-6af84bf8a939 tempest-GroupsTest-1140657678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f88e556-57bb-4abd-a8c0-6fa09b3ea4fe 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:49:34 devstack sudo[93949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f88e556-57bb-4abd-a8c0-6fa09b3ea4fe 1073741824 Nov 06 17:49:34 devstack sudo[93949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:49:34 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-54ae54b5-e510-4aa5-b6fd-6dab57dfa344 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Create snapshot completed successfully Nov 06 17:49:35 devstack sudo[93949]: pam_unix(sudo:session): session closed for user root Nov 06 17:49:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c39ae5a6-cd7a-41d9-b8b5-6af84bf8a939 tempest-GroupsTest-1140657678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f88e556-57bb-4abd-a8c0-6fa09b3ea4fe 1073741824" returned: 0 in 1.140s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:49:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c39ae5a6-cd7a-41d9-b8b5-6af84bf8a939 tempest-GroupsTest-1140657678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f88e556-57bb-4abd-a8c0-6fa09b3ea4fe {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:49:35 devstack sudo[93957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f88e556-57bb-4abd-a8c0-6fa09b3ea4fe Nov 06 17:49:35 devstack sudo[93957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:49:36 devstack sudo[93957]: pam_unix(sudo:session): session closed for user root Nov 06 17:49:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c39ae5a6-cd7a-41d9-b8b5-6af84bf8a939 tempest-GroupsTest-1140657678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f88e556-57bb-4abd-a8c0-6fa09b3ea4fe" returned: 0 in 0.446s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:49:36 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c39ae5a6-cd7a-41d9-b8b5-6af84bf8a939 tempest-GroupsTest-1140657678 None] <== create_volume: return (1684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:49:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c39ae5a6-cd7a-41d9-b8b5-6af84bf8a939 tempest-GroupsTest-1140657678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.695s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:49:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c39ae5a6-cd7a-41d9-b8b5-6af84bf8a939 tempest-GroupsTest-1140657678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0df1cf1-75a9-463f-9bfb-79051f4300b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f88e556-57bb-4abd-a8c0-6fa09b3ea4fe', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:49:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c39ae5a6-cd7a-41d9-b8b5-6af84bf8a939 tempest-GroupsTest-1140657678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c2f804c-7e9a-4cae-974d-dd918cb8e260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:49:36 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-c39ae5a6-cd7a-41d9-b8b5-6af84bf8a939 tempest-GroupsTest-1140657678 None] Volume volume-6f88e556-57bb-4abd-a8c0-6fa09b3ea4fe (6f88e556-57bb-4abd-a8c0-6fa09b3ea4fe): created successfully Nov 06 17:49:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c39ae5a6-cd7a-41d9-b8b5-6af84bf8a939 tempest-GroupsTest-1140657678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c2f804c-7e9a-4cae-974d-dd918cb8e260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:49:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c39ae5a6-cd7a-41d9-b8b5-6af84bf8a939 tempest-GroupsTest-1140657678 None] Flow 'volume_create_manager' (a36652e0-6426-4d12-83b7-a8158052a4fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:49:36 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-c39ae5a6-cd7a-41d9-b8b5-6af84bf8a939 tempest-GroupsTest-1140657678 None] Created volume successfully. Nov 06 17:49:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-546f11a6-a499-4228-90b4-9fd1e7cefb28 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Acquiring lock "cinder-662228a2-927c-4d8e-b7ac-eafee0dfb093-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:49:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-546f11a6-a499-4228-90b4-9fd1e7cefb28 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Lock "cinder-662228a2-927c-4d8e-b7ac-eafee0dfb093-delete_snapshot" acquired by "delete_snapshot" :: waited 0.060s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:49:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-546f11a6-a499-4228-90b4-9fd1e7cefb28 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Acquiring lock "cinder-quobyte-f97df955-02b4-4288-9ec3-eab168b91ee2" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:49:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-546f11a6-a499-4228-90b4-9fd1e7cefb28 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Lock "cinder-quobyte-f97df955-02b4-4288-9ec3-eab168b91ee2" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:49:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-546f11a6-a499-4228-90b4-9fd1e7cefb28 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Acquiring lock "cinder-quobyte-662228a2-927c-4d8e-b7ac-eafee0dfb093" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:49:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-546f11a6-a499-4228-90b4-9fd1e7cefb28 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Lock "cinder-quobyte-662228a2-927c-4d8e-b7ac-eafee0dfb093" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:49:36 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-546f11a6-a499-4228-90b4-9fd1e7cefb28 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Deleting offline snapshot 662228a2-927c-4d8e-b7ac-eafee0dfb093 of volume f97df955-02b4-4288-9ec3-eab168b91ee2 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 17:49:36 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-546f11a6-a499-4228-90b4-9fd1e7cefb28 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] snapshot_file for this snap is: volume-f97df955-02b4-4288-9ec3-eab168b91ee2.662228a2-927c-4d8e-b7ac-eafee0dfb093 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 17:49:36 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9757df-17e7-4ecc-922f-b99f27972685]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:49:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-546f11a6-a499-4228-90b4-9fd1e7cefb28 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f97df955-02b4-4288-9ec3-eab168b91ee2.662228a2-927c-4d8e-b7ac-eafee0dfb093 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:49:36 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-208bed8e-2437-440d-9149-de11ca9522ca tempest-AttachVolumeNegativeTest-577825985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:49:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-208bed8e-2437-440d-9149-de11ca9522ca tempest-AttachVolumeNegativeTest-577825985 None] Flow 'volume_create_manager' (33278e23-9f93-4738-842b-7aea511bf4a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:49:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-208bed8e-2437-440d-9149-de11ca9522ca tempest-AttachVolumeNegativeTest-577825985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2f7d7da-1a0b-4d3c-be0d-214ce0386f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:49:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-208bed8e-2437-440d-9149-de11ca9522ca tempest-AttachVolumeNegativeTest-577825985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2f7d7da-1a0b-4d3c-be0d-214ce0386f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:49:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1212744382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f579ad7b-ab63-42e0-ac9e-eb6cbc816c23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a899b78c2d34f678680c8113c7dc62f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:49:37Z,use_quota=True,user_id='3ac9532494834390be879588a01db91d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:49:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-208bed8e-2437-440d-9149-de11ca9522ca tempest-AttachVolumeNegativeTest-577825985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61550e4d-4e01-4205-851d-238ea96c1355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:49:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-208bed8e-2437-440d-9149-de11ca9522ca tempest-AttachVolumeNegativeTest-577825985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61550e4d-4e01-4205-851d-238ea96c1355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:49:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-208bed8e-2437-440d-9149-de11ca9522ca tempest-AttachVolumeNegativeTest-577825985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (576e3183-fa91-4b05-982e-c24f5f7662c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:49:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-208bed8e-2437-440d-9149-de11ca9522ca tempest-AttachVolumeNegativeTest-577825985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (576e3183-fa91-4b05-982e-c24f5f7662c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f579ad7b-ab63-42e0-ac9e-eb6cbc816c23', 'volume_name': 'volume-f579ad7b-ab63-42e0-ac9e-eb6cbc816c23', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:49:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-208bed8e-2437-440d-9149-de11ca9522ca tempest-AttachVolumeNegativeTest-577825985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f67efbe-136d-4fcf-8bd6-3a933bee72c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:49:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-208bed8e-2437-440d-9149-de11ca9522ca tempest-AttachVolumeNegativeTest-577825985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f67efbe-136d-4fcf-8bd6-3a933bee72c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:49:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-208bed8e-2437-440d-9149-de11ca9522ca tempest-AttachVolumeNegativeTest-577825985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46aaa349-a93f-4bed-a839-319a4ce317ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:49:36 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-208bed8e-2437-440d-9149-de11ca9522ca tempest-AttachVolumeNegativeTest-577825985 None] Volume f579ad7b-ab63-42e0-ac9e-eb6cbc816c23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f579ad7b-ab63-42e0-ac9e-eb6cbc816c23', 'volume_size': 1} Nov 06 17:49:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-208bed8e-2437-440d-9149-de11ca9522ca tempest-AttachVolumeNegativeTest-577825985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:49:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-208bed8e-2437-440d-9149-de11ca9522ca tempest-AttachVolumeNegativeTest-577825985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:49:36 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-208bed8e-2437-440d-9149-de11ca9522ca tempest-AttachVolumeNegativeTest-577825985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:49:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1212744382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f579ad7b-ab63-42e0-ac9e-eb6cbc816c23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a899b78c2d34f678680c8113c7dc62f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:49:37Z,use_quota=True,user_id='3ac9532494834390be879588a01db91d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:49:36 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-208bed8e-2437-440d-9149-de11ca9522ca tempest-AttachVolumeNegativeTest-577825985 None] Creating volume f579ad7b-ab63-42e0-ac9e-eb6cbc816c23 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:49:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-208bed8e-2437-440d-9149-de11ca9522ca tempest-AttachVolumeNegativeTest-577825985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:49:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-208bed8e-2437-440d-9149-de11ca9522ca tempest-AttachVolumeNegativeTest-577825985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:49:36 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-208bed8e-2437-440d-9149-de11ca9522ca tempest-AttachVolumeNegativeTest-577825985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:49:36 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-208bed8e-2437-440d-9149-de11ca9522ca tempest-AttachVolumeNegativeTest-577825985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:49:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-208bed8e-2437-440d-9149-de11ca9522ca tempest-AttachVolumeNegativeTest-577825985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:49:36 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-208bed8e-2437-440d-9149-de11ca9522ca tempest-AttachVolumeNegativeTest-577825985 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:49:36 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-208bed8e-2437-440d-9149-de11ca9522ca tempest-AttachVolumeNegativeTest-577825985 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:49:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-208bed8e-2437-440d-9149-de11ca9522ca tempest-AttachVolumeNegativeTest-577825985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f579ad7b-ab63-42e0-ac9e-eb6cbc816c23 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:49:36 devstack sudo[93961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f579ad7b-ab63-42e0-ac9e-eb6cbc816c23 1073741824 Nov 06 17:49:36 devstack sudo[93961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:49:36 devstack sudo[93960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f97df955-02b4-4288-9ec3-eab168b91ee2.662228a2-927c-4d8e-b7ac-eafee0dfb093 Nov 06 17:49:36 devstack sudo[93960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:49:37 devstack sudo[93960]: pam_unix(sudo:session): session closed for user root Nov 06 17:49:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-546f11a6-a499-4228-90b4-9fd1e7cefb28 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f97df955-02b4-4288-9ec3-eab168b91ee2.662228a2-927c-4d8e-b7ac-eafee0dfb093" returned: 0 in 0.746s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:49:37 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-546f11a6-a499-4228-90b4-9fd1e7cefb28 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f97df955-02b4-4288-9ec3-eab168b91ee2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 17:49:37 devstack sudo[93961]: pam_unix(sudo:session): session closed for user root Nov 06 17:49:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-208bed8e-2437-440d-9149-de11ca9522ca tempest-AttachVolumeNegativeTest-577825985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f579ad7b-ab63-42e0-ac9e-eb6cbc816c23 1073741824" returned: 0 in 0.655s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:49:37 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c94ca46-66f5-4bf2-a33d-d5c4ee217385]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:49:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-546f11a6-a499-4228-90b4-9fd1e7cefb28 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f97df955-02b4-4288-9ec3-eab168b91ee2 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:49:37 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=118,cinder:INSERT=28,cinder:UPDATE=108,cinder:DELETE=4 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 17:49:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-208bed8e-2437-440d-9149-de11ca9522ca tempest-AttachVolumeNegativeTest-577825985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f579ad7b-ab63-42e0-ac9e-eb6cbc816c23 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:49:37 devstack sudo[93973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f97df955-02b4-4288-9ec3-eab168b91ee2 Nov 06 17:49:37 devstack sudo[93973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:49:37 devstack sudo[93974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f579ad7b-ab63-42e0-ac9e-eb6cbc816c23 Nov 06 17:49:37 devstack sudo[93974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:49:37 devstack sudo[93974]: pam_unix(sudo:session): session closed for user root Nov 06 17:49:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-208bed8e-2437-440d-9149-de11ca9522ca tempest-AttachVolumeNegativeTest-577825985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f579ad7b-ab63-42e0-ac9e-eb6cbc816c23" returned: 0 in 0.350s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:49:37 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-208bed8e-2437-440d-9149-de11ca9522ca tempest-AttachVolumeNegativeTest-577825985 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:49:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-208bed8e-2437-440d-9149-de11ca9522ca tempest-AttachVolumeNegativeTest-577825985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:49:38 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-14c3c3d2-b352-43b3-9746-4d98f55b1fea tempest-GroupsTest-1140657678 None] Acquiring lock "cinder-quobyte-6f88e556-57bb-4abd-a8c0-6fa09b3ea4fe" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:49:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-208bed8e-2437-440d-9149-de11ca9522ca tempest-AttachVolumeNegativeTest-577825985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46aaa349-a93f-4bed-a839-319a4ce317ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f579ad7b-ab63-42e0-ac9e-eb6cbc816c23', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:49:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-208bed8e-2437-440d-9149-de11ca9522ca tempest-AttachVolumeNegativeTest-577825985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a6e68a0-81c9-40c6-afb0-dbcb783632f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:49:38 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-208bed8e-2437-440d-9149-de11ca9522ca tempest-AttachVolumeNegativeTest-577825985 None] Volume volume-f579ad7b-ab63-42e0-ac9e-eb6cbc816c23 (f579ad7b-ab63-42e0-ac9e-eb6cbc816c23): created successfully Nov 06 17:49:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-208bed8e-2437-440d-9149-de11ca9522ca tempest-AttachVolumeNegativeTest-577825985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a6e68a0-81c9-40c6-afb0-dbcb783632f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:49:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-208bed8e-2437-440d-9149-de11ca9522ca tempest-AttachVolumeNegativeTest-577825985 None] Flow 'volume_create_manager' (33278e23-9f93-4738-842b-7aea511bf4a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:49:38 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-14c3c3d2-b352-43b3-9746-4d98f55b1fea tempest-GroupsTest-1140657678 None] Lock "cinder-quobyte-6f88e556-57bb-4abd-a8c0-6fa09b3ea4fe" acquired by "delete_volume" :: waited 0.086s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:49:38 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-208bed8e-2437-440d-9149-de11ca9522ca tempest-AttachVolumeNegativeTest-577825985 None] Created volume successfully. Nov 06 17:49:38 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd7ceca-88f2-4136-95c5-39e9545285b1]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:49:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-14c3c3d2-b352-43b3-9746-4d98f55b1fea tempest-GroupsTest-1140657678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f88e556-57bb-4abd-a8c0-6fa09b3ea4fe {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:49:38 devstack sudo[93973]: pam_unix(sudo:session): session closed for user root Nov 06 17:49:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-546f11a6-a499-4228-90b4-9fd1e7cefb28 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f97df955-02b4-4288-9ec3-eab168b91ee2" returned: 0 in 0.641s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:49:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-546f11a6-a499-4228-90b4-9fd1e7cefb28 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f97df955-02b4-4288-9ec3-eab168b91ee2.662228a2-927c-4d8e-b7ac-eafee0dfb093 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:49:38 devstack sudo[93983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f97df955-02b4-4288-9ec3-eab168b91ee2.662228a2-927c-4d8e-b7ac-eafee0dfb093 Nov 06 17:49:38 devstack sudo[93983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:49:38 devstack sudo[93981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f88e556-57bb-4abd-a8c0-6fa09b3ea4fe Nov 06 17:49:38 devstack sudo[93981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:49:38 devstack sudo[93983]: pam_unix(sudo:session): session closed for user root Nov 06 17:49:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-546f11a6-a499-4228-90b4-9fd1e7cefb28 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f97df955-02b4-4288-9ec3-eab168b91ee2.662228a2-927c-4d8e-b7ac-eafee0dfb093" returned: 0 in 0.661s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:49:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-546f11a6-a499-4228-90b4-9fd1e7cefb28 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f97df955-02b4-4288-9ec3-eab168b91ee2.662228a2-927c-4d8e-b7ac-eafee0dfb093 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:49:38 devstack sudo[93992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f97df955-02b4-4288-9ec3-eab168b91ee2.662228a2-927c-4d8e-b7ac-eafee0dfb093 Nov 06 17:49:38 devstack sudo[93992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:49:38 devstack sudo[93981]: pam_unix(sudo:session): session closed for user root Nov 06 17:49:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-14c3c3d2-b352-43b3-9746-4d98f55b1fea tempest-GroupsTest-1140657678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f88e556-57bb-4abd-a8c0-6fa09b3ea4fe" returned: 0 in 0.876s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:49:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-14c3c3d2-b352-43b3-9746-4d98f55b1fea tempest-GroupsTest-1140657678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f88e556-57bb-4abd-a8c0-6fa09b3ea4fe {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:49:39 devstack sudo[93997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f88e556-57bb-4abd-a8c0-6fa09b3ea4fe Nov 06 17:49:39 devstack sudo[93997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:49:39 devstack sudo[93992]: pam_unix(sudo:session): session closed for user root Nov 06 17:49:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-546f11a6-a499-4228-90b4-9fd1e7cefb28 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f97df955-02b4-4288-9ec3-eab168b91ee2.662228a2-927c-4d8e-b7ac-eafee0dfb093" returned: 0 in 0.381s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:49:39 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-546f11a6-a499-4228-90b4-9fd1e7cefb28 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Lock "cinder-quobyte-662228a2-927c-4d8e-b7ac-eafee0dfb093" released by "_delete_snapshot" :: held 2.675s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:49:39 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-546f11a6-a499-4228-90b4-9fd1e7cefb28 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Lock "cinder-quobyte-f97df955-02b4-4288-9ec3-eab168b91ee2" released by "delete_snapshot" :: held 2.724s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:49:39 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-546f11a6-a499-4228-90b4-9fd1e7cefb28 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Created reservations ['0d1b7861-c057-4f7f-8817-3501963ad707', '841c8861-9064-40a4-88b4-cb9e9642678d', '6a43d169-3886-433a-8b71-24560edb96a6', '5caf9645-02ab-42f0-a94e-d27d63d51f59'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:49:39 devstack sudo[93997]: pam_unix(sudo:session): session closed for user root Nov 06 17:49:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-14c3c3d2-b352-43b3-9746-4d98f55b1fea tempest-GroupsTest-1140657678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f88e556-57bb-4abd-a8c0-6fa09b3ea4fe" returned: 0 in 0.624s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:49:39 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-14c3c3d2-b352-43b3-9746-4d98f55b1fea tempest-GroupsTest-1140657678 None] Lock "cinder-quobyte-6f88e556-57bb-4abd-a8c0-6fa09b3ea4fe" released by "delete_volume" :: held 1.579s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:49:39 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-546f11a6-a499-4228-90b4-9fd1e7cefb28 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Delete snapshot completed successfully. Nov 06 17:49:39 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-546f11a6-a499-4228-90b4-9fd1e7cefb28 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Lock "cinder-662228a2-927c-4d8e-b7ac-eafee0dfb093-delete_snapshot" released by "delete_snapshot" :: held 3.140s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:49:39 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-14c3c3d2-b352-43b3-9746-4d98f55b1fea tempest-GroupsTest-1140657678 None] Created reservations ['c9ff2b5b-40c3-42d8-80a1-fc8f6316c452'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:49:39 devstack cinder-volume[87068]: WARNING cinder.quota [None req-14c3c3d2-b352-43b3-9746-4d98f55b1fea tempest-GroupsTest-1140657678 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-338781260 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-338781260, it is now deprecated. Please use the default quota class for default quota. Nov 06 17:49:39 devstack cinder-volume[87068]: WARNING cinder.quota [None req-14c3c3d2-b352-43b3-9746-4d98f55b1fea tempest-GroupsTest-1140657678 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-338781260 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-338781260, it is now deprecated. Please use the default quota class for default quota. Nov 06 17:49:39 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-14c3c3d2-b352-43b3-9746-4d98f55b1fea tempest-GroupsTest-1140657678 None] Created reservations ['216f125b-25e7-481f-8c00-dd3630a2df92', 'df9a4d08-7679-440b-ac60-992460556e7e', '53c6b52a-2827-41f8-acb4-b25b5c8c3b5d', '5082f237-e6c4-46f2-806d-0cfe4f823811'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:49:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-14c3c3d2-b352-43b3-9746-4d98f55b1fea tempest-GroupsTest-1140657678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:49:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-14c3c3d2-b352-43b3-9746-4d98f55b1fea tempest-GroupsTest-1140657678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:49:39 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-14c3c3d2-b352-43b3-9746-4d98f55b1fea tempest-GroupsTest-1140657678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:49:40 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-14c3c3d2-b352-43b3-9746-4d98f55b1fea tempest-GroupsTest-1140657678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:49:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-14c3c3d2-b352-43b3-9746-4d98f55b1fea tempest-GroupsTest-1140657678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:49:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-14c3c3d2-b352-43b3-9746-4d98f55b1fea tempest-GroupsTest-1140657678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:49:40 devstack sudo[94005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:49:40 devstack sudo[94005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:49:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4be03bdf-75e7-4b5f-8069-df5de95b6db5 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Acquiring lock "cinder-f97df955-02b4-4288-9ec3-eab168b91ee2-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:49:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4be03bdf-75e7-4b5f-8069-df5de95b6db5 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Lock "cinder-f97df955-02b4-4288-9ec3-eab168b91ee2-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:49:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4be03bdf-75e7-4b5f-8069-df5de95b6db5 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Acquiring lock "cinder-quobyte-f97df955-02b4-4288-9ec3-eab168b91ee2" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:49:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4be03bdf-75e7-4b5f-8069-df5de95b6db5 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Lock "cinder-quobyte-f97df955-02b4-4288-9ec3-eab168b91ee2" acquired by "delete_volume" :: waited 0.028s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:49:40 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7812f95-9b17-4d87-be56-bfb0bbfdb5fb]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:49:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4be03bdf-75e7-4b5f-8069-df5de95b6db5 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f97df955-02b4-4288-9ec3-eab168b91ee2 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:49:40 devstack sudo[94005]: pam_unix(sudo:session): session closed for user root Nov 06 17:49:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-14c3c3d2-b352-43b3-9746-4d98f55b1fea tempest-GroupsTest-1140657678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.449s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:49:40 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-14c3c3d2-b352-43b3-9746-4d98f55b1fea tempest-GroupsTest-1140657678 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:49:40 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-14c3c3d2-b352-43b3-9746-4d98f55b1fea tempest-GroupsTest-1140657678 None] Delete group completed successfully. Nov 06 17:49:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-99687889-747f-4a90-abe9-fefa08da60f4 req-2dd5e2c6-c07d-4c0e-aea1-aa4f431f002d tempest-AttachVolumeNegativeTest-577825985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:49:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-99687889-747f-4a90-abe9-fefa08da60f4 req-2dd5e2c6-c07d-4c0e-aea1-aa4f431f002d tempest-AttachVolumeNegativeTest-577825985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:49:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-99687889-747f-4a90-abe9-fefa08da60f4 req-2dd5e2c6-c07d-4c0e-aea1-aa4f431f002d tempest-AttachVolumeNegativeTest-577825985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:49:40 devstack sudo[94016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f97df955-02b4-4288-9ec3-eab168b91ee2 Nov 06 17:49:40 devstack sudo[94016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:49:40 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-99687889-747f-4a90-abe9-fefa08da60f4 req-2dd5e2c6-c07d-4c0e-aea1-aa4f431f002d tempest-AttachVolumeNegativeTest-577825985 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072', 'name': 'volume-f579ad7b-ab63-42e0-ac9e-eb6cbc816c23', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dc9ac32c-8bac-4dd0-a466-989c8e3a4867', 'enforce_multipath': True} {{(pid=87068) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 17:49:40 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-99687889-747f-4a90-abe9-fefa08da60f4 req-2dd5e2c6-c07d-4c0e-aea1-aa4f431f002d tempest-AttachVolumeNegativeTest-577825985 None] attachment_update completed successfully. Nov 06 17:49:41 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-4a58ba39-320a-4ccb-ad87-3988311584a2 tempest-GroupsTest-1140657678 None] Created reservations ['1f99c84a-067a-4788-8e4e-5b7915b16915'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:49:41 devstack sudo[94016]: pam_unix(sudo:session): session closed for user root Nov 06 17:49:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4a58ba39-320a-4ccb-ad87-3988311584a2 tempest-GroupsTest-1140657678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:49:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4a58ba39-320a-4ccb-ad87-3988311584a2 tempest-GroupsTest-1140657678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:49:41 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4a58ba39-320a-4ccb-ad87-3988311584a2 tempest-GroupsTest-1140657678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:49:41 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4a58ba39-320a-4ccb-ad87-3988311584a2 tempest-GroupsTest-1140657678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:49:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4a58ba39-320a-4ccb-ad87-3988311584a2 tempest-GroupsTest-1140657678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:49:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4a58ba39-320a-4ccb-ad87-3988311584a2 tempest-GroupsTest-1140657678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:49:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4be03bdf-75e7-4b5f-8069-df5de95b6db5 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f97df955-02b4-4288-9ec3-eab168b91ee2" returned: 0 in 0.786s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:49:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4be03bdf-75e7-4b5f-8069-df5de95b6db5 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f97df955-02b4-4288-9ec3-eab168b91ee2 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:49:41 devstack sudo[94025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:49:41 devstack sudo[94025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:49:41 devstack sudo[94027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f97df955-02b4-4288-9ec3-eab168b91ee2 Nov 06 17:49:41 devstack sudo[94027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:49:41 devstack sudo[94025]: pam_unix(sudo:session): session closed for user root Nov 06 17:49:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4a58ba39-320a-4ccb-ad87-3988311584a2 tempest-GroupsTest-1140657678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.319s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:49:41 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-4a58ba39-320a-4ccb-ad87-3988311584a2 tempest-GroupsTest-1140657678 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:49:41 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-4a58ba39-320a-4ccb-ad87-3988311584a2 tempest-GroupsTest-1140657678 None] Delete group completed successfully. Nov 06 17:49:41 devstack sudo[94027]: pam_unix(sudo:session): session closed for user root Nov 06 17:49:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4be03bdf-75e7-4b5f-8069-df5de95b6db5 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f97df955-02b4-4288-9ec3-eab168b91ee2" returned: 0 in 0.436s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:49:41 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4be03bdf-75e7-4b5f-8069-df5de95b6db5 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Lock "cinder-quobyte-f97df955-02b4-4288-9ec3-eab168b91ee2" released by "delete_volume" :: held 1.368s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:49:41 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-4be03bdf-75e7-4b5f-8069-df5de95b6db5 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Created reservations ['dfb931ea-7571-4b55-a405-3e037d0e0b28', '4c4b3e36-c3f4-4518-be78-e429a1a4b0dd', 'ac997e48-ddf8-451b-a407-9f1ebf1e76ba', '74042822-4c5b-4c20-831b-77e600c7a3bb'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:49:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4be03bdf-75e7-4b5f-8069-df5de95b6db5 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:49:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4be03bdf-75e7-4b5f-8069-df5de95b6db5 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:49:41 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4be03bdf-75e7-4b5f-8069-df5de95b6db5 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:49:41 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4be03bdf-75e7-4b5f-8069-df5de95b6db5 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:49:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4be03bdf-75e7-4b5f-8069-df5de95b6db5 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:49:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4be03bdf-75e7-4b5f-8069-df5de95b6db5 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:49:41 devstack sudo[94050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:49:41 devstack sudo[94050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:49:41 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-0603c9b5-e41c-42a7-b49d-f2bccee35f5a req-8bed6492-aed3-4de4-abcd-d34c667c7fba tempest-ServerActionsTestOtherA-1480259007 None] Terminate volume connection completed successfully. Nov 06 17:49:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-0603c9b5-e41c-42a7-b49d-f2bccee35f5a req-8bed6492-aed3-4de4-abcd-d34c667c7fba tempest-ServerActionsTestOtherA-1480259007 None] Deleting attachment 8bbea91d-be5f-419e-b646-ab2456d1eb7d. {{(pid=87068) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 17:49:42 devstack sudo[94050]: pam_unix(sudo:session): session closed for user root Nov 06 17:49:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4be03bdf-75e7-4b5f-8069-df5de95b6db5 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.435s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:49:42 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-4be03bdf-75e7-4b5f-8069-df5de95b6db5 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:49:42 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-4be03bdf-75e7-4b5f-8069-df5de95b6db5 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Deleted volume successfully. Nov 06 17:49:42 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4be03bdf-75e7-4b5f-8069-df5de95b6db5 tempest-VolumeSnapshotQuotasNegativeTestJSON-538929705 None] Lock "cinder-f97df955-02b4-4288-9ec3-eab168b91ee2-delete_volume" released by "delete_volume" :: held 2.166s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:49:43 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-8a131aa8-50a4-4c79-ad81-6c004697b084 tempest-GroupsTest-1140657678 None] Group tempest-GroupsTest-Group-124259331: creating Nov 06 17:49:43 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-8a131aa8-50a4-4c79-ad81-6c004697b084 tempest-GroupsTest-1140657678 None] Group tempest-GroupsTest-Group-124259331: created successfully Nov 06 17:49:43 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-8a131aa8-50a4-4c79-ad81-6c004697b084 tempest-GroupsTest-1140657678 None] Create group completed successfully. Nov 06 17:49:43 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-7aac76df-c488-47f5-be23-560512075166 req-d3629e13-3f04-4f0e-8ed7-5f9aa8966aaa tempest-AttachVolumeNegativeTest-577825985 None] Terminate volume connection completed successfully. Nov 06 17:49:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-7aac76df-c488-47f5-be23-560512075166 req-d3629e13-3f04-4f0e-8ed7-5f9aa8966aaa tempest-AttachVolumeNegativeTest-577825985 None] Deleting attachment dc9ac32c-8bac-4dd0-a466-989c8e3a4867. {{(pid=87068) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 17:49:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-0603c9b5-e41c-42a7-b49d-f2bccee35f5a req-2617aac1-1694-4db0-b410-8a215a3c6ac9 tempest-ServerActionsTestOtherA-1480259007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:49:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-0603c9b5-e41c-42a7-b49d-f2bccee35f5a req-2617aac1-1694-4db0-b410-8a215a3c6ac9 tempest-ServerActionsTestOtherA-1480259007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:49:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-0603c9b5-e41c-42a7-b49d-f2bccee35f5a req-2617aac1-1694-4db0-b410-8a215a3c6ac9 tempest-ServerActionsTestOtherA-1480259007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:49:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-0603c9b5-e41c-42a7-b49d-f2bccee35f5a req-2617aac1-1694-4db0-b410-8a215a3c6ac9 tempest-ServerActionsTestOtherA-1480259007 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072', 'name': 'volume-6d1939d4-3ffe-40ee-9bf8-49c5d298eb18', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f3aefb87-2526-4a10-98d2-fade7297c772', 'enforce_multipath': True} {{(pid=87068) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 17:49:44 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-0603c9b5-e41c-42a7-b49d-f2bccee35f5a req-2617aac1-1694-4db0-b410-8a215a3c6ac9 tempest-ServerActionsTestOtherA-1480259007 None] attachment_update completed successfully. Nov 06 17:49:45 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-00822366-b7ff-4e0b-be2d-7296ff4db934 tempest-GroupsTest-1140657678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:49:45 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-00822366-b7ff-4e0b-be2d-7296ff4db934 tempest-GroupsTest-1140657678 None] Flow 'volume_create_manager' (a85a59e7-ac8a-46e4-838f-7b69c5400a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:49:45 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-00822366-b7ff-4e0b-be2d-7296ff4db934 tempest-GroupsTest-1140657678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa9fc090-b0c3-4d07-969d-fa64119eba62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:49:45 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-00822366-b7ff-4e0b-be2d-7296ff4db934 tempest-GroupsTest-1140657678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa9fc090-b0c3-4d07-969d-fa64119eba62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:49:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-876438435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fcf19fd5-4f95-4dc9-ad50-8c9067856c01,host='devstack@QuobyteHD#QuobyteHD',id=9c3f3e86-c4da-4b72-bb75-40bd7b2eeafe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7cedfd1a95f433bb3b8967ee1c61320',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:49:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:49:45Z,use_quota=True,user_id='77b54e1507594eb4a3675cb844aca78a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e562f2f6-5b62-4d9b-baad-5b76bf3faa37),volume_type_id=e562f2f6-5b62-4d9b-baad-5b76bf3faa37)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:49:45 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-00822366-b7ff-4e0b-be2d-7296ff4db934 tempest-GroupsTest-1140657678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4279ba55-9ce9-4a33-a73e-3abe6333ee89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:49:45 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-00822366-b7ff-4e0b-be2d-7296ff4db934 tempest-GroupsTest-1140657678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4279ba55-9ce9-4a33-a73e-3abe6333ee89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:49:45 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-00822366-b7ff-4e0b-be2d-7296ff4db934 tempest-GroupsTest-1140657678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccfac106-e891-491e-9dfe-d847ec4058c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:49:45 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-00822366-b7ff-4e0b-be2d-7296ff4db934 tempest-GroupsTest-1140657678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccfac106-e891-491e-9dfe-d847ec4058c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c3f3e86-c4da-4b72-bb75-40bd7b2eeafe', 'volume_name': 'volume-9c3f3e86-c4da-4b72-bb75-40bd7b2eeafe', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:49:45 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-00822366-b7ff-4e0b-be2d-7296ff4db934 tempest-GroupsTest-1140657678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b30a6068-17c2-429a-9eb1-634236f07cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:49:45 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-00822366-b7ff-4e0b-be2d-7296ff4db934 tempest-GroupsTest-1140657678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b30a6068-17c2-429a-9eb1-634236f07cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:49:45 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-00822366-b7ff-4e0b-be2d-7296ff4db934 tempest-GroupsTest-1140657678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a33e67a-000a-4c0f-9b77-52e3966b8cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:49:45 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-00822366-b7ff-4e0b-be2d-7296ff4db934 tempest-GroupsTest-1140657678 None] Volume 9c3f3e86-c4da-4b72-bb75-40bd7b2eeafe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c3f3e86-c4da-4b72-bb75-40bd7b2eeafe', 'volume_size': 1} Nov 06 17:49:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-00822366-b7ff-4e0b-be2d-7296ff4db934 tempest-GroupsTest-1140657678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:49:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-00822366-b7ff-4e0b-be2d-7296ff4db934 tempest-GroupsTest-1140657678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:49:45 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-00822366-b7ff-4e0b-be2d-7296ff4db934 tempest-GroupsTest-1140657678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fcf19fd5-4f95-4dc9-ad50-8c9067856c01,created_at=2026-11-06T16:49:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-876438435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fcf19fd5-4f95-4dc9-ad50-8c9067856c01,host='devstack@QuobyteHD#QuobyteHD',id=9c3f3e86-c4da-4b72-bb75-40bd7b2eeafe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7cedfd1a95f433bb3b8967ee1c61320',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:49:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:49:45Z,use_quota=True,user_id='77b54e1507594eb4a3675cb844aca78a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e562f2f6-5b62-4d9b-baad-5b76bf3faa37),volume_type_id=e562f2f6-5b62-4d9b-baad-5b76bf3faa37)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:49:45 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-00822366-b7ff-4e0b-be2d-7296ff4db934 tempest-GroupsTest-1140657678 None] Creating volume 9c3f3e86-c4da-4b72-bb75-40bd7b2eeafe {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:49:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-00822366-b7ff-4e0b-be2d-7296ff4db934 tempest-GroupsTest-1140657678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:49:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-00822366-b7ff-4e0b-be2d-7296ff4db934 tempest-GroupsTest-1140657678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:49:45 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-00822366-b7ff-4e0b-be2d-7296ff4db934 tempest-GroupsTest-1140657678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:49:45 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-00822366-b7ff-4e0b-be2d-7296ff4db934 tempest-GroupsTest-1140657678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:49:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-00822366-b7ff-4e0b-be2d-7296ff4db934 tempest-GroupsTest-1140657678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:49:45 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-00822366-b7ff-4e0b-be2d-7296ff4db934 tempest-GroupsTest-1140657678 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:49:45 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-00822366-b7ff-4e0b-be2d-7296ff4db934 tempest-GroupsTest-1140657678 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:49:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-00822366-b7ff-4e0b-be2d-7296ff4db934 tempest-GroupsTest-1140657678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9c3f3e86-c4da-4b72-bb75-40bd7b2eeafe 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:49:45 devstack sudo[94233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9c3f3e86-c4da-4b72-bb75-40bd7b2eeafe 1073741824 Nov 06 17:49:45 devstack sudo[94233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:49:46 devstack sudo[94233]: pam_unix(sudo:session): session closed for user root Nov 06 17:49:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-00822366-b7ff-4e0b-be2d-7296ff4db934 tempest-GroupsTest-1140657678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9c3f3e86-c4da-4b72-bb75-40bd7b2eeafe 1073741824" returned: 0 in 1.159s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:49:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-00822366-b7ff-4e0b-be2d-7296ff4db934 tempest-GroupsTest-1140657678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9c3f3e86-c4da-4b72-bb75-40bd7b2eeafe {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:49:46 devstack sudo[94604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9c3f3e86-c4da-4b72-bb75-40bd7b2eeafe Nov 06 17:49:46 devstack sudo[94604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:49:46 devstack sudo[94604]: pam_unix(sudo:session): session closed for user root Nov 06 17:49:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-00822366-b7ff-4e0b-be2d-7296ff4db934 tempest-GroupsTest-1140657678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9c3f3e86-c4da-4b72-bb75-40bd7b2eeafe" returned: 0 in 0.367s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:49:46 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-00822366-b7ff-4e0b-be2d-7296ff4db934 tempest-GroupsTest-1140657678 None] <== create_volume: return (1657ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:49:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-00822366-b7ff-4e0b-be2d-7296ff4db934 tempest-GroupsTest-1140657678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.663s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:49:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-00822366-b7ff-4e0b-be2d-7296ff4db934 tempest-GroupsTest-1140657678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a33e67a-000a-4c0f-9b77-52e3966b8cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c3f3e86-c4da-4b72-bb75-40bd7b2eeafe', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:49:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-00822366-b7ff-4e0b-be2d-7296ff4db934 tempest-GroupsTest-1140657678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd59c2c8-d113-47da-b4b2-943db4b43960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:49:46 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-00822366-b7ff-4e0b-be2d-7296ff4db934 tempest-GroupsTest-1140657678 None] Volume volume-9c3f3e86-c4da-4b72-bb75-40bd7b2eeafe (9c3f3e86-c4da-4b72-bb75-40bd7b2eeafe): created successfully Nov 06 17:49:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-00822366-b7ff-4e0b-be2d-7296ff4db934 tempest-GroupsTest-1140657678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd59c2c8-d113-47da-b4b2-943db4b43960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:49:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-00822366-b7ff-4e0b-be2d-7296ff4db934 tempest-GroupsTest-1140657678 None] Flow 'volume_create_manager' (a85a59e7-ac8a-46e4-838f-7b69c5400a98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:49:46 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-00822366-b7ff-4e0b-be2d-7296ff4db934 tempest-GroupsTest-1140657678 None] Created volume successfully. Nov 06 17:49:48 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-cee6075d-5c50-4af9-90f0-90df63ca7bc1 tempest-GroupsTest-1140657678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:49:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cee6075d-5c50-4af9-90f0-90df63ca7bc1 tempest-GroupsTest-1140657678 None] Flow 'volume_create_manager' (7b8171f5-abc6-4f77-a8d1-23b494af853e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:49:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cee6075d-5c50-4af9-90f0-90df63ca7bc1 tempest-GroupsTest-1140657678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82e2b32e-0eaa-438e-bfdc-2e6b8efc1661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:49:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cee6075d-5c50-4af9-90f0-90df63ca7bc1 tempest-GroupsTest-1140657678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82e2b32e-0eaa-438e-bfdc-2e6b8efc1661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:49:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1591876761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fcf19fd5-4f95-4dc9-ad50-8c9067856c01,host='devstack@QuobyteHD#QuobyteHD',id=8e3abb2b-4b62-4f5c-aa92-6fcb1f6983e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7cedfd1a95f433bb3b8967ee1c61320',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:49:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:49:49Z,use_quota=True,user_id='77b54e1507594eb4a3675cb844aca78a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e562f2f6-5b62-4d9b-baad-5b76bf3faa37),volume_type_id=e562f2f6-5b62-4d9b-baad-5b76bf3faa37)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:49:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cee6075d-5c50-4af9-90f0-90df63ca7bc1 tempest-GroupsTest-1140657678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b897f419-5557-4333-a464-8276700325bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:49:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cee6075d-5c50-4af9-90f0-90df63ca7bc1 tempest-GroupsTest-1140657678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b897f419-5557-4333-a464-8276700325bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:49:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cee6075d-5c50-4af9-90f0-90df63ca7bc1 tempest-GroupsTest-1140657678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48839aa8-e630-46ff-80e6-71a33f74703a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:49:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cee6075d-5c50-4af9-90f0-90df63ca7bc1 tempest-GroupsTest-1140657678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48839aa8-e630-46ff-80e6-71a33f74703a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e3abb2b-4b62-4f5c-aa92-6fcb1f6983e3', 'volume_name': 'volume-8e3abb2b-4b62-4f5c-aa92-6fcb1f6983e3', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:49:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cee6075d-5c50-4af9-90f0-90df63ca7bc1 tempest-GroupsTest-1140657678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f60f1cc-acab-42ea-9d4c-c1361bffd8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:49:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cee6075d-5c50-4af9-90f0-90df63ca7bc1 tempest-GroupsTest-1140657678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f60f1cc-acab-42ea-9d4c-c1361bffd8f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:49:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cee6075d-5c50-4af9-90f0-90df63ca7bc1 tempest-GroupsTest-1140657678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c20177bd-f705-42a9-8569-b396f8395984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:49:49 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-cee6075d-5c50-4af9-90f0-90df63ca7bc1 tempest-GroupsTest-1140657678 None] Volume 8e3abb2b-4b62-4f5c-aa92-6fcb1f6983e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e3abb2b-4b62-4f5c-aa92-6fcb1f6983e3', 'volume_size': 1} Nov 06 17:49:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cee6075d-5c50-4af9-90f0-90df63ca7bc1 tempest-GroupsTest-1140657678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:49:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cee6075d-5c50-4af9-90f0-90df63ca7bc1 tempest-GroupsTest-1140657678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:49:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-cee6075d-5c50-4af9-90f0-90df63ca7bc1 tempest-GroupsTest-1140657678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fcf19fd5-4f95-4dc9-ad50-8c9067856c01,created_at=2026-11-06T16:49:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1591876761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fcf19fd5-4f95-4dc9-ad50-8c9067856c01,host='devstack@QuobyteHD#QuobyteHD',id=8e3abb2b-4b62-4f5c-aa92-6fcb1f6983e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7cedfd1a95f433bb3b8967ee1c61320',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:49:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:49:49Z,use_quota=True,user_id='77b54e1507594eb4a3675cb844aca78a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e562f2f6-5b62-4d9b-baad-5b76bf3faa37),volume_type_id=e562f2f6-5b62-4d9b-baad-5b76bf3faa37)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:49:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-cee6075d-5c50-4af9-90f0-90df63ca7bc1 tempest-GroupsTest-1140657678 None] Creating volume 8e3abb2b-4b62-4f5c-aa92-6fcb1f6983e3 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:49:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cee6075d-5c50-4af9-90f0-90df63ca7bc1 tempest-GroupsTest-1140657678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:49:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cee6075d-5c50-4af9-90f0-90df63ca7bc1 tempest-GroupsTest-1140657678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:49:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-cee6075d-5c50-4af9-90f0-90df63ca7bc1 tempest-GroupsTest-1140657678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:49:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-cee6075d-5c50-4af9-90f0-90df63ca7bc1 tempest-GroupsTest-1140657678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:49:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cee6075d-5c50-4af9-90f0-90df63ca7bc1 tempest-GroupsTest-1140657678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:49:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-cee6075d-5c50-4af9-90f0-90df63ca7bc1 tempest-GroupsTest-1140657678 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:49:49 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-cee6075d-5c50-4af9-90f0-90df63ca7bc1 tempest-GroupsTest-1140657678 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:49:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cee6075d-5c50-4af9-90f0-90df63ca7bc1 tempest-GroupsTest-1140657678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8e3abb2b-4b62-4f5c-aa92-6fcb1f6983e3 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:49:49 devstack sudo[94614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8e3abb2b-4b62-4f5c-aa92-6fcb1f6983e3 1073741824 Nov 06 17:49:49 devstack sudo[94614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:49:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cee6075d-5c50-4af9-90f0-90df63ca7bc1 tempest-GroupsTest-1140657678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8e3abb2b-4b62-4f5c-aa92-6fcb1f6983e3 1073741824" returned: 0 in 0.887s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:49:50 devstack sudo[94614]: pam_unix(sudo:session): session closed for user root Nov 06 17:49:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cee6075d-5c50-4af9-90f0-90df63ca7bc1 tempest-GroupsTest-1140657678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8e3abb2b-4b62-4f5c-aa92-6fcb1f6983e3 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:49:50 devstack sudo[94622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8e3abb2b-4b62-4f5c-aa92-6fcb1f6983e3 Nov 06 17:49:50 devstack sudo[94622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:49:50 devstack sudo[94622]: pam_unix(sudo:session): session closed for user root Nov 06 17:49:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cee6075d-5c50-4af9-90f0-90df63ca7bc1 tempest-GroupsTest-1140657678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8e3abb2b-4b62-4f5c-aa92-6fcb1f6983e3" returned: 0 in 0.586s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:49:50 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-cee6075d-5c50-4af9-90f0-90df63ca7bc1 tempest-GroupsTest-1140657678 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:49:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cee6075d-5c50-4af9-90f0-90df63ca7bc1 tempest-GroupsTest-1140657678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.570s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:49:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cee6075d-5c50-4af9-90f0-90df63ca7bc1 tempest-GroupsTest-1140657678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c20177bd-f705-42a9-8569-b396f8395984) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e3abb2b-4b62-4f5c-aa92-6fcb1f6983e3', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:49:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cee6075d-5c50-4af9-90f0-90df63ca7bc1 tempest-GroupsTest-1140657678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53c28999-9c61-45f3-830c-3ecb9c65bb2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:49:50 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-cee6075d-5c50-4af9-90f0-90df63ca7bc1 tempest-GroupsTest-1140657678 None] Volume volume-8e3abb2b-4b62-4f5c-aa92-6fcb1f6983e3 (8e3abb2b-4b62-4f5c-aa92-6fcb1f6983e3): created successfully Nov 06 17:49:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cee6075d-5c50-4af9-90f0-90df63ca7bc1 tempest-GroupsTest-1140657678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53c28999-9c61-45f3-830c-3ecb9c65bb2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:49:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cee6075d-5c50-4af9-90f0-90df63ca7bc1 tempest-GroupsTest-1140657678 None] Flow 'volume_create_manager' (7b8171f5-abc6-4f77-a8d1-23b494af853e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:49:50 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-cee6075d-5c50-4af9-90f0-90df63ca7bc1 tempest-GroupsTest-1140657678 None] Created volume successfully. Nov 06 17:49:52 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-b145670b-76eb-4010-9f32-0dbf6f497608 tempest-GroupsTest-1140657678 None] Update group completed successfully. Nov 06 17:49:54 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-646ff44f-31c1-4753-84ba-f50775b3c1d9 tempest-GroupsTest-1140657678 None] Update group completed successfully. Nov 06 17:49:54 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 17:49:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:49:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:49:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:49:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:49:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:49:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:49:54 devstack sudo[94645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:49:54 devstack sudo[94645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:49:54 devstack sudo[94645]: pam_unix(sudo:session): session closed for user root Nov 06 17:49:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.367s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:49:54 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:49:54 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running periodic task VolumeManager._thread_info {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 17:49:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] thread count: 28 {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 17:49:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] thread info: [<_MainThread(MainThread, started 133940619505792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 17:49:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2ebc1334-51b6-4a21-99a2-3e5f3ae7a8ac tempest-GroupsTest-1140657678 None] Acquiring lock "cinder-quobyte-8e3abb2b-4b62-4f5c-aa92-6fcb1f6983e3" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:49:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2ebc1334-51b6-4a21-99a2-3e5f3ae7a8ac tempest-GroupsTest-1140657678 None] Lock "cinder-quobyte-8e3abb2b-4b62-4f5c-aa92-6fcb1f6983e3" acquired by "delete_volume" :: waited 0.036s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:49:56 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bafd783-5939-4311-b0bf-39e7c3a0a3b0]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:49:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2ebc1334-51b6-4a21-99a2-3e5f3ae7a8ac tempest-GroupsTest-1140657678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8e3abb2b-4b62-4f5c-aa92-6fcb1f6983e3 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:49:56 devstack sudo[94648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8e3abb2b-4b62-4f5c-aa92-6fcb1f6983e3 Nov 06 17:49:56 devstack sudo[94648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:49:56 devstack sudo[94648]: pam_unix(sudo:session): session closed for user root Nov 06 17:49:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2ebc1334-51b6-4a21-99a2-3e5f3ae7a8ac tempest-GroupsTest-1140657678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8e3abb2b-4b62-4f5c-aa92-6fcb1f6983e3" returned: 0 in 0.477s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:49:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2ebc1334-51b6-4a21-99a2-3e5f3ae7a8ac tempest-GroupsTest-1140657678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8e3abb2b-4b62-4f5c-aa92-6fcb1f6983e3 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:49:56 devstack sudo[94653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8e3abb2b-4b62-4f5c-aa92-6fcb1f6983e3 Nov 06 17:49:56 devstack sudo[94653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:49:56 devstack sudo[94653]: pam_unix(sudo:session): session closed for user root Nov 06 17:49:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2ebc1334-51b6-4a21-99a2-3e5f3ae7a8ac tempest-GroupsTest-1140657678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8e3abb2b-4b62-4f5c-aa92-6fcb1f6983e3" returned: 0 in 0.418s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:49:56 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2ebc1334-51b6-4a21-99a2-3e5f3ae7a8ac tempest-GroupsTest-1140657678 None] Lock "cinder-quobyte-8e3abb2b-4b62-4f5c-aa92-6fcb1f6983e3" released by "delete_volume" :: held 0.993s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:49:56 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2ebc1334-51b6-4a21-99a2-3e5f3ae7a8ac tempest-GroupsTest-1140657678 None] Acquiring lock "cinder-quobyte-9c3f3e86-c4da-4b72-bb75-40bd7b2eeafe" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:49:56 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2ebc1334-51b6-4a21-99a2-3e5f3ae7a8ac tempest-GroupsTest-1140657678 None] Lock "cinder-quobyte-9c3f3e86-c4da-4b72-bb75-40bd7b2eeafe" acquired by "delete_volume" :: waited 0.025s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:49:56 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb60803d-d782-4d7f-8cee-807c362200b4]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:49:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2ebc1334-51b6-4a21-99a2-3e5f3ae7a8ac tempest-GroupsTest-1140657678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9c3f3e86-c4da-4b72-bb75-40bd7b2eeafe {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:49:57 devstack sudo[94659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9c3f3e86-c4da-4b72-bb75-40bd7b2eeafe Nov 06 17:49:57 devstack sudo[94659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:49:57 devstack sudo[94659]: pam_unix(sudo:session): session closed for user root Nov 06 17:49:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2ebc1334-51b6-4a21-99a2-3e5f3ae7a8ac tempest-GroupsTest-1140657678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9c3f3e86-c4da-4b72-bb75-40bd7b2eeafe" returned: 0 in 0.622s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:49:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2ebc1334-51b6-4a21-99a2-3e5f3ae7a8ac tempest-GroupsTest-1140657678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9c3f3e86-c4da-4b72-bb75-40bd7b2eeafe {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:49:57 devstack sudo[94664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9c3f3e86-c4da-4b72-bb75-40bd7b2eeafe Nov 06 17:49:57 devstack sudo[94664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:49:58 devstack sudo[94664]: pam_unix(sudo:session): session closed for user root Nov 06 17:49:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2ebc1334-51b6-4a21-99a2-3e5f3ae7a8ac tempest-GroupsTest-1140657678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9c3f3e86-c4da-4b72-bb75-40bd7b2eeafe" returned: 0 in 0.566s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:49:58 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2ebc1334-51b6-4a21-99a2-3e5f3ae7a8ac tempest-GroupsTest-1140657678 None] Lock "cinder-quobyte-9c3f3e86-c4da-4b72-bb75-40bd7b2eeafe" released by "delete_volume" :: held 1.256s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:49:58 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-2ebc1334-51b6-4a21-99a2-3e5f3ae7a8ac tempest-GroupsTest-1140657678 None] Created reservations ['f770731c-c805-4aee-9328-a8baa3671619'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:49:58 devstack cinder-volume[87068]: WARNING cinder.quota [None req-2ebc1334-51b6-4a21-99a2-3e5f3ae7a8ac tempest-GroupsTest-1140657678 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1503149718 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1503149718, it is now deprecated. Please use the default quota class for default quota. Nov 06 17:49:58 devstack cinder-volume[87068]: WARNING cinder.quota [None req-2ebc1334-51b6-4a21-99a2-3e5f3ae7a8ac tempest-GroupsTest-1140657678 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1503149718 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1503149718, it is now deprecated. Please use the default quota class for default quota. Nov 06 17:49:58 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-2ebc1334-51b6-4a21-99a2-3e5f3ae7a8ac tempest-GroupsTest-1140657678 None] Created reservations ['8306178f-4a9f-4a73-8193-48ad497effd8', '6312f663-553b-4e50-8443-014bbea7f03e', '885f752a-c9b4-4156-8733-d00b8bda9997', '20ff1214-2022-4513-ae1a-45f358a56cab'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:49:58 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-2ebc1334-51b6-4a21-99a2-3e5f3ae7a8ac tempest-GroupsTest-1140657678 None] Created reservations ['e0fafeaf-78a8-495a-9498-50dd1ccc4804', '85f81ada-d9a9-4ae7-9268-036010bc1742', '8af99900-013c-448c-9525-3130b6d44c64', '19f3c725-e47f-400c-ad6a-49a25394b9e4'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:49:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2ebc1334-51b6-4a21-99a2-3e5f3ae7a8ac tempest-GroupsTest-1140657678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:49:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2ebc1334-51b6-4a21-99a2-3e5f3ae7a8ac tempest-GroupsTest-1140657678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:49:58 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2ebc1334-51b6-4a21-99a2-3e5f3ae7a8ac tempest-GroupsTest-1140657678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:49:58 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2ebc1334-51b6-4a21-99a2-3e5f3ae7a8ac tempest-GroupsTest-1140657678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:49:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2ebc1334-51b6-4a21-99a2-3e5f3ae7a8ac tempest-GroupsTest-1140657678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:49:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2ebc1334-51b6-4a21-99a2-3e5f3ae7a8ac tempest-GroupsTest-1140657678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:49:58 devstack sudo[94668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:49:58 devstack sudo[94668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:49:59 devstack sudo[94668]: pam_unix(sudo:session): session closed for user root Nov 06 17:49:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2ebc1334-51b6-4a21-99a2-3e5f3ae7a8ac tempest-GroupsTest-1140657678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.419s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:49:59 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-2ebc1334-51b6-4a21-99a2-3e5f3ae7a8ac tempest-GroupsTest-1140657678 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:49:59 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-2ebc1334-51b6-4a21-99a2-3e5f3ae7a8ac tempest-GroupsTest-1140657678 None] Delete group completed successfully. Nov 06 17:50:08 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=56,cinder:UPDATE=65,cinder:DELETE=2,cinder:INSERT=10 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 17:50:08 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=71,cinder:UPDATE=61,cinder:INSERT=17,cinder:DELETE=4 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 17:50:11 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad5108ae-a64c-4db7-bee8-fdb79b4a0e5a tempest-SnapshotsActionsTest-284033357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:50:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ad5108ae-a64c-4db7-bee8-fdb79b4a0e5a tempest-SnapshotsActionsTest-284033357 None] Flow 'volume_create_manager' (70ea8f5d-9ee9-4981-bc56-f070f4266afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:50:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ad5108ae-a64c-4db7-bee8-fdb79b4a0e5a tempest-SnapshotsActionsTest-284033357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bd3168c-1884-4159-a48e-5ea77d5148db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:50:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ad5108ae-a64c-4db7-bee8-fdb79b4a0e5a tempest-SnapshotsActionsTest-284033357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bd3168c-1884-4159-a48e-5ea77d5148db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:50:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2044265502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d50918bc-f0e8-4572-bceb-84e9d767c65e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='662859cea66e4f348caf81d69c939692',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:50:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:50:11Z,use_quota=True,user_id='39f81e5ae3694c1480155822f1fceb44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:50:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ad5108ae-a64c-4db7-bee8-fdb79b4a0e5a tempest-SnapshotsActionsTest-284033357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b52613f1-adf4-4b6b-ab86-f0f347ad2c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:50:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ad5108ae-a64c-4db7-bee8-fdb79b4a0e5a tempest-SnapshotsActionsTest-284033357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b52613f1-adf4-4b6b-ab86-f0f347ad2c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:50:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ad5108ae-a64c-4db7-bee8-fdb79b4a0e5a tempest-SnapshotsActionsTest-284033357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2425bb6-6507-4d6a-a069-400a89e8a468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:50:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ad5108ae-a64c-4db7-bee8-fdb79b4a0e5a tempest-SnapshotsActionsTest-284033357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2425bb6-6507-4d6a-a069-400a89e8a468) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd50918bc-f0e8-4572-bceb-84e9d767c65e', 'volume_name': 'volume-d50918bc-f0e8-4572-bceb-84e9d767c65e', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:50:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ad5108ae-a64c-4db7-bee8-fdb79b4a0e5a tempest-SnapshotsActionsTest-284033357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42cff6e6-1468-4116-992c-e03afe3c8e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:50:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ad5108ae-a64c-4db7-bee8-fdb79b4a0e5a tempest-SnapshotsActionsTest-284033357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42cff6e6-1468-4116-992c-e03afe3c8e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:50:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ad5108ae-a64c-4db7-bee8-fdb79b4a0e5a tempest-SnapshotsActionsTest-284033357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a339776-1274-4320-bb4c-0d45bcba0d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:50:11 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-ad5108ae-a64c-4db7-bee8-fdb79b4a0e5a tempest-SnapshotsActionsTest-284033357 None] Volume d50918bc-f0e8-4572-bceb-84e9d767c65e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d50918bc-f0e8-4572-bceb-84e9d767c65e', 'volume_size': 1} Nov 06 17:50:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ad5108ae-a64c-4db7-bee8-fdb79b4a0e5a tempest-SnapshotsActionsTest-284033357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:50:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ad5108ae-a64c-4db7-bee8-fdb79b4a0e5a tempest-SnapshotsActionsTest-284033357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:50:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ad5108ae-a64c-4db7-bee8-fdb79b4a0e5a tempest-SnapshotsActionsTest-284033357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:50:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2044265502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d50918bc-f0e8-4572-bceb-84e9d767c65e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='662859cea66e4f348caf81d69c939692',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:50:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:50:11Z,use_quota=True,user_id='39f81e5ae3694c1480155822f1fceb44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:50:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-ad5108ae-a64c-4db7-bee8-fdb79b4a0e5a tempest-SnapshotsActionsTest-284033357 None] Creating volume d50918bc-f0e8-4572-bceb-84e9d767c65e {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:50:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ad5108ae-a64c-4db7-bee8-fdb79b4a0e5a tempest-SnapshotsActionsTest-284033357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:50:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ad5108ae-a64c-4db7-bee8-fdb79b4a0e5a tempest-SnapshotsActionsTest-284033357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:50:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ad5108ae-a64c-4db7-bee8-fdb79b4a0e5a tempest-SnapshotsActionsTest-284033357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:50:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ad5108ae-a64c-4db7-bee8-fdb79b4a0e5a tempest-SnapshotsActionsTest-284033357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:50:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ad5108ae-a64c-4db7-bee8-fdb79b4a0e5a tempest-SnapshotsActionsTest-284033357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:50:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ad5108ae-a64c-4db7-bee8-fdb79b4a0e5a tempest-SnapshotsActionsTest-284033357 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:50:11 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-ad5108ae-a64c-4db7-bee8-fdb79b4a0e5a tempest-SnapshotsActionsTest-284033357 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:50:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ad5108ae-a64c-4db7-bee8-fdb79b4a0e5a tempest-SnapshotsActionsTest-284033357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:11 devstack sudo[94801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e 1073741824 Nov 06 17:50:11 devstack sudo[94801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:11 devstack sudo[94801]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ad5108ae-a64c-4db7-bee8-fdb79b4a0e5a tempest-SnapshotsActionsTest-284033357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e 1073741824" returned: 0 in 0.469s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ad5108ae-a64c-4db7-bee8-fdb79b4a0e5a tempest-SnapshotsActionsTest-284033357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:12 devstack sudo[94807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e Nov 06 17:50:12 devstack sudo[94807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:12 devstack sudo[94807]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ad5108ae-a64c-4db7-bee8-fdb79b4a0e5a tempest-SnapshotsActionsTest-284033357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e" returned: 0 in 0.292s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:12 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ad5108ae-a64c-4db7-bee8-fdb79b4a0e5a tempest-SnapshotsActionsTest-284033357 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:50:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ad5108ae-a64c-4db7-bee8-fdb79b4a0e5a tempest-SnapshotsActionsTest-284033357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:50:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ad5108ae-a64c-4db7-bee8-fdb79b4a0e5a tempest-SnapshotsActionsTest-284033357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a339776-1274-4320-bb4c-0d45bcba0d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d50918bc-f0e8-4572-bceb-84e9d767c65e', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:50:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ad5108ae-a64c-4db7-bee8-fdb79b4a0e5a tempest-SnapshotsActionsTest-284033357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b731687-90b0-4d21-804b-87dca87a95dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:50:12 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-ad5108ae-a64c-4db7-bee8-fdb79b4a0e5a tempest-SnapshotsActionsTest-284033357 None] Volume volume-d50918bc-f0e8-4572-bceb-84e9d767c65e (d50918bc-f0e8-4572-bceb-84e9d767c65e): created successfully Nov 06 17:50:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ad5108ae-a64c-4db7-bee8-fdb79b4a0e5a tempest-SnapshotsActionsTest-284033357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b731687-90b0-4d21-804b-87dca87a95dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:50:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ad5108ae-a64c-4db7-bee8-fdb79b4a0e5a tempest-SnapshotsActionsTest-284033357 None] Flow 'volume_create_manager' (70ea8f5d-9ee9-4981-bc56-f070f4266afe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:50:12 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-ad5108ae-a64c-4db7-bee8-fdb79b4a0e5a tempest-SnapshotsActionsTest-284033357 None] Created volume successfully. Nov 06 17:50:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b59a80d2-5ed6-4faa-a4a2-d0ba691fdea3 tempest-SnapshotsActionsTest-284033357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:50:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b59a80d2-5ed6-4faa-a4a2-d0ba691fdea3 tempest-SnapshotsActionsTest-284033357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:50:13 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-b59a80d2-5ed6-4faa-a4a2-d0ba691fdea3 tempest-SnapshotsActionsTest-284033357 None] Creating offline snapshot 92a02276-7ba6-4d17-bd33-79a5f5824240 of volume d50918bc-f0e8-4572-bceb-84e9d767c65e {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 17:50:13 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c850028-3ad2-478e-8e39-54398f022072]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:50:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b59a80d2-5ed6-4faa-a4a2-d0ba691fdea3 tempest-SnapshotsActionsTest-284033357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:14 devstack sudo[94811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e Nov 06 17:50:14 devstack sudo[94811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:14 devstack sudo[94811]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b59a80d2-5ed6-4faa-a4a2-d0ba691fdea3 tempest-SnapshotsActionsTest-284033357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e" returned: 0 in 0.440s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b59a80d2-5ed6-4faa-a4a2-d0ba691fdea3 tempest-SnapshotsActionsTest-284033357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:14 devstack sudo[94817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240 1G Nov 06 17:50:14 devstack sudo[94817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:14 devstack sudo[94817]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b59a80d2-5ed6-4faa-a4a2-d0ba691fdea3 tempest-SnapshotsActionsTest-284033357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240 1G" returned: 0 in 0.591s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b59a80d2-5ed6-4faa-a4a2-d0ba691fdea3 tempest-SnapshotsActionsTest-284033357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d50918bc-f0e8-4572-bceb-84e9d767c65e -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:14 devstack sudo[94823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d50918bc-f0e8-4572-bceb-84e9d767c65e -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240 Nov 06 17:50:14 devstack sudo[94823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:15 devstack sudo[94823]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b59a80d2-5ed6-4faa-a4a2-d0ba691fdea3 tempest-SnapshotsActionsTest-284033357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d50918bc-f0e8-4572-bceb-84e9d767c65e -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240" returned: 0 in 0.359s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:15 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-b59a80d2-5ed6-4faa-a4a2-d0ba691fdea3 tempest-SnapshotsActionsTest-284033357 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240 is being set with open permissions: ugo+rw Nov 06 17:50:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b59a80d2-5ed6-4faa-a4a2-d0ba691fdea3 tempest-SnapshotsActionsTest-284033357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:15 devstack sudo[94828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240 Nov 06 17:50:15 devstack sudo[94828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:15 devstack sudo[94828]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b59a80d2-5ed6-4faa-a4a2-d0ba691fdea3 tempest-SnapshotsActionsTest-284033357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240" returned: 0 in 0.331s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b59a80d2-5ed6-4faa-a4a2-d0ba691fdea3 tempest-SnapshotsActionsTest-284033357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:15 devstack sudo[94831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.info Nov 06 17:50:15 devstack sudo[94831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:15 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-48510b89-7930-4ee4-b3f6-41163ec7fd1e tempest-VolumesListAdminTestJSON-209193959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:50:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-48510b89-7930-4ee4-b3f6-41163ec7fd1e tempest-VolumesListAdminTestJSON-209193959 None] Flow 'volume_create_manager' (91ac56fd-1da6-48f8-9ffb-45ab169d15ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:50:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-48510b89-7930-4ee4-b3f6-41163ec7fd1e tempest-VolumesListAdminTestJSON-209193959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (506467ec-2682-4271-8db0-caf7a5501c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:50:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-48510b89-7930-4ee4-b3f6-41163ec7fd1e tempest-VolumesListAdminTestJSON-209193959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (506467ec-2682-4271-8db0-caf7a5501c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:50:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1738122585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bf6244d-0066-4a18-bddc-eb0900dd7864,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9eb03bc862844a82af48b67d57f82b59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:50:16Z,use_quota=True,user_id='53f854eeca9e4044b4b6fd3cf17c28e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:50:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-48510b89-7930-4ee4-b3f6-41163ec7fd1e tempest-VolumesListAdminTestJSON-209193959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc2c4726-1da7-4a02-b0d9-713e16181e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:50:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-48510b89-7930-4ee4-b3f6-41163ec7fd1e tempest-VolumesListAdminTestJSON-209193959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc2c4726-1da7-4a02-b0d9-713e16181e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:50:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-48510b89-7930-4ee4-b3f6-41163ec7fd1e tempest-VolumesListAdminTestJSON-209193959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56ab8d76-2a5b-4d7f-a79c-90b53582b36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:50:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-48510b89-7930-4ee4-b3f6-41163ec7fd1e tempest-VolumesListAdminTestJSON-209193959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56ab8d76-2a5b-4d7f-a79c-90b53582b36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bf6244d-0066-4a18-bddc-eb0900dd7864', 'volume_name': 'volume-4bf6244d-0066-4a18-bddc-eb0900dd7864', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:50:15 devstack sudo[94831]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-48510b89-7930-4ee4-b3f6-41163ec7fd1e tempest-VolumesListAdminTestJSON-209193959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ede1fb71-3eb2-4de6-8f91-48b7ce82c296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:50:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-48510b89-7930-4ee4-b3f6-41163ec7fd1e tempest-VolumesListAdminTestJSON-209193959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ede1fb71-3eb2-4de6-8f91-48b7ce82c296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:50:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-48510b89-7930-4ee4-b3f6-41163ec7fd1e tempest-VolumesListAdminTestJSON-209193959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9808eb5-1138-4341-aa68-5cf425f473c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:50:15 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-48510b89-7930-4ee4-b3f6-41163ec7fd1e tempest-VolumesListAdminTestJSON-209193959 None] Volume 4bf6244d-0066-4a18-bddc-eb0900dd7864: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bf6244d-0066-4a18-bddc-eb0900dd7864', 'volume_size': 1} Nov 06 17:50:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-48510b89-7930-4ee4-b3f6-41163ec7fd1e tempest-VolumesListAdminTestJSON-209193959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:50:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b59a80d2-5ed6-4faa-a4a2-d0ba691fdea3 tempest-SnapshotsActionsTest-284033357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.info" returned: 0 in 0.334s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:15 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-b59a80d2-5ed6-4faa-a4a2-d0ba691fdea3 tempest-SnapshotsActionsTest-284033357 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.info is being set with open permissions: ugo+rw Nov 06 17:50:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b59a80d2-5ed6-4faa-a4a2-d0ba691fdea3 tempest-SnapshotsActionsTest-284033357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:16 devstack sudo[94834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.info Nov 06 17:50:16 devstack sudo[94834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:16 devstack sudo[94834]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b59a80d2-5ed6-4faa-a4a2-d0ba691fdea3 tempest-SnapshotsActionsTest-284033357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.info" returned: 0 in 0.294s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b59a80d2-5ed6-4faa-a4a2-d0ba691fdea3 tempest-SnapshotsActionsTest-284033357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.479s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:50:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-48510b89-7930-4ee4-b3f6-41163ec7fd1e tempest-VolumesListAdminTestJSON-209193959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.321s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:50:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-48510b89-7930-4ee4-b3f6-41163ec7fd1e tempest-VolumesListAdminTestJSON-209193959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:50:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1738122585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bf6244d-0066-4a18-bddc-eb0900dd7864,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9eb03bc862844a82af48b67d57f82b59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:50:16Z,use_quota=True,user_id='53f854eeca9e4044b4b6fd3cf17c28e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:50:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-48510b89-7930-4ee4-b3f6-41163ec7fd1e tempest-VolumesListAdminTestJSON-209193959 None] Creating volume 4bf6244d-0066-4a18-bddc-eb0900dd7864 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:50:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-48510b89-7930-4ee4-b3f6-41163ec7fd1e tempest-VolumesListAdminTestJSON-209193959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:50:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-48510b89-7930-4ee4-b3f6-41163ec7fd1e tempest-VolumesListAdminTestJSON-209193959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:50:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-48510b89-7930-4ee4-b3f6-41163ec7fd1e tempest-VolumesListAdminTestJSON-209193959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:50:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-48510b89-7930-4ee4-b3f6-41163ec7fd1e tempest-VolumesListAdminTestJSON-209193959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:50:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-48510b89-7930-4ee4-b3f6-41163ec7fd1e tempest-VolumesListAdminTestJSON-209193959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:50:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-48510b89-7930-4ee4-b3f6-41163ec7fd1e tempest-VolumesListAdminTestJSON-209193959 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:50:16 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-48510b89-7930-4ee4-b3f6-41163ec7fd1e tempest-VolumesListAdminTestJSON-209193959 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:50:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-48510b89-7930-4ee4-b3f6-41163ec7fd1e tempest-VolumesListAdminTestJSON-209193959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4bf6244d-0066-4a18-bddc-eb0900dd7864 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:16 devstack sudo[94846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4bf6244d-0066-4a18-bddc-eb0900dd7864 1073741824 Nov 06 17:50:16 devstack sudo[94846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:16 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-b59a80d2-5ed6-4faa-a4a2-d0ba691fdea3 tempest-SnapshotsActionsTest-284033357 None] Create snapshot completed successfully Nov 06 17:50:17 devstack sudo[94846]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-48510b89-7930-4ee4-b3f6-41163ec7fd1e tempest-VolumesListAdminTestJSON-209193959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4bf6244d-0066-4a18-bddc-eb0900dd7864 1073741824" returned: 0 in 0.755s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-48510b89-7930-4ee4-b3f6-41163ec7fd1e tempest-VolumesListAdminTestJSON-209193959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4bf6244d-0066-4a18-bddc-eb0900dd7864 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:17 devstack sudo[94853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4bf6244d-0066-4a18-bddc-eb0900dd7864 Nov 06 17:50:17 devstack sudo[94853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:17 devstack sudo[94853]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-48510b89-7930-4ee4-b3f6-41163ec7fd1e tempest-VolumesListAdminTestJSON-209193959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4bf6244d-0066-4a18-bddc-eb0900dd7864" returned: 0 in 0.353s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-48510b89-7930-4ee4-b3f6-41163ec7fd1e tempest-VolumesListAdminTestJSON-209193959 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:50:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-48510b89-7930-4ee4-b3f6-41163ec7fd1e tempest-VolumesListAdminTestJSON-209193959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.207s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:50:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-48510b89-7930-4ee4-b3f6-41163ec7fd1e tempest-VolumesListAdminTestJSON-209193959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9808eb5-1138-4341-aa68-5cf425f473c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bf6244d-0066-4a18-bddc-eb0900dd7864', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:50:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-48510b89-7930-4ee4-b3f6-41163ec7fd1e tempest-VolumesListAdminTestJSON-209193959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c4b1e48-f0d2-479b-a065-8092a81d1d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:50:17 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-48510b89-7930-4ee4-b3f6-41163ec7fd1e tempest-VolumesListAdminTestJSON-209193959 None] Volume volume-4bf6244d-0066-4a18-bddc-eb0900dd7864 (4bf6244d-0066-4a18-bddc-eb0900dd7864): created successfully Nov 06 17:50:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-48510b89-7930-4ee4-b3f6-41163ec7fd1e tempest-VolumesListAdminTestJSON-209193959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c4b1e48-f0d2-479b-a065-8092a81d1d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:50:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-48510b89-7930-4ee4-b3f6-41163ec7fd1e tempest-VolumesListAdminTestJSON-209193959 None] Flow 'volume_create_manager' (91ac56fd-1da6-48f8-9ffb-45ab169d15ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:50:17 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-48510b89-7930-4ee4-b3f6-41163ec7fd1e tempest-VolumesListAdminTestJSON-209193959 None] Created volume successfully. Nov 06 17:50:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5561d9c1-df71-4c68-9b31-191e0e5c8f2d tempest-SnapshotsActionsTest-284033357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:50:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5561d9c1-df71-4c68-9b31-191e0e5c8f2d tempest-SnapshotsActionsTest-284033357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:50:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-5561d9c1-df71-4c68-9b31-191e0e5c8f2d tempest-SnapshotsActionsTest-284033357 None] Creating offline snapshot cecba221-75e3-4d32-b672-f89037a61be7 of volume d50918bc-f0e8-4572-bceb-84e9d767c65e {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 17:50:18 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede15a32-7df1-4e7d-935a-57c066b28385]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:50:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5561d9c1-df71-4c68-9b31-191e0e5c8f2d tempest-SnapshotsActionsTest-284033357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:18 devstack sudo[94873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240 Nov 06 17:50:18 devstack sudo[94873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:18 devstack sudo[94873]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5561d9c1-df71-4c68-9b31-191e0e5c8f2d tempest-SnapshotsActionsTest-284033357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240" returned: 0 in 0.668s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:18 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-5561d9c1-df71-4c68-9b31-191e0e5c8f2d tempest-SnapshotsActionsTest-284033357 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d50918bc-f0e8-4572-bceb-84e9d767c65e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 17:50:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5561d9c1-df71-4c68-9b31-191e0e5c8f2d tempest-SnapshotsActionsTest-284033357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.cecba221-75e3-4d32-b672-f89037a61be7 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:18 devstack sudo[94906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.cecba221-75e3-4d32-b672-f89037a61be7 1G Nov 06 17:50:18 devstack sudo[94906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:19 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c17d977-f9a9-4f78-b88e-6d075b08098a tempest-VolumesListAdminTestJSON-209193959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:50:19 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2c17d977-f9a9-4f78-b88e-6d075b08098a tempest-VolumesListAdminTestJSON-209193959 None] Flow 'volume_create_manager' (96c3f937-0cf0-4eac-baf2-4c7146ae9b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:50:19 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2c17d977-f9a9-4f78-b88e-6d075b08098a tempest-VolumesListAdminTestJSON-209193959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (241a1ac7-de09-4f84-9375-e31722aaa06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:50:19 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2c17d977-f9a9-4f78-b88e-6d075b08098a tempest-VolumesListAdminTestJSON-209193959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (241a1ac7-de09-4f84-9375-e31722aaa06f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-186619271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21ed33a0-06a6-4119-b858-e2f5f486be5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9eb03bc862844a82af48b67d57f82b59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:50:19Z,use_quota=True,user_id='53f854eeca9e4044b4b6fd3cf17c28e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:50:19 devstack sudo[94906]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:19 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2c17d977-f9a9-4f78-b88e-6d075b08098a tempest-VolumesListAdminTestJSON-209193959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b576eec3-86ca-42ba-9f43-76894a3aa308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:50:19 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2c17d977-f9a9-4f78-b88e-6d075b08098a tempest-VolumesListAdminTestJSON-209193959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b576eec3-86ca-42ba-9f43-76894a3aa308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:50:19 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2c17d977-f9a9-4f78-b88e-6d075b08098a tempest-VolumesListAdminTestJSON-209193959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c70e153-9f73-43db-b521-67663bafd8b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:50:19 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2c17d977-f9a9-4f78-b88e-6d075b08098a tempest-VolumesListAdminTestJSON-209193959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c70e153-9f73-43db-b521-67663bafd8b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21ed33a0-06a6-4119-b858-e2f5f486be5e', 'volume_name': 'volume-21ed33a0-06a6-4119-b858-e2f5f486be5e', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:50:19 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2c17d977-f9a9-4f78-b88e-6d075b08098a tempest-VolumesListAdminTestJSON-209193959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17bb2447-8365-4d5d-b48f-35ba465817f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:50:19 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2c17d977-f9a9-4f78-b88e-6d075b08098a tempest-VolumesListAdminTestJSON-209193959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17bb2447-8365-4d5d-b48f-35ba465817f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:50:19 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2c17d977-f9a9-4f78-b88e-6d075b08098a tempest-VolumesListAdminTestJSON-209193959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe7733e7-40a2-4519-9dfb-5a6623305a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:50:19 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-2c17d977-f9a9-4f78-b88e-6d075b08098a tempest-VolumesListAdminTestJSON-209193959 None] Volume 21ed33a0-06a6-4119-b858-e2f5f486be5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21ed33a0-06a6-4119-b858-e2f5f486be5e', 'volume_size': 1} Nov 06 17:50:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2c17d977-f9a9-4f78-b88e-6d075b08098a tempest-VolumesListAdminTestJSON-209193959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:50:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5561d9c1-df71-4c68-9b31-191e0e5c8f2d tempest-SnapshotsActionsTest-284033357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.cecba221-75e3-4d32-b672-f89037a61be7 1G" returned: 0 in 0.706s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5561d9c1-df71-4c68-9b31-191e0e5c8f2d tempest-SnapshotsActionsTest-284033357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.cecba221-75e3-4d32-b672-f89037a61be7 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:19 devstack sudo[94914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.cecba221-75e3-4d32-b672-f89037a61be7 Nov 06 17:50:19 devstack sudo[94914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:19 devstack sudo[94914]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5561d9c1-df71-4c68-9b31-191e0e5c8f2d tempest-SnapshotsActionsTest-284033357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.cecba221-75e3-4d32-b672-f89037a61be7" returned: 0 in 0.336s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:19 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-5561d9c1-df71-4c68-9b31-191e0e5c8f2d tempest-SnapshotsActionsTest-284033357 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.cecba221-75e3-4d32-b672-f89037a61be7 is being set with open permissions: ugo+rw Nov 06 17:50:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5561d9c1-df71-4c68-9b31-191e0e5c8f2d tempest-SnapshotsActionsTest-284033357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.cecba221-75e3-4d32-b672-f89037a61be7 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:19 devstack sudo[94920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.cecba221-75e3-4d32-b672-f89037a61be7 Nov 06 17:50:19 devstack sudo[94920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:19 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-46a96117-1947-418a-9790-4a40995bbb2b req-258c197c-7ff8-4044-a0e8-b459e6e0e076 tempest-ServerActionsTestOtherA-1480259007 None] Terminate volume connection completed successfully. Nov 06 17:50:19 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-46a96117-1947-418a-9790-4a40995bbb2b req-258c197c-7ff8-4044-a0e8-b459e6e0e076 tempest-ServerActionsTestOtherA-1480259007 None] Deleting attachment f3aefb87-2526-4a10-98d2-fade7297c772. {{(pid=87068) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 17:50:19 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-46a96117-1947-418a-9790-4a40995bbb2b req-beaa176a-039d-4e13-b2e7-c510501834b1 tempest-ServerActionsTestOtherA-1480259007 None] Acquiring lock "cinder-6d1939d4-3ffe-40ee-9bf8-49c5d298eb18-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:50:20 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-46a96117-1947-418a-9790-4a40995bbb2b req-beaa176a-039d-4e13-b2e7-c510501834b1 tempest-ServerActionsTestOtherA-1480259007 None] Lock "cinder-6d1939d4-3ffe-40ee-9bf8-49c5d298eb18-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:50:20 devstack sudo[94920]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5561d9c1-df71-4c68-9b31-191e0e5c8f2d tempest-SnapshotsActionsTest-284033357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.cecba221-75e3-4d32-b672-f89037a61be7" returned: 0 in 0.283s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:20 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-46a96117-1947-418a-9790-4a40995bbb2b req-beaa176a-039d-4e13-b2e7-c510501834b1 tempest-ServerActionsTestOtherA-1480259007 None] Acquiring lock "cinder-quobyte-6d1939d4-3ffe-40ee-9bf8-49c5d298eb18" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:50:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5561d9c1-df71-4c68-9b31-191e0e5c8f2d tempest-SnapshotsActionsTest-284033357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.272s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:50:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2c17d977-f9a9-4f78-b88e-6d075b08098a tempest-VolumesListAdminTestJSON-209193959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.687s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:50:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2c17d977-f9a9-4f78-b88e-6d075b08098a tempest-VolumesListAdminTestJSON-209193959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-186619271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21ed33a0-06a6-4119-b858-e2f5f486be5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9eb03bc862844a82af48b67d57f82b59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:50:19Z,use_quota=True,user_id='53f854eeca9e4044b4b6fd3cf17c28e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:50:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-2c17d977-f9a9-4f78-b88e-6d075b08098a tempest-VolumesListAdminTestJSON-209193959 None] Creating volume 21ed33a0-06a6-4119-b858-e2f5f486be5e {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:50:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2c17d977-f9a9-4f78-b88e-6d075b08098a tempest-VolumesListAdminTestJSON-209193959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:50:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2c17d977-f9a9-4f78-b88e-6d075b08098a tempest-VolumesListAdminTestJSON-209193959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:50:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2c17d977-f9a9-4f78-b88e-6d075b08098a tempest-VolumesListAdminTestJSON-209193959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:50:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2c17d977-f9a9-4f78-b88e-6d075b08098a tempest-VolumesListAdminTestJSON-209193959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:50:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2c17d977-f9a9-4f78-b88e-6d075b08098a tempest-VolumesListAdminTestJSON-209193959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:50:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2c17d977-f9a9-4f78-b88e-6d075b08098a tempest-VolumesListAdminTestJSON-209193959 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:50:20 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-2c17d977-f9a9-4f78-b88e-6d075b08098a tempest-VolumesListAdminTestJSON-209193959 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:50:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2c17d977-f9a9-4f78-b88e-6d075b08098a tempest-VolumesListAdminTestJSON-209193959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-21ed33a0-06a6-4119-b858-e2f5f486be5e 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:20 devstack sudo[94923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-21ed33a0-06a6-4119-b858-e2f5f486be5e 1073741824 Nov 06 17:50:20 devstack sudo[94923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:20 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-46a96117-1947-418a-9790-4a40995bbb2b req-beaa176a-039d-4e13-b2e7-c510501834b1 tempest-ServerActionsTestOtherA-1480259007 None] Lock "cinder-quobyte-6d1939d4-3ffe-40ee-9bf8-49c5d298eb18" acquired by "delete_volume" :: waited 0.094s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:50:20 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[634a532d-958c-4a66-a55e-2768dca2321e]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:50:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-46a96117-1947-418a-9790-4a40995bbb2b req-beaa176a-039d-4e13-b2e7-c510501834b1 tempest-ServerActionsTestOtherA-1480259007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6d1939d4-3ffe-40ee-9bf8-49c5d298eb18 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:20 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-5561d9c1-df71-4c68-9b31-191e0e5c8f2d tempest-SnapshotsActionsTest-284033357 None] Create snapshot completed successfully Nov 06 17:50:20 devstack sudo[94926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6d1939d4-3ffe-40ee-9bf8-49c5d298eb18 Nov 06 17:50:20 devstack sudo[94926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:20 devstack sudo[94926]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-46a96117-1947-418a-9790-4a40995bbb2b req-beaa176a-039d-4e13-b2e7-c510501834b1 tempest-ServerActionsTestOtherA-1480259007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6d1939d4-3ffe-40ee-9bf8-49c5d298eb18" returned: 0 in 0.471s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-46a96117-1947-418a-9790-4a40995bbb2b req-beaa176a-039d-4e13-b2e7-c510501834b1 tempest-ServerActionsTestOtherA-1480259007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6d1939d4-3ffe-40ee-9bf8-49c5d298eb18 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:20 devstack sudo[94923]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2c17d977-f9a9-4f78-b88e-6d075b08098a tempest-VolumesListAdminTestJSON-209193959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-21ed33a0-06a6-4119-b858-e2f5f486be5e 1073741824" returned: 0 in 0.568s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:20 devstack sudo[94936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6d1939d4-3ffe-40ee-9bf8-49c5d298eb18 Nov 06 17:50:20 devstack sudo[94936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2c17d977-f9a9-4f78-b88e-6d075b08098a tempest-VolumesListAdminTestJSON-209193959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-21ed33a0-06a6-4119-b858-e2f5f486be5e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:20 devstack sudo[94938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-21ed33a0-06a6-4119-b858-e2f5f486be5e Nov 06 17:50:20 devstack sudo[94938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:20 devstack sudo[94936]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-46a96117-1947-418a-9790-4a40995bbb2b req-beaa176a-039d-4e13-b2e7-c510501834b1 tempest-ServerActionsTestOtherA-1480259007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6d1939d4-3ffe-40ee-9bf8-49c5d298eb18" returned: 0 in 0.271s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:20 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-46a96117-1947-418a-9790-4a40995bbb2b req-beaa176a-039d-4e13-b2e7-c510501834b1 tempest-ServerActionsTestOtherA-1480259007 None] Lock "cinder-quobyte-6d1939d4-3ffe-40ee-9bf8-49c5d298eb18" released by "delete_volume" :: held 0.811s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:50:20 devstack sudo[94938]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2c17d977-f9a9-4f78-b88e-6d075b08098a tempest-VolumesListAdminTestJSON-209193959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-21ed33a0-06a6-4119-b858-e2f5f486be5e" returned: 0 in 0.256s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2c17d977-f9a9-4f78-b88e-6d075b08098a tempest-VolumesListAdminTestJSON-209193959 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:50:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2c17d977-f9a9-4f78-b88e-6d075b08098a tempest-VolumesListAdminTestJSON-209193959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:50:20 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2c17d977-f9a9-4f78-b88e-6d075b08098a tempest-VolumesListAdminTestJSON-209193959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe7733e7-40a2-4519-9dfb-5a6623305a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21ed33a0-06a6-4119-b858-e2f5f486be5e', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:50:20 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2c17d977-f9a9-4f78-b88e-6d075b08098a tempest-VolumesListAdminTestJSON-209193959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad36ca8a-b9fe-444f-8896-1840db8602ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:50:21 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-2c17d977-f9a9-4f78-b88e-6d075b08098a tempest-VolumesListAdminTestJSON-209193959 None] Volume volume-21ed33a0-06a6-4119-b858-e2f5f486be5e (21ed33a0-06a6-4119-b858-e2f5f486be5e): created successfully Nov 06 17:50:21 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2c17d977-f9a9-4f78-b88e-6d075b08098a tempest-VolumesListAdminTestJSON-209193959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad36ca8a-b9fe-444f-8896-1840db8602ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:50:21 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2c17d977-f9a9-4f78-b88e-6d075b08098a tempest-VolumesListAdminTestJSON-209193959 None] Flow 'volume_create_manager' (96c3f937-0cf0-4eac-baf2-4c7146ae9b47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:50:21 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-2c17d977-f9a9-4f78-b88e-6d075b08098a tempest-VolumesListAdminTestJSON-209193959 None] Created volume successfully. Nov 06 17:50:21 devstack cinder-volume[87068]: DEBUG cinder.quota [req-46a96117-1947-418a-9790-4a40995bbb2b req-beaa176a-039d-4e13-b2e7-c510501834b1 tempest-ServerActionsTestOtherA-1480259007 None] Created reservations ['c416597b-8814-4604-a6a0-7636a7b9e693', '0dd25460-383b-4864-bc46-fd594e12ee9c', 'a01ee3f6-4db4-467f-a7f0-98237642f278', 'b8a08dcb-390d-4056-a60f-5fc0ffda53b9'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:50:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8c7a7bf5-99d1-4d62-9864-15595b0a97f5 tempest-SnapshotsActionsTest-1297661370 None] Acquiring lock "cinder-cecba221-75e3-4d32-b672-f89037a61be7-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:50:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8c7a7bf5-99d1-4d62-9864-15595b0a97f5 tempest-SnapshotsActionsTest-1297661370 None] Lock "cinder-cecba221-75e3-4d32-b672-f89037a61be7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:50:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8c7a7bf5-99d1-4d62-9864-15595b0a97f5 tempest-SnapshotsActionsTest-1297661370 None] Acquiring lock "cinder-quobyte-d50918bc-f0e8-4572-bceb-84e9d767c65e" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:50:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8c7a7bf5-99d1-4d62-9864-15595b0a97f5 tempest-SnapshotsActionsTest-1297661370 None] Lock "cinder-quobyte-d50918bc-f0e8-4572-bceb-84e9d767c65e" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:50:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8c7a7bf5-99d1-4d62-9864-15595b0a97f5 tempest-SnapshotsActionsTest-1297661370 None] Acquiring lock "cinder-quobyte-cecba221-75e3-4d32-b672-f89037a61be7" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:50:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-46a96117-1947-418a-9790-4a40995bbb2b req-beaa176a-039d-4e13-b2e7-c510501834b1 tempest-ServerActionsTestOtherA-1480259007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:50:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-46a96117-1947-418a-9790-4a40995bbb2b req-beaa176a-039d-4e13-b2e7-c510501834b1 tempest-ServerActionsTestOtherA-1480259007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:50:21 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [req-46a96117-1947-418a-9790-4a40995bbb2b req-beaa176a-039d-4e13-b2e7-c510501834b1 tempest-ServerActionsTestOtherA-1480259007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:50:21 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [req-46a96117-1947-418a-9790-4a40995bbb2b req-beaa176a-039d-4e13-b2e7-c510501834b1 tempest-ServerActionsTestOtherA-1480259007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:50:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-46a96117-1947-418a-9790-4a40995bbb2b req-beaa176a-039d-4e13-b2e7-c510501834b1 tempest-ServerActionsTestOtherA-1480259007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:50:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-46a96117-1947-418a-9790-4a40995bbb2b req-beaa176a-039d-4e13-b2e7-c510501834b1 tempest-ServerActionsTestOtherA-1480259007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8c7a7bf5-99d1-4d62-9864-15595b0a97f5 tempest-SnapshotsActionsTest-1297661370 None] Lock "cinder-quobyte-cecba221-75e3-4d32-b672-f89037a61be7" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:50:21 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-8c7a7bf5-99d1-4d62-9864-15595b0a97f5 tempest-SnapshotsActionsTest-1297661370 None] Deleting offline snapshot cecba221-75e3-4d32-b672-f89037a61be7 of volume d50918bc-f0e8-4572-bceb-84e9d767c65e {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 17:50:21 devstack sudo[94942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:50:21 devstack sudo[94942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:21 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-8c7a7bf5-99d1-4d62-9864-15595b0a97f5 tempest-SnapshotsActionsTest-1297661370 None] snapshot_file for this snap is: volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.cecba221-75e3-4d32-b672-f89037a61be7 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 17:50:21 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[597bd6bc-dec4-47cf-b7d9-e6086f3eee5b]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:50:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8c7a7bf5-99d1-4d62-9864-15595b0a97f5 tempest-SnapshotsActionsTest-1297661370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.cecba221-75e3-4d32-b672-f89037a61be7 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:21 devstack sudo[94944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.cecba221-75e3-4d32-b672-f89037a61be7 Nov 06 17:50:21 devstack sudo[94944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f17e3e7b-e9ce-4549-97dd-db4bd344505b tempest-ServerActionsTestOtherA-1480259007 None] Acquiring lock "cinder-459474e7-2a9c-4265-9f62-8b738b7531b7-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:50:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f17e3e7b-e9ce-4549-97dd-db4bd344505b tempest-ServerActionsTestOtherA-1480259007 None] Lock "cinder-459474e7-2a9c-4265-9f62-8b738b7531b7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:50:21 devstack sudo[94942]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f17e3e7b-e9ce-4549-97dd-db4bd344505b tempest-ServerActionsTestOtherA-1480259007 None] Acquiring lock "cinder-quobyte-459474e7-2a9c-4265-9f62-8b738b7531b7" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:50:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-46a96117-1947-418a-9790-4a40995bbb2b req-beaa176a-039d-4e13-b2e7-c510501834b1 tempest-ServerActionsTestOtherA-1480259007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.342s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:21 devstack cinder-volume[87068]: DEBUG cinder.manager [req-46a96117-1947-418a-9790-4a40995bbb2b req-beaa176a-039d-4e13-b2e7-c510501834b1 tempest-ServerActionsTestOtherA-1480259007 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:50:21 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-46a96117-1947-418a-9790-4a40995bbb2b req-beaa176a-039d-4e13-b2e7-c510501834b1 tempest-ServerActionsTestOtherA-1480259007 None] Deleted volume successfully. Nov 06 17:50:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f17e3e7b-e9ce-4549-97dd-db4bd344505b tempest-ServerActionsTestOtherA-1480259007 None] Lock "cinder-quobyte-459474e7-2a9c-4265-9f62-8b738b7531b7" acquired by "delete_volume" :: waited 0.027s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:50:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-46a96117-1947-418a-9790-4a40995bbb2b req-beaa176a-039d-4e13-b2e7-c510501834b1 tempest-ServerActionsTestOtherA-1480259007 None] Lock "cinder-6d1939d4-3ffe-40ee-9bf8-49c5d298eb18-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:50:21 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2bd55a5-4411-4f51-b14f-5141bbd657ec]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:50:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f17e3e7b-e9ce-4549-97dd-db4bd344505b tempest-ServerActionsTestOtherA-1480259007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-459474e7-2a9c-4265-9f62-8b738b7531b7 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:21 devstack sudo[94944]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8c7a7bf5-99d1-4d62-9864-15595b0a97f5 tempest-SnapshotsActionsTest-1297661370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.cecba221-75e3-4d32-b672-f89037a61be7" returned: 0 in 0.450s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:21 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-8c7a7bf5-99d1-4d62-9864-15595b0a97f5 tempest-SnapshotsActionsTest-1297661370 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d50918bc-f0e8-4572-bceb-84e9d767c65e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 17:50:21 devstack sudo[94947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-459474e7-2a9c-4265-9f62-8b738b7531b7 Nov 06 17:50:21 devstack sudo[94947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:21 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1e1d20-36fa-4e85-a818-6db289001d52]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:50:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8c7a7bf5-99d1-4d62-9864-15595b0a97f5 tempest-SnapshotsActionsTest-1297661370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:21 devstack sudo[94952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240 Nov 06 17:50:21 devstack sudo[94952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:22 devstack sudo[94947]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f17e3e7b-e9ce-4549-97dd-db4bd344505b tempest-ServerActionsTestOtherA-1480259007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-459474e7-2a9c-4265-9f62-8b738b7531b7" returned: 0 in 0.428s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f17e3e7b-e9ce-4549-97dd-db4bd344505b tempest-ServerActionsTestOtherA-1480259007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-459474e7-2a9c-4265-9f62-8b738b7531b7 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:22 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-924273b0-265d-4e8a-bd5e-b79d00997d3b tempest-VolumesListAdminTestJSON-209193959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:50:22 devstack sudo[94957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-459474e7-2a9c-4265-9f62-8b738b7531b7 Nov 06 17:50:22 devstack sudo[94957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:22 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-924273b0-265d-4e8a-bd5e-b79d00997d3b tempest-VolumesListAdminTestJSON-209193959 None] Flow 'volume_create_manager' (3241aa84-c18d-4b1f-a00c-090c2196f16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:50:22 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-924273b0-265d-4e8a-bd5e-b79d00997d3b tempest-VolumesListAdminTestJSON-209193959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef27999b-7456-49e2-9093-6697c65c1a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:50:22 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-924273b0-265d-4e8a-bd5e-b79d00997d3b tempest-VolumesListAdminTestJSON-209193959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef27999b-7456-49e2-9093-6697c65c1a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:50:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-818420424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61f3eb67-beaf-4c75-a3e0-292f950cf3bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9eb03bc862844a82af48b67d57f82b59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:50:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:50:22Z,use_quota=True,user_id='53f854eeca9e4044b4b6fd3cf17c28e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:50:22 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-924273b0-265d-4e8a-bd5e-b79d00997d3b tempest-VolumesListAdminTestJSON-209193959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8e9d1da-5831-42c8-ad30-8c7a4390b852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:50:22 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-924273b0-265d-4e8a-bd5e-b79d00997d3b tempest-VolumesListAdminTestJSON-209193959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8e9d1da-5831-42c8-ad30-8c7a4390b852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:50:22 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-924273b0-265d-4e8a-bd5e-b79d00997d3b tempest-VolumesListAdminTestJSON-209193959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6d32ea6-e4c8-41ec-9d1e-437556c1370e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:50:22 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-924273b0-265d-4e8a-bd5e-b79d00997d3b tempest-VolumesListAdminTestJSON-209193959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6d32ea6-e4c8-41ec-9d1e-437556c1370e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61f3eb67-beaf-4c75-a3e0-292f950cf3bc', 'volume_name': 'volume-61f3eb67-beaf-4c75-a3e0-292f950cf3bc', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:50:22 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-924273b0-265d-4e8a-bd5e-b79d00997d3b tempest-VolumesListAdminTestJSON-209193959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acbbd299-2363-4a49-852a-9300a392a62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:50:22 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-924273b0-265d-4e8a-bd5e-b79d00997d3b tempest-VolumesListAdminTestJSON-209193959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acbbd299-2363-4a49-852a-9300a392a62f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:50:22 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-924273b0-265d-4e8a-bd5e-b79d00997d3b tempest-VolumesListAdminTestJSON-209193959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3a37f27-5e5e-4106-a8e7-84bafa13c5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:50:22 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-924273b0-265d-4e8a-bd5e-b79d00997d3b tempest-VolumesListAdminTestJSON-209193959 None] Volume 61f3eb67-beaf-4c75-a3e0-292f950cf3bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61f3eb67-beaf-4c75-a3e0-292f950cf3bc', 'volume_size': 1} Nov 06 17:50:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-924273b0-265d-4e8a-bd5e-b79d00997d3b tempest-VolumesListAdminTestJSON-209193959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:50:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-924273b0-265d-4e8a-bd5e-b79d00997d3b tempest-VolumesListAdminTestJSON-209193959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:50:22 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-924273b0-265d-4e8a-bd5e-b79d00997d3b tempest-VolumesListAdminTestJSON-209193959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:50:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-818420424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61f3eb67-beaf-4c75-a3e0-292f950cf3bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9eb03bc862844a82af48b67d57f82b59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:50:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:50:22Z,use_quota=True,user_id='53f854eeca9e4044b4b6fd3cf17c28e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:50:22 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-924273b0-265d-4e8a-bd5e-b79d00997d3b tempest-VolumesListAdminTestJSON-209193959 None] Creating volume 61f3eb67-beaf-4c75-a3e0-292f950cf3bc {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:50:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-924273b0-265d-4e8a-bd5e-b79d00997d3b tempest-VolumesListAdminTestJSON-209193959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:50:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-924273b0-265d-4e8a-bd5e-b79d00997d3b tempest-VolumesListAdminTestJSON-209193959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:50:22 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-924273b0-265d-4e8a-bd5e-b79d00997d3b tempest-VolumesListAdminTestJSON-209193959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:50:22 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-924273b0-265d-4e8a-bd5e-b79d00997d3b tempest-VolumesListAdminTestJSON-209193959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:50:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-924273b0-265d-4e8a-bd5e-b79d00997d3b tempest-VolumesListAdminTestJSON-209193959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:50:22 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-924273b0-265d-4e8a-bd5e-b79d00997d3b tempest-VolumesListAdminTestJSON-209193959 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:50:22 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-924273b0-265d-4e8a-bd5e-b79d00997d3b tempest-VolumesListAdminTestJSON-209193959 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:50:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-924273b0-265d-4e8a-bd5e-b79d00997d3b tempest-VolumesListAdminTestJSON-209193959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-61f3eb67-beaf-4c75-a3e0-292f950cf3bc 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:22 devstack sudo[94952]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8c7a7bf5-99d1-4d62-9864-15595b0a97f5 tempest-SnapshotsActionsTest-1297661370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240" returned: 0 in 0.416s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:22 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-8c7a7bf5-99d1-4d62-9864-15595b0a97f5 tempest-SnapshotsActionsTest-1297661370 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d50918bc-f0e8-4572-bceb-84e9d767c65e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 17:50:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8c7a7bf5-99d1-4d62-9864-15595b0a97f5 tempest-SnapshotsActionsTest-1297661370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.cecba221-75e3-4d32-b672-f89037a61be7 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:22 devstack sudo[94962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-61f3eb67-beaf-4c75-a3e0-292f950cf3bc 1073741824 Nov 06 17:50:22 devstack sudo[94962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:22 devstack sudo[94963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.cecba221-75e3-4d32-b672-f89037a61be7 Nov 06 17:50:22 devstack sudo[94963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:22 devstack sudo[94957]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f17e3e7b-e9ce-4549-97dd-db4bd344505b tempest-ServerActionsTestOtherA-1480259007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-459474e7-2a9c-4265-9f62-8b738b7531b7" returned: 0 in 0.280s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:22 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f17e3e7b-e9ce-4549-97dd-db4bd344505b tempest-ServerActionsTestOtherA-1480259007 None] Lock "cinder-quobyte-459474e7-2a9c-4265-9f62-8b738b7531b7" released by "delete_volume" :: held 0.783s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:50:22 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-f17e3e7b-e9ce-4549-97dd-db4bd344505b tempest-ServerActionsTestOtherA-1480259007 None] Created reservations ['7e58a1a6-e8a4-47ec-ae9b-d1219ca85047', 'b00a64ee-9c55-4fa4-b9bd-5688e9c43d93', '51030c29-71e6-44ba-b6c7-535b9ea945b6', 'dde1e59d-acc5-4822-bad7-2fe1f21584ce'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:50:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f17e3e7b-e9ce-4549-97dd-db4bd344505b tempest-ServerActionsTestOtherA-1480259007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:50:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f17e3e7b-e9ce-4549-97dd-db4bd344505b tempest-ServerActionsTestOtherA-1480259007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:50:22 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f17e3e7b-e9ce-4549-97dd-db4bd344505b tempest-ServerActionsTestOtherA-1480259007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:50:22 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f17e3e7b-e9ce-4549-97dd-db4bd344505b tempest-ServerActionsTestOtherA-1480259007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:50:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f17e3e7b-e9ce-4549-97dd-db4bd344505b tempest-ServerActionsTestOtherA-1480259007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:50:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f17e3e7b-e9ce-4549-97dd-db4bd344505b tempest-ServerActionsTestOtherA-1480259007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:22 devstack sudo[94974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:50:22 devstack sudo[94974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:22 devstack sudo[94963]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8c7a7bf5-99d1-4d62-9864-15595b0a97f5 tempest-SnapshotsActionsTest-1297661370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.cecba221-75e3-4d32-b672-f89037a61be7" returned: 0 in 0.501s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8c7a7bf5-99d1-4d62-9864-15595b0a97f5 tempest-SnapshotsActionsTest-1297661370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.cecba221-75e3-4d32-b672-f89037a61be7 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:22 devstack sudo[94962]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-924273b0-265d-4e8a-bd5e-b79d00997d3b tempest-VolumesListAdminTestJSON-209193959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-61f3eb67-beaf-4c75-a3e0-292f950cf3bc 1073741824" returned: 0 in 0.552s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:22 devstack sudo[94977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.cecba221-75e3-4d32-b672-f89037a61be7 Nov 06 17:50:22 devstack sudo[94977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-924273b0-265d-4e8a-bd5e-b79d00997d3b tempest-VolumesListAdminTestJSON-209193959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-61f3eb67-beaf-4c75-a3e0-292f950cf3bc {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:22 devstack sudo[94981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-61f3eb67-beaf-4c75-a3e0-292f950cf3bc Nov 06 17:50:22 devstack sudo[94981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:22 devstack sudo[94974]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f17e3e7b-e9ce-4549-97dd-db4bd344505b tempest-ServerActionsTestOtherA-1480259007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.390s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:22 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-f17e3e7b-e9ce-4549-97dd-db4bd344505b tempest-ServerActionsTestOtherA-1480259007 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:50:22 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-f17e3e7b-e9ce-4549-97dd-db4bd344505b tempest-ServerActionsTestOtherA-1480259007 None] Deleted volume successfully. Nov 06 17:50:22 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f17e3e7b-e9ce-4549-97dd-db4bd344505b tempest-ServerActionsTestOtherA-1480259007 None] Lock "cinder-459474e7-2a9c-4265-9f62-8b738b7531b7-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:50:23 devstack sudo[94977]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8c7a7bf5-99d1-4d62-9864-15595b0a97f5 tempest-SnapshotsActionsTest-1297661370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.cecba221-75e3-4d32-b672-f89037a61be7" returned: 0 in 0.339s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:23 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8c7a7bf5-99d1-4d62-9864-15595b0a97f5 tempest-SnapshotsActionsTest-1297661370 None] Lock "cinder-quobyte-cecba221-75e3-4d32-b672-f89037a61be7" released by "_delete_snapshot" :: held 1.845s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:50:23 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8c7a7bf5-99d1-4d62-9864-15595b0a97f5 tempest-SnapshotsActionsTest-1297661370 None] Lock "cinder-quobyte-d50918bc-f0e8-4572-bceb-84e9d767c65e" released by "delete_snapshot" :: held 1.894s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:50:23 devstack sudo[94981]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-924273b0-265d-4e8a-bd5e-b79d00997d3b tempest-VolumesListAdminTestJSON-209193959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-61f3eb67-beaf-4c75-a3e0-292f950cf3bc" returned: 0 in 0.370s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:23 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-924273b0-265d-4e8a-bd5e-b79d00997d3b tempest-VolumesListAdminTestJSON-209193959 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:50:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-924273b0-265d-4e8a-bd5e-b79d00997d3b tempest-VolumesListAdminTestJSON-209193959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:50:23 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-924273b0-265d-4e8a-bd5e-b79d00997d3b tempest-VolumesListAdminTestJSON-209193959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3a37f27-5e5e-4106-a8e7-84bafa13c5c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61f3eb67-beaf-4c75-a3e0-292f950cf3bc', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:50:23 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-924273b0-265d-4e8a-bd5e-b79d00997d3b tempest-VolumesListAdminTestJSON-209193959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f61cec1e-3e6b-4dae-afe7-3bb2f4c81074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:50:23 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-8c7a7bf5-99d1-4d62-9864-15595b0a97f5 tempest-SnapshotsActionsTest-1297661370 None] Created reservations ['38c7354d-f989-48f0-a962-8dcb3b04b23f', '09c95fcb-e330-4ae3-be26-0c1e67bf1347', 'f526d0ab-9a9b-4c6a-a524-8026b21e079f', '152d5c36-49e8-4f03-9fb3-e595dfab32e7'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:50:23 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-924273b0-265d-4e8a-bd5e-b79d00997d3b tempest-VolumesListAdminTestJSON-209193959 None] Volume volume-61f3eb67-beaf-4c75-a3e0-292f950cf3bc (61f3eb67-beaf-4c75-a3e0-292f950cf3bc): created successfully Nov 06 17:50:23 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-924273b0-265d-4e8a-bd5e-b79d00997d3b tempest-VolumesListAdminTestJSON-209193959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f61cec1e-3e6b-4dae-afe7-3bb2f4c81074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:50:23 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-924273b0-265d-4e8a-bd5e-b79d00997d3b tempest-VolumesListAdminTestJSON-209193959 None] Flow 'volume_create_manager' (3241aa84-c18d-4b1f-a00c-090c2196f16f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:50:23 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-924273b0-265d-4e8a-bd5e-b79d00997d3b tempest-VolumesListAdminTestJSON-209193959 None] Created volume successfully. Nov 06 17:50:23 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-8c7a7bf5-99d1-4d62-9864-15595b0a97f5 tempest-SnapshotsActionsTest-1297661370 None] Delete snapshot completed successfully. Nov 06 17:50:23 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8c7a7bf5-99d1-4d62-9864-15595b0a97f5 tempest-SnapshotsActionsTest-1297661370 None] Lock "cinder-cecba221-75e3-4d32-b672-f89037a61be7-delete_snapshot" released by "delete_snapshot" :: held 2.230s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:50:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-91270f62-28b3-4a6b-9623-00712cc7f30d tempest-SnapshotsActionsTest-284033357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:50:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-91270f62-28b3-4a6b-9623-00712cc7f30d tempest-SnapshotsActionsTest-284033357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:50:24 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-91270f62-28b3-4a6b-9623-00712cc7f30d tempest-SnapshotsActionsTest-284033357 None] Creating offline snapshot 4107f506-c640-4b0e-b4db-c0b56f42fcad of volume d50918bc-f0e8-4572-bceb-84e9d767c65e {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 17:50:25 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab1687f-53b2-4680-b323-b307e60a51bb]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:50:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-91270f62-28b3-4a6b-9623-00712cc7f30d tempest-SnapshotsActionsTest-284033357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:25 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-f26a977f-3f51-48ea-9637-cefcb9e8e36b tempest-VolumesListAdminTestJSON-1746153784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:50:25 devstack sudo[95010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240 Nov 06 17:50:25 devstack sudo[95010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f26a977f-3f51-48ea-9637-cefcb9e8e36b tempest-VolumesListAdminTestJSON-1746153784 None] Flow 'volume_create_manager' (4be31724-6622-4077-9e61-be2735993aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:50:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f26a977f-3f51-48ea-9637-cefcb9e8e36b tempest-VolumesListAdminTestJSON-1746153784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87f56a3d-5db2-4884-8e49-a49908d5d943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:50:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f26a977f-3f51-48ea-9637-cefcb9e8e36b tempest-VolumesListAdminTestJSON-1746153784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87f56a3d-5db2-4884-8e49-a49908d5d943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20f8045f-5e0f-4180-80d9-50484c0d7cb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dac67f09620b41ff88fbe36fcbdffebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:50:25Z,use_quota=True,user_id='eac651157a314394bea30f3895e6c768',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:50:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f26a977f-3f51-48ea-9637-cefcb9e8e36b tempest-VolumesListAdminTestJSON-1746153784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be886011-cda6-4229-90dc-b01e5137bfbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:50:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f26a977f-3f51-48ea-9637-cefcb9e8e36b tempest-VolumesListAdminTestJSON-1746153784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be886011-cda6-4229-90dc-b01e5137bfbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:50:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f26a977f-3f51-48ea-9637-cefcb9e8e36b tempest-VolumesListAdminTestJSON-1746153784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bde70dce-465b-4e53-9ebe-55ca0bd75cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:50:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f26a977f-3f51-48ea-9637-cefcb9e8e36b tempest-VolumesListAdminTestJSON-1746153784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bde70dce-465b-4e53-9ebe-55ca0bd75cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20f8045f-5e0f-4180-80d9-50484c0d7cb3', 'volume_name': 'volume-20f8045f-5e0f-4180-80d9-50484c0d7cb3', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:50:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f26a977f-3f51-48ea-9637-cefcb9e8e36b tempest-VolumesListAdminTestJSON-1746153784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1244054-6656-4fd5-820e-dfa42baa7f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:50:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f26a977f-3f51-48ea-9637-cefcb9e8e36b tempest-VolumesListAdminTestJSON-1746153784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1244054-6656-4fd5-820e-dfa42baa7f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:50:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f26a977f-3f51-48ea-9637-cefcb9e8e36b tempest-VolumesListAdminTestJSON-1746153784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (311d2927-f68f-4126-bb03-fe7ee1477bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:50:25 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-f26a977f-3f51-48ea-9637-cefcb9e8e36b tempest-VolumesListAdminTestJSON-1746153784 None] Volume 20f8045f-5e0f-4180-80d9-50484c0d7cb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20f8045f-5e0f-4180-80d9-50484c0d7cb3', 'volume_size': 1} Nov 06 17:50:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f26a977f-3f51-48ea-9637-cefcb9e8e36b tempest-VolumesListAdminTestJSON-1746153784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:50:25 devstack sudo[95010]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-91270f62-28b3-4a6b-9623-00712cc7f30d tempest-SnapshotsActionsTest-284033357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240" returned: 0 in 0.439s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:25 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-91270f62-28b3-4a6b-9623-00712cc7f30d tempest-SnapshotsActionsTest-284033357 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d50918bc-f0e8-4572-bceb-84e9d767c65e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 17:50:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-91270f62-28b3-4a6b-9623-00712cc7f30d tempest-SnapshotsActionsTest-284033357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.4107f506-c640-4b0e-b4db-c0b56f42fcad 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:25 devstack sudo[95016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.4107f506-c640-4b0e-b4db-c0b56f42fcad 1G Nov 06 17:50:25 devstack sudo[95016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:26 devstack sudo[95016]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-91270f62-28b3-4a6b-9623-00712cc7f30d tempest-SnapshotsActionsTest-284033357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.4107f506-c640-4b0e-b4db-c0b56f42fcad 1G" returned: 0 in 0.572s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-91270f62-28b3-4a6b-9623-00712cc7f30d tempest-SnapshotsActionsTest-284033357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.4107f506-c640-4b0e-b4db-c0b56f42fcad {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:26 devstack sudo[95022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.4107f506-c640-4b0e-b4db-c0b56f42fcad Nov 06 17:50:26 devstack sudo[95022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:26 devstack sudo[95022]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-91270f62-28b3-4a6b-9623-00712cc7f30d tempest-SnapshotsActionsTest-284033357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.4107f506-c640-4b0e-b4db-c0b56f42fcad" returned: 0 in 0.313s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:26 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-91270f62-28b3-4a6b-9623-00712cc7f30d tempest-SnapshotsActionsTest-284033357 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.4107f506-c640-4b0e-b4db-c0b56f42fcad is being set with open permissions: ugo+rw Nov 06 17:50:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-91270f62-28b3-4a6b-9623-00712cc7f30d tempest-SnapshotsActionsTest-284033357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.4107f506-c640-4b0e-b4db-c0b56f42fcad {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:26 devstack sudo[95028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.4107f506-c640-4b0e-b4db-c0b56f42fcad Nov 06 17:50:26 devstack sudo[95028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:26 devstack sudo[95028]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-91270f62-28b3-4a6b-9623-00712cc7f30d tempest-SnapshotsActionsTest-284033357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.4107f506-c640-4b0e-b4db-c0b56f42fcad" returned: 0 in 0.262s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-91270f62-28b3-4a6b-9623-00712cc7f30d tempest-SnapshotsActionsTest-284033357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.731s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:50:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f26a977f-3f51-48ea-9637-cefcb9e8e36b tempest-VolumesListAdminTestJSON-1746153784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.393s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:50:26 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f26a977f-3f51-48ea-9637-cefcb9e8e36b tempest-VolumesListAdminTestJSON-1746153784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20f8045f-5e0f-4180-80d9-50484c0d7cb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dac67f09620b41ff88fbe36fcbdffebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:50:25Z,use_quota=True,user_id='eac651157a314394bea30f3895e6c768',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:50:26 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-f26a977f-3f51-48ea-9637-cefcb9e8e36b tempest-VolumesListAdminTestJSON-1746153784 None] Creating volume 20f8045f-5e0f-4180-80d9-50484c0d7cb3 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:50:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f26a977f-3f51-48ea-9637-cefcb9e8e36b tempest-VolumesListAdminTestJSON-1746153784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:50:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f26a977f-3f51-48ea-9637-cefcb9e8e36b tempest-VolumesListAdminTestJSON-1746153784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:50:26 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f26a977f-3f51-48ea-9637-cefcb9e8e36b tempest-VolumesListAdminTestJSON-1746153784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:50:26 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f26a977f-3f51-48ea-9637-cefcb9e8e36b tempest-VolumesListAdminTestJSON-1746153784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:50:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f26a977f-3f51-48ea-9637-cefcb9e8e36b tempest-VolumesListAdminTestJSON-1746153784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:50:26 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f26a977f-3f51-48ea-9637-cefcb9e8e36b tempest-VolumesListAdminTestJSON-1746153784 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:50:26 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-f26a977f-3f51-48ea-9637-cefcb9e8e36b tempest-VolumesListAdminTestJSON-1746153784 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:50:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f26a977f-3f51-48ea-9637-cefcb9e8e36b tempest-VolumesListAdminTestJSON-1746153784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-20f8045f-5e0f-4180-80d9-50484c0d7cb3 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:26 devstack sudo[95031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-20f8045f-5e0f-4180-80d9-50484c0d7cb3 1073741824 Nov 06 17:50:26 devstack sudo[95031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:26 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-91270f62-28b3-4a6b-9623-00712cc7f30d tempest-SnapshotsActionsTest-284033357 None] Create snapshot completed successfully Nov 06 17:50:27 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-95586f77-a744-4d78-8e38-833cec18d68c tempest-SnapshotsActionsTest-1297661370 None] Acquiring lock "cinder-4107f506-c640-4b0e-b4db-c0b56f42fcad-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:50:27 devstack sudo[95031]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:27 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-95586f77-a744-4d78-8e38-833cec18d68c tempest-SnapshotsActionsTest-1297661370 None] Lock "cinder-4107f506-c640-4b0e-b4db-c0b56f42fcad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:50:27 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-95586f77-a744-4d78-8e38-833cec18d68c tempest-SnapshotsActionsTest-1297661370 None] Acquiring lock "cinder-quobyte-d50918bc-f0e8-4572-bceb-84e9d767c65e" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:50:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f26a977f-3f51-48ea-9637-cefcb9e8e36b tempest-VolumesListAdminTestJSON-1746153784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-20f8045f-5e0f-4180-80d9-50484c0d7cb3 1073741824" returned: 0 in 0.554s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:27 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-95586f77-a744-4d78-8e38-833cec18d68c tempest-SnapshotsActionsTest-1297661370 None] Lock "cinder-quobyte-d50918bc-f0e8-4572-bceb-84e9d767c65e" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:50:27 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-95586f77-a744-4d78-8e38-833cec18d68c tempest-SnapshotsActionsTest-1297661370 None] Acquiring lock "cinder-quobyte-4107f506-c640-4b0e-b4db-c0b56f42fcad" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:50:27 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-95586f77-a744-4d78-8e38-833cec18d68c tempest-SnapshotsActionsTest-1297661370 None] Lock "cinder-quobyte-4107f506-c640-4b0e-b4db-c0b56f42fcad" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:50:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-95586f77-a744-4d78-8e38-833cec18d68c tempest-SnapshotsActionsTest-1297661370 None] Deleting offline snapshot 4107f506-c640-4b0e-b4db-c0b56f42fcad of volume d50918bc-f0e8-4572-bceb-84e9d767c65e {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 17:50:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-95586f77-a744-4d78-8e38-833cec18d68c tempest-SnapshotsActionsTest-1297661370 None] snapshot_file for this snap is: volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.4107f506-c640-4b0e-b4db-c0b56f42fcad {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 17:50:27 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[411f77ed-346d-42bc-862c-e939cd54b48a]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:50:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-95586f77-a744-4d78-8e38-833cec18d68c tempest-SnapshotsActionsTest-1297661370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.4107f506-c640-4b0e-b4db-c0b56f42fcad {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f26a977f-3f51-48ea-9637-cefcb9e8e36b tempest-VolumesListAdminTestJSON-1746153784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-20f8045f-5e0f-4180-80d9-50484c0d7cb3 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:27 devstack sudo[95038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-20f8045f-5e0f-4180-80d9-50484c0d7cb3 Nov 06 17:50:27 devstack sudo[95038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:27 devstack sudo[95037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.4107f506-c640-4b0e-b4db-c0b56f42fcad Nov 06 17:50:27 devstack sudo[95037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:27 devstack sudo[95038]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f26a977f-3f51-48ea-9637-cefcb9e8e36b tempest-VolumesListAdminTestJSON-1746153784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-20f8045f-5e0f-4180-80d9-50484c0d7cb3" returned: 0 in 0.270s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f26a977f-3f51-48ea-9637-cefcb9e8e36b tempest-VolumesListAdminTestJSON-1746153784 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:50:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f26a977f-3f51-48ea-9637-cefcb9e8e36b tempest-VolumesListAdminTestJSON-1746153784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:50:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f26a977f-3f51-48ea-9637-cefcb9e8e36b tempest-VolumesListAdminTestJSON-1746153784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (311d2927-f68f-4126-bb03-fe7ee1477bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20f8045f-5e0f-4180-80d9-50484c0d7cb3', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:50:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f26a977f-3f51-48ea-9637-cefcb9e8e36b tempest-VolumesListAdminTestJSON-1746153784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8de16ac9-9287-48c0-925c-cc589cace18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:50:27 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-f26a977f-3f51-48ea-9637-cefcb9e8e36b tempest-VolumesListAdminTestJSON-1746153784 None] Volume volume-20f8045f-5e0f-4180-80d9-50484c0d7cb3 (20f8045f-5e0f-4180-80d9-50484c0d7cb3): created successfully Nov 06 17:50:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f26a977f-3f51-48ea-9637-cefcb9e8e36b tempest-VolumesListAdminTestJSON-1746153784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8de16ac9-9287-48c0-925c-cc589cace18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:50:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f26a977f-3f51-48ea-9637-cefcb9e8e36b tempest-VolumesListAdminTestJSON-1746153784 None] Flow 'volume_create_manager' (4be31724-6622-4077-9e61-be2735993aad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:50:27 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-f26a977f-3f51-48ea-9637-cefcb9e8e36b tempest-VolumesListAdminTestJSON-1746153784 None] Created volume successfully. Nov 06 17:50:27 devstack sudo[95037]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-95586f77-a744-4d78-8e38-833cec18d68c tempest-SnapshotsActionsTest-1297661370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.4107f506-c640-4b0e-b4db-c0b56f42fcad" returned: 0 in 0.436s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-95586f77-a744-4d78-8e38-833cec18d68c tempest-SnapshotsActionsTest-1297661370 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d50918bc-f0e8-4572-bceb-84e9d767c65e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 17:50:27 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf2b013-b514-4a17-bd05-7fb64a1887cb]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:50:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-95586f77-a744-4d78-8e38-833cec18d68c tempest-SnapshotsActionsTest-1297661370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:27 devstack sudo[95046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240 Nov 06 17:50:27 devstack sudo[95046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:28 devstack sudo[95046]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-95586f77-a744-4d78-8e38-833cec18d68c tempest-SnapshotsActionsTest-1297661370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240" returned: 0 in 0.394s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-95586f77-a744-4d78-8e38-833cec18d68c tempest-SnapshotsActionsTest-1297661370 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d50918bc-f0e8-4572-bceb-84e9d767c65e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 17:50:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-95586f77-a744-4d78-8e38-833cec18d68c tempest-SnapshotsActionsTest-1297661370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.4107f506-c640-4b0e-b4db-c0b56f42fcad {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:28 devstack sudo[95051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.4107f506-c640-4b0e-b4db-c0b56f42fcad Nov 06 17:50:28 devstack sudo[95051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:28 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c2a3915e-0c58-4139-8056-1a3d5d8f388b tempest-VolumesListAdminTestJSON-1746153784 None] Acquiring lock "cinder-20f8045f-5e0f-4180-80d9-50484c0d7cb3-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:50:28 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c2a3915e-0c58-4139-8056-1a3d5d8f388b tempest-VolumesListAdminTestJSON-1746153784 None] Lock "cinder-20f8045f-5e0f-4180-80d9-50484c0d7cb3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:50:28 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c2a3915e-0c58-4139-8056-1a3d5d8f388b tempest-VolumesListAdminTestJSON-1746153784 None] Acquiring lock "cinder-quobyte-20f8045f-5e0f-4180-80d9-50484c0d7cb3" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:50:28 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c2a3915e-0c58-4139-8056-1a3d5d8f388b tempest-VolumesListAdminTestJSON-1746153784 None] Lock "cinder-quobyte-20f8045f-5e0f-4180-80d9-50484c0d7cb3" acquired by "delete_volume" :: waited 0.017s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:50:28 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[334b196b-3d0b-4457-86b8-4a01d24e732c]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:50:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c2a3915e-0c58-4139-8056-1a3d5d8f388b tempest-VolumesListAdminTestJSON-1746153784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-20f8045f-5e0f-4180-80d9-50484c0d7cb3 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:28 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9e746a4e-72f1-463a-892b-e61e49dfdb5a tempest-VolumesListAdminTestJSON-209193959 None] Acquiring lock "cinder-61f3eb67-beaf-4c75-a3e0-292f950cf3bc-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:50:28 devstack sudo[95051]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-95586f77-a744-4d78-8e38-833cec18d68c tempest-SnapshotsActionsTest-1297661370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.4107f506-c640-4b0e-b4db-c0b56f42fcad" returned: 0 in 0.547s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-95586f77-a744-4d78-8e38-833cec18d68c tempest-SnapshotsActionsTest-1297661370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.4107f506-c640-4b0e-b4db-c0b56f42fcad {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:28 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9e746a4e-72f1-463a-892b-e61e49dfdb5a tempest-VolumesListAdminTestJSON-209193959 None] Lock "cinder-61f3eb67-beaf-4c75-a3e0-292f950cf3bc-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:50:28 devstack sudo[95056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-20f8045f-5e0f-4180-80d9-50484c0d7cb3 Nov 06 17:50:28 devstack sudo[95057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.4107f506-c640-4b0e-b4db-c0b56f42fcad Nov 06 17:50:28 devstack sudo[95057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:28 devstack sudo[95056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:28 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9e746a4e-72f1-463a-892b-e61e49dfdb5a tempest-VolumesListAdminTestJSON-209193959 None] Acquiring lock "cinder-quobyte-61f3eb67-beaf-4c75-a3e0-292f950cf3bc" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:50:28 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9e746a4e-72f1-463a-892b-e61e49dfdb5a tempest-VolumesListAdminTestJSON-209193959 None] Lock "cinder-quobyte-61f3eb67-beaf-4c75-a3e0-292f950cf3bc" acquired by "delete_volume" :: waited 0.031s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:50:28 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ba6362-44f8-4559-99e6-059434a4b05e]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:50:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9e746a4e-72f1-463a-892b-e61e49dfdb5a tempest-VolumesListAdminTestJSON-209193959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-61f3eb67-beaf-4c75-a3e0-292f950cf3bc {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:29 devstack sudo[95057]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-95586f77-a744-4d78-8e38-833cec18d68c tempest-SnapshotsActionsTest-1297661370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.4107f506-c640-4b0e-b4db-c0b56f42fcad" returned: 0 in 0.405s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:29 devstack sudo[95062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-61f3eb67-beaf-4c75-a3e0-292f950cf3bc Nov 06 17:50:29 devstack sudo[95062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:29 devstack sudo[95056]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c2a3915e-0c58-4139-8056-1a3d5d8f388b tempest-VolumesListAdminTestJSON-1746153784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-20f8045f-5e0f-4180-80d9-50484c0d7cb3" returned: 0 in 0.562s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c2a3915e-0c58-4139-8056-1a3d5d8f388b tempest-VolumesListAdminTestJSON-1746153784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-20f8045f-5e0f-4180-80d9-50484c0d7cb3 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:29 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-95586f77-a744-4d78-8e38-833cec18d68c tempest-SnapshotsActionsTest-1297661370 None] Lock "cinder-quobyte-4107f506-c640-4b0e-b4db-c0b56f42fcad" released by "_delete_snapshot" :: held 1.926s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:50:29 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-95586f77-a744-4d78-8e38-833cec18d68c tempest-SnapshotsActionsTest-1297661370 None] Lock "cinder-quobyte-d50918bc-f0e8-4572-bceb-84e9d767c65e" released by "delete_snapshot" :: held 1.958s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:50:29 devstack sudo[95068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-20f8045f-5e0f-4180-80d9-50484c0d7cb3 Nov 06 17:50:29 devstack sudo[95068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:29 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-95586f77-a744-4d78-8e38-833cec18d68c tempest-SnapshotsActionsTest-1297661370 None] Created reservations ['2723092f-d849-4456-8357-9d13d34d81c6', '59a8df44-5611-4464-81ed-36aad48e4466', '27303db1-6e72-4f1f-ba9c-4b78e70c74a2', '896baf6d-3a9a-410b-a800-dd89ed4b8dc2'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:50:29 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-95586f77-a744-4d78-8e38-833cec18d68c tempest-SnapshotsActionsTest-1297661370 None] Delete snapshot completed successfully. Nov 06 17:50:29 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-95586f77-a744-4d78-8e38-833cec18d68c tempest-SnapshotsActionsTest-1297661370 None] Lock "cinder-4107f506-c640-4b0e-b4db-c0b56f42fcad-delete_snapshot" released by "delete_snapshot" :: held 2.131s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:50:29 devstack sudo[95062]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9e746a4e-72f1-463a-892b-e61e49dfdb5a tempest-VolumesListAdminTestJSON-209193959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-61f3eb67-beaf-4c75-a3e0-292f950cf3bc" returned: 0 in 0.552s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9e746a4e-72f1-463a-892b-e61e49dfdb5a tempest-VolumesListAdminTestJSON-209193959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-61f3eb67-beaf-4c75-a3e0-292f950cf3bc {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:29 devstack sudo[95074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-61f3eb67-beaf-4c75-a3e0-292f950cf3bc Nov 06 17:50:29 devstack sudo[95074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:29 devstack sudo[95068]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c2a3915e-0c58-4139-8056-1a3d5d8f388b tempest-VolumesListAdminTestJSON-1746153784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-20f8045f-5e0f-4180-80d9-50484c0d7cb3" returned: 0 in 0.363s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:29 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c2a3915e-0c58-4139-8056-1a3d5d8f388b tempest-VolumesListAdminTestJSON-1746153784 None] Lock "cinder-quobyte-20f8045f-5e0f-4180-80d9-50484c0d7cb3" released by "delete_volume" :: held 0.989s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:50:29 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-c2a3915e-0c58-4139-8056-1a3d5d8f388b tempest-VolumesListAdminTestJSON-1746153784 None] Created reservations ['8e573dea-d11d-4aaa-beb7-57153b46dad2', '906543fe-50d7-4ed0-8ba1-93b694cd4cf5', 'afc84c7c-4b6c-40a5-a56b-68037b8fd7c9', 'bc553c00-67da-4ccd-a599-e51b49d8b510'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:50:29 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-72e592a7-0c0f-4c14-a7e8-7dcfd4f63888 tempest-AttachVolumeNegativeTest-577825985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:50:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-72e592a7-0c0f-4c14-a7e8-7dcfd4f63888 tempest-AttachVolumeNegativeTest-577825985 None] Flow 'volume_create_manager' (e9e0dd80-7505-439c-8193-a9ce26abd206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:50:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-72e592a7-0c0f-4c14-a7e8-7dcfd4f63888 tempest-AttachVolumeNegativeTest-577825985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db7bfdc5-a2fd-467e-b0c6-559c0c6e2c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:50:29 devstack sudo[95074]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-72e592a7-0c0f-4c14-a7e8-7dcfd4f63888 tempest-AttachVolumeNegativeTest-577825985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db7bfdc5-a2fd-467e-b0c6-559c0c6e2c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1958591959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25f3c2c8-fe4b-4576-a10d-6d94e42c0bc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a899b78c2d34f678680c8113c7dc62f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:50:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:50:30Z,use_quota=True,user_id='3ac9532494834390be879588a01db91d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:50:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-72e592a7-0c0f-4c14-a7e8-7dcfd4f63888 tempest-AttachVolumeNegativeTest-577825985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14cbe3b9-878d-432d-af29-e3c7927f1866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:50:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-72e592a7-0c0f-4c14-a7e8-7dcfd4f63888 tempest-AttachVolumeNegativeTest-577825985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14cbe3b9-878d-432d-af29-e3c7927f1866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:50:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-72e592a7-0c0f-4c14-a7e8-7dcfd4f63888 tempest-AttachVolumeNegativeTest-577825985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba816d22-09a6-4dba-8c09-c161e51a08d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:50:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-72e592a7-0c0f-4c14-a7e8-7dcfd4f63888 tempest-AttachVolumeNegativeTest-577825985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba816d22-09a6-4dba-8c09-c161e51a08d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25f3c2c8-fe4b-4576-a10d-6d94e42c0bc8', 'volume_name': 'volume-25f3c2c8-fe4b-4576-a10d-6d94e42c0bc8', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:50:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-72e592a7-0c0f-4c14-a7e8-7dcfd4f63888 tempest-AttachVolumeNegativeTest-577825985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24696315-f0f6-4c65-b775-c8ad8be3a7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:50:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-72e592a7-0c0f-4c14-a7e8-7dcfd4f63888 tempest-AttachVolumeNegativeTest-577825985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24696315-f0f6-4c65-b775-c8ad8be3a7cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:50:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-72e592a7-0c0f-4c14-a7e8-7dcfd4f63888 tempest-AttachVolumeNegativeTest-577825985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (255e1038-3482-4270-9bc5-c70fa75fd196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:50:29 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-72e592a7-0c0f-4c14-a7e8-7dcfd4f63888 tempest-AttachVolumeNegativeTest-577825985 None] Volume 25f3c2c8-fe4b-4576-a10d-6d94e42c0bc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25f3c2c8-fe4b-4576-a10d-6d94e42c0bc8', 'volume_size': 1} Nov 06 17:50:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-72e592a7-0c0f-4c14-a7e8-7dcfd4f63888 tempest-AttachVolumeNegativeTest-577825985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:50:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-72e592a7-0c0f-4c14-a7e8-7dcfd4f63888 tempest-AttachVolumeNegativeTest-577825985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:50:29 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-72e592a7-0c0f-4c14-a7e8-7dcfd4f63888 tempest-AttachVolumeNegativeTest-577825985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1958591959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25f3c2c8-fe4b-4576-a10d-6d94e42c0bc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a899b78c2d34f678680c8113c7dc62f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:50:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:50:30Z,use_quota=True,user_id='3ac9532494834390be879588a01db91d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:50:29 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-72e592a7-0c0f-4c14-a7e8-7dcfd4f63888 tempest-AttachVolumeNegativeTest-577825985 None] Creating volume 25f3c2c8-fe4b-4576-a10d-6d94e42c0bc8 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:50:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-72e592a7-0c0f-4c14-a7e8-7dcfd4f63888 tempest-AttachVolumeNegativeTest-577825985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:50:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-72e592a7-0c0f-4c14-a7e8-7dcfd4f63888 tempest-AttachVolumeNegativeTest-577825985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:50:29 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-72e592a7-0c0f-4c14-a7e8-7dcfd4f63888 tempest-AttachVolumeNegativeTest-577825985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:50:29 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-72e592a7-0c0f-4c14-a7e8-7dcfd4f63888 tempest-AttachVolumeNegativeTest-577825985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:50:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-72e592a7-0c0f-4c14-a7e8-7dcfd4f63888 tempest-AttachVolumeNegativeTest-577825985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:50:29 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-72e592a7-0c0f-4c14-a7e8-7dcfd4f63888 tempest-AttachVolumeNegativeTest-577825985 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:50:29 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-72e592a7-0c0f-4c14-a7e8-7dcfd4f63888 tempest-AttachVolumeNegativeTest-577825985 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:50:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-72e592a7-0c0f-4c14-a7e8-7dcfd4f63888 tempest-AttachVolumeNegativeTest-577825985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-25f3c2c8-fe4b-4576-a10d-6d94e42c0bc8 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9e746a4e-72f1-463a-892b-e61e49dfdb5a tempest-VolumesListAdminTestJSON-209193959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-61f3eb67-beaf-4c75-a3e0-292f950cf3bc" returned: 0 in 0.388s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:29 devstack sudo[95077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-25f3c2c8-fe4b-4576-a10d-6d94e42c0bc8 1073741824 Nov 06 17:50:29 devstack sudo[95077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:29 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9e746a4e-72f1-463a-892b-e61e49dfdb5a tempest-VolumesListAdminTestJSON-209193959 None] Lock "cinder-quobyte-61f3eb67-beaf-4c75-a3e0-292f950cf3bc" released by "delete_volume" :: held 1.027s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:50:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c2a3915e-0c58-4139-8056-1a3d5d8f388b tempest-VolumesListAdminTestJSON-1746153784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:50:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c2a3915e-0c58-4139-8056-1a3d5d8f388b tempest-VolumesListAdminTestJSON-1746153784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:50:29 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c2a3915e-0c58-4139-8056-1a3d5d8f388b tempest-VolumesListAdminTestJSON-1746153784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:50:29 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c2a3915e-0c58-4139-8056-1a3d5d8f388b tempest-VolumesListAdminTestJSON-1746153784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:50:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c2a3915e-0c58-4139-8056-1a3d5d8f388b tempest-VolumesListAdminTestJSON-1746153784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:50:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c2a3915e-0c58-4139-8056-1a3d5d8f388b tempest-VolumesListAdminTestJSON-1746153784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:29 devstack sudo[95079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:50:29 devstack sudo[95079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:29 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-9e746a4e-72f1-463a-892b-e61e49dfdb5a tempest-VolumesListAdminTestJSON-209193959 None] Created reservations ['a316890d-b14c-465d-ac00-c755aa5caff9', '6bc56ecf-b668-4bda-8d5c-3bc27c91c621', '6c17f7e2-ea1c-4642-8a80-2eae2d6cd4d9', '197372d1-0853-44b6-9af8-fdc5031d8572'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:50:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9e746a4e-72f1-463a-892b-e61e49dfdb5a tempest-VolumesListAdminTestJSON-209193959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:50:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9e746a4e-72f1-463a-892b-e61e49dfdb5a tempest-VolumesListAdminTestJSON-209193959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:50:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9e746a4e-72f1-463a-892b-e61e49dfdb5a tempest-VolumesListAdminTestJSON-209193959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:50:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9e746a4e-72f1-463a-892b-e61e49dfdb5a tempest-VolumesListAdminTestJSON-209193959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:50:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9e746a4e-72f1-463a-892b-e61e49dfdb5a tempest-VolumesListAdminTestJSON-209193959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:50:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9e746a4e-72f1-463a-892b-e61e49dfdb5a tempest-VolumesListAdminTestJSON-209193959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:30 devstack sudo[95081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:50:30 devstack sudo[95081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:30 devstack sudo[95079]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c2a3915e-0c58-4139-8056-1a3d5d8f388b tempest-VolumesListAdminTestJSON-1746153784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.417s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:30 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-c2a3915e-0c58-4139-8056-1a3d5d8f388b tempest-VolumesListAdminTestJSON-1746153784 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:50:30 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-c2a3915e-0c58-4139-8056-1a3d5d8f388b tempest-VolumesListAdminTestJSON-1746153784 None] Deleted volume successfully. Nov 06 17:50:30 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c2a3915e-0c58-4139-8056-1a3d5d8f388b tempest-VolumesListAdminTestJSON-1746153784 None] Lock "cinder-20f8045f-5e0f-4180-80d9-50484c0d7cb3-delete_volume" released by "delete_volume" :: held 1.867s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:50:30 devstack sudo[95081]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9e746a4e-72f1-463a-892b-e61e49dfdb5a tempest-VolumesListAdminTestJSON-209193959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.360s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:30 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-9e746a4e-72f1-463a-892b-e61e49dfdb5a tempest-VolumesListAdminTestJSON-209193959 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:50:30 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-9e746a4e-72f1-463a-892b-e61e49dfdb5a tempest-VolumesListAdminTestJSON-209193959 None] Deleted volume successfully. Nov 06 17:50:30 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9e746a4e-72f1-463a-892b-e61e49dfdb5a tempest-VolumesListAdminTestJSON-209193959 None] Lock "cinder-61f3eb67-beaf-4c75-a3e0-292f950cf3bc-delete_volume" released by "delete_volume" :: held 1.731s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:50:30 devstack sudo[95077]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-72e592a7-0c0f-4c14-a7e8-7dcfd4f63888 tempest-AttachVolumeNegativeTest-577825985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-25f3c2c8-fe4b-4576-a10d-6d94e42c0bc8 1073741824" returned: 0 in 0.665s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-72e592a7-0c0f-4c14-a7e8-7dcfd4f63888 tempest-AttachVolumeNegativeTest-577825985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-25f3c2c8-fe4b-4576-a10d-6d94e42c0bc8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:30 devstack sudo[95090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-25f3c2c8-fe4b-4576-a10d-6d94e42c0bc8 Nov 06 17:50:30 devstack sudo[95090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f7cac623-3213-4e6f-9b30-ef812c3744d1 tempest-SnapshotsActionsTest-284033357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:50:30 devstack sudo[95090]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-72e592a7-0c0f-4c14-a7e8-7dcfd4f63888 tempest-AttachVolumeNegativeTest-577825985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-25f3c2c8-fe4b-4576-a10d-6d94e42c0bc8" returned: 0 in 0.289s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-72e592a7-0c0f-4c14-a7e8-7dcfd4f63888 tempest-AttachVolumeNegativeTest-577825985 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:50:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-72e592a7-0c0f-4c14-a7e8-7dcfd4f63888 tempest-AttachVolumeNegativeTest-577825985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:50:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f7cac623-3213-4e6f-9b30-ef812c3744d1 tempest-SnapshotsActionsTest-284033357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.026s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:50:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-72e592a7-0c0f-4c14-a7e8-7dcfd4f63888 tempest-AttachVolumeNegativeTest-577825985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (255e1038-3482-4270-9bc5-c70fa75fd196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25f3c2c8-fe4b-4576-a10d-6d94e42c0bc8', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:50:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-72e592a7-0c0f-4c14-a7e8-7dcfd4f63888 tempest-AttachVolumeNegativeTest-577825985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3938b649-96ef-4ecb-bf90-43f6b7643260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:50:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-f7cac623-3213-4e6f-9b30-ef812c3744d1 tempest-SnapshotsActionsTest-284033357 None] Creating offline snapshot 44f911ee-a5c0-4d52-9e4a-7ffdddc5d550 of volume d50918bc-f0e8-4572-bceb-84e9d767c65e {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 17:50:30 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-72e592a7-0c0f-4c14-a7e8-7dcfd4f63888 tempest-AttachVolumeNegativeTest-577825985 None] Volume volume-25f3c2c8-fe4b-4576-a10d-6d94e42c0bc8 (25f3c2c8-fe4b-4576-a10d-6d94e42c0bc8): created successfully Nov 06 17:50:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-72e592a7-0c0f-4c14-a7e8-7dcfd4f63888 tempest-AttachVolumeNegativeTest-577825985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3938b649-96ef-4ecb-bf90-43f6b7643260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:50:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-72e592a7-0c0f-4c14-a7e8-7dcfd4f63888 tempest-AttachVolumeNegativeTest-577825985 None] Flow 'volume_create_manager' (e9e0dd80-7505-439c-8193-a9ce26abd206) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:50:31 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18932ed-cf1a-493b-83ee-ddee91c447d7]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:50:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f7cac623-3213-4e6f-9b30-ef812c3744d1 tempest-SnapshotsActionsTest-284033357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:31 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-72e592a7-0c0f-4c14-a7e8-7dcfd4f63888 tempest-AttachVolumeNegativeTest-577825985 None] Created volume successfully. Nov 06 17:50:31 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-fba247d0-e1bc-41de-8e83-2fa4b05b4041 tempest-VolumesListAdminTestJSON-209193959 None] Acquiring lock "cinder-21ed33a0-06a6-4119-b858-e2f5f486be5e-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:50:31 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-fba247d0-e1bc-41de-8e83-2fa4b05b4041 tempest-VolumesListAdminTestJSON-209193959 None] Lock "cinder-21ed33a0-06a6-4119-b858-e2f5f486be5e-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:50:31 devstack sudo[95093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240 Nov 06 17:50:31 devstack sudo[95093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:31 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-fba247d0-e1bc-41de-8e83-2fa4b05b4041 tempest-VolumesListAdminTestJSON-209193959 None] Acquiring lock "cinder-quobyte-21ed33a0-06a6-4119-b858-e2f5f486be5e" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:50:31 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-fba247d0-e1bc-41de-8e83-2fa4b05b4041 tempest-VolumesListAdminTestJSON-209193959 None] Lock "cinder-quobyte-21ed33a0-06a6-4119-b858-e2f5f486be5e" acquired by "delete_volume" :: waited 0.026s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:50:31 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd4d450-5afd-4785-99ef-e44677fce2f1]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:50:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fba247d0-e1bc-41de-8e83-2fa4b05b4041 tempest-VolumesListAdminTestJSON-209193959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-21ed33a0-06a6-4119-b858-e2f5f486be5e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:31 devstack sudo[95096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-21ed33a0-06a6-4119-b858-e2f5f486be5e Nov 06 17:50:31 devstack sudo[95096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:31 devstack sudo[95093]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f7cac623-3213-4e6f-9b30-ef812c3744d1 tempest-SnapshotsActionsTest-284033357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240" returned: 0 in 0.491s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-f7cac623-3213-4e6f-9b30-ef812c3744d1 tempest-SnapshotsActionsTest-284033357 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d50918bc-f0e8-4572-bceb-84e9d767c65e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 17:50:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f7cac623-3213-4e6f-9b30-ef812c3744d1 tempest-SnapshotsActionsTest-284033357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.44f911ee-a5c0-4d52-9e4a-7ffdddc5d550 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:31 devstack sudo[95101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.44f911ee-a5c0-4d52-9e4a-7ffdddc5d550 1G Nov 06 17:50:31 devstack sudo[95101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:31 devstack sudo[95096]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fba247d0-e1bc-41de-8e83-2fa4b05b4041 tempest-VolumesListAdminTestJSON-209193959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-21ed33a0-06a6-4119-b858-e2f5f486be5e" returned: 0 in 0.465s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fba247d0-e1bc-41de-8e83-2fa4b05b4041 tempest-VolumesListAdminTestJSON-209193959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-21ed33a0-06a6-4119-b858-e2f5f486be5e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:31 devstack sudo[95108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-21ed33a0-06a6-4119-b858-e2f5f486be5e Nov 06 17:50:31 devstack sudo[95108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:32 devstack sudo[95108]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fba247d0-e1bc-41de-8e83-2fa4b05b4041 tempest-VolumesListAdminTestJSON-209193959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-21ed33a0-06a6-4119-b858-e2f5f486be5e" returned: 0 in 0.316s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:32 devstack sudo[95101]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f7cac623-3213-4e6f-9b30-ef812c3744d1 tempest-SnapshotsActionsTest-284033357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.44f911ee-a5c0-4d52-9e4a-7ffdddc5d550 1G" returned: 0 in 0.605s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f7cac623-3213-4e6f-9b30-ef812c3744d1 tempest-SnapshotsActionsTest-284033357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.44f911ee-a5c0-4d52-9e4a-7ffdddc5d550 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-fba247d0-e1bc-41de-8e83-2fa4b05b4041 tempest-VolumesListAdminTestJSON-209193959 None] Lock "cinder-quobyte-21ed33a0-06a6-4119-b858-e2f5f486be5e" released by "delete_volume" :: held 0.874s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:50:32 devstack sudo[95117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.44f911ee-a5c0-4d52-9e4a-7ffdddc5d550 Nov 06 17:50:32 devstack sudo[95117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:32 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-fba247d0-e1bc-41de-8e83-2fa4b05b4041 tempest-VolumesListAdminTestJSON-209193959 None] Created reservations ['e156d154-660f-4957-bd3f-b24449f987ef', 'fe84ff18-08e0-47cb-8dd9-9b1a88a6c913', '380ce428-f217-4486-886a-32c35d044e1b', '992fa887-8992-4835-8f93-7db64ae9b969'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:50:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fba247d0-e1bc-41de-8e83-2fa4b05b4041 tempest-VolumesListAdminTestJSON-209193959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:50:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fba247d0-e1bc-41de-8e83-2fa4b05b4041 tempest-VolumesListAdminTestJSON-209193959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:50:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fba247d0-e1bc-41de-8e83-2fa4b05b4041 tempest-VolumesListAdminTestJSON-209193959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:50:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fba247d0-e1bc-41de-8e83-2fa4b05b4041 tempest-VolumesListAdminTestJSON-209193959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:50:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fba247d0-e1bc-41de-8e83-2fa4b05b4041 tempest-VolumesListAdminTestJSON-209193959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:50:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fba247d0-e1bc-41de-8e83-2fa4b05b4041 tempest-VolumesListAdminTestJSON-209193959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:32 devstack sudo[95120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:50:32 devstack sudo[95120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:32 devstack sudo[95117]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f7cac623-3213-4e6f-9b30-ef812c3744d1 tempest-SnapshotsActionsTest-284033357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.44f911ee-a5c0-4d52-9e4a-7ffdddc5d550" returned: 0 in 0.477s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:32 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-f7cac623-3213-4e6f-9b30-ef812c3744d1 tempest-SnapshotsActionsTest-284033357 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.44f911ee-a5c0-4d52-9e4a-7ffdddc5d550 is being set with open permissions: ugo+rw Nov 06 17:50:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f7cac623-3213-4e6f-9b30-ef812c3744d1 tempest-SnapshotsActionsTest-284033357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.44f911ee-a5c0-4d52-9e4a-7ffdddc5d550 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:32 devstack sudo[95132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.44f911ee-a5c0-4d52-9e4a-7ffdddc5d550 Nov 06 17:50:32 devstack sudo[95132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-89b87d7b-e8da-4769-a9ec-c4973266c45d req-041eadc2-98ea-4179-8947-b17678fcbaf3 tempest-AttachVolumeNegativeTest-577825985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:50:32 devstack sudo[95120]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fba247d0-e1bc-41de-8e83-2fa4b05b4041 tempest-VolumesListAdminTestJSON-209193959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.430s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:32 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-fba247d0-e1bc-41de-8e83-2fa4b05b4041 tempest-VolumesListAdminTestJSON-209193959 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:50:32 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-fba247d0-e1bc-41de-8e83-2fa4b05b4041 tempest-VolumesListAdminTestJSON-209193959 None] Deleted volume successfully. Nov 06 17:50:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-fba247d0-e1bc-41de-8e83-2fa4b05b4041 tempest-VolumesListAdminTestJSON-209193959 None] Lock "cinder-21ed33a0-06a6-4119-b858-e2f5f486be5e-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:50:32 devstack sudo[95132]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f7cac623-3213-4e6f-9b30-ef812c3744d1 tempest-SnapshotsActionsTest-284033357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.44f911ee-a5c0-4d52-9e4a-7ffdddc5d550" returned: 0 in 0.313s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f7cac623-3213-4e6f-9b30-ef812c3744d1 tempest-SnapshotsActionsTest-284033357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.084s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:50:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-89b87d7b-e8da-4769-a9ec-c4973266c45d req-041eadc2-98ea-4179-8947-b17678fcbaf3 tempest-AttachVolumeNegativeTest-577825985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.158s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:50:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-89b87d7b-e8da-4769-a9ec-c4973266c45d req-041eadc2-98ea-4179-8947-b17678fcbaf3 tempest-AttachVolumeNegativeTest-577825985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:50:32 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-f7cac623-3213-4e6f-9b30-ef812c3744d1 tempest-SnapshotsActionsTest-284033357 None] Create snapshot completed successfully Nov 06 17:50:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-89b87d7b-e8da-4769-a9ec-c4973266c45d req-041eadc2-98ea-4179-8947-b17678fcbaf3 tempest-AttachVolumeNegativeTest-577825985 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072', 'name': 'volume-25f3c2c8-fe4b-4576-a10d-6d94e42c0bc8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2e6b6091-c5b4-41bb-93d1-63c59b80ae23', 'enforce_multipath': True} {{(pid=87068) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 17:50:33 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-89b87d7b-e8da-4769-a9ec-c4973266c45d req-041eadc2-98ea-4179-8947-b17678fcbaf3 tempest-AttachVolumeNegativeTest-577825985 None] attachment_update completed successfully. Nov 06 17:50:33 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-90f4bb29-f3e1-4e92-a866-4227fe6d6228 tempest-VolumesListAdminTestJSON-209193959 None] Acquiring lock "cinder-4bf6244d-0066-4a18-bddc-eb0900dd7864-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:50:33 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-90f4bb29-f3e1-4e92-a866-4227fe6d6228 tempest-VolumesListAdminTestJSON-209193959 None] Lock "cinder-4bf6244d-0066-4a18-bddc-eb0900dd7864-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:50:33 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-90f4bb29-f3e1-4e92-a866-4227fe6d6228 tempest-VolumesListAdminTestJSON-209193959 None] Acquiring lock "cinder-quobyte-4bf6244d-0066-4a18-bddc-eb0900dd7864" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:50:33 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-90f4bb29-f3e1-4e92-a866-4227fe6d6228 tempest-VolumesListAdminTestJSON-209193959 None] Lock "cinder-quobyte-4bf6244d-0066-4a18-bddc-eb0900dd7864" acquired by "delete_volume" :: waited 0.017s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:50:33 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32eb90e-2832-4ea3-91a9-6b2f7d1fe7d1]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:50:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-90f4bb29-f3e1-4e92-a866-4227fe6d6228 tempest-VolumesListAdminTestJSON-209193959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4bf6244d-0066-4a18-bddc-eb0900dd7864 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:33 devstack sudo[95552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4bf6244d-0066-4a18-bddc-eb0900dd7864 Nov 06 17:50:33 devstack sudo[95552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:34 devstack sudo[95552]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d47582c0-8068-4f0a-923a-925defd02a88 tempest-SnapshotsActionsTest-1297661370 None] Acquiring lock "cinder-44f911ee-a5c0-4d52-9e4a-7ffdddc5d550-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:50:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-90f4bb29-f3e1-4e92-a866-4227fe6d6228 tempest-VolumesListAdminTestJSON-209193959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4bf6244d-0066-4a18-bddc-eb0900dd7864" returned: 0 in 0.502s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-90f4bb29-f3e1-4e92-a866-4227fe6d6228 tempest-VolumesListAdminTestJSON-209193959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4bf6244d-0066-4a18-bddc-eb0900dd7864 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d47582c0-8068-4f0a-923a-925defd02a88 tempest-SnapshotsActionsTest-1297661370 None] Lock "cinder-44f911ee-a5c0-4d52-9e4a-7ffdddc5d550-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:50:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d47582c0-8068-4f0a-923a-925defd02a88 tempest-SnapshotsActionsTest-1297661370 None] Acquiring lock "cinder-quobyte-d50918bc-f0e8-4572-bceb-84e9d767c65e" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:50:34 devstack sudo[95557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4bf6244d-0066-4a18-bddc-eb0900dd7864 Nov 06 17:50:34 devstack sudo[95557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d47582c0-8068-4f0a-923a-925defd02a88 tempest-SnapshotsActionsTest-1297661370 None] Lock "cinder-quobyte-d50918bc-f0e8-4572-bceb-84e9d767c65e" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:50:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d47582c0-8068-4f0a-923a-925defd02a88 tempest-SnapshotsActionsTest-1297661370 None] Acquiring lock "cinder-quobyte-44f911ee-a5c0-4d52-9e4a-7ffdddc5d550" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:50:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d47582c0-8068-4f0a-923a-925defd02a88 tempest-SnapshotsActionsTest-1297661370 None] Lock "cinder-quobyte-44f911ee-a5c0-4d52-9e4a-7ffdddc5d550" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:50:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-d47582c0-8068-4f0a-923a-925defd02a88 tempest-SnapshotsActionsTest-1297661370 None] Deleting offline snapshot 44f911ee-a5c0-4d52-9e4a-7ffdddc5d550 of volume d50918bc-f0e8-4572-bceb-84e9d767c65e {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 17:50:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-d47582c0-8068-4f0a-923a-925defd02a88 tempest-SnapshotsActionsTest-1297661370 None] snapshot_file for this snap is: volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.44f911ee-a5c0-4d52-9e4a-7ffdddc5d550 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 17:50:34 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe50259-f6bf-40f6-ac26-a4c2f827e423]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:50:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d47582c0-8068-4f0a-923a-925defd02a88 tempest-SnapshotsActionsTest-1297661370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.44f911ee-a5c0-4d52-9e4a-7ffdddc5d550 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:34 devstack sudo[95559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.44f911ee-a5c0-4d52-9e4a-7ffdddc5d550 Nov 06 17:50:34 devstack sudo[95559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:34 devstack sudo[95557]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-90f4bb29-f3e1-4e92-a866-4227fe6d6228 tempest-VolumesListAdminTestJSON-209193959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4bf6244d-0066-4a18-bddc-eb0900dd7864" returned: 0 in 0.283s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-90f4bb29-f3e1-4e92-a866-4227fe6d6228 tempest-VolumesListAdminTestJSON-209193959 None] Lock "cinder-quobyte-4bf6244d-0066-4a18-bddc-eb0900dd7864" released by "delete_volume" :: held 0.863s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:50:34 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-90f4bb29-f3e1-4e92-a866-4227fe6d6228 tempest-VolumesListAdminTestJSON-209193959 None] Created reservations ['c3b1c0e5-7ed6-4601-bbd2-c1c4cb0d8f87', 'bbcc49b0-3159-4bba-94be-f587d8488764', 'bc7224e3-2267-4581-9f7a-7ddc6722d370', 'a060850a-278d-4ddd-a6ec-d25fe45a70de'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:50:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-90f4bb29-f3e1-4e92-a866-4227fe6d6228 tempest-VolumesListAdminTestJSON-209193959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:50:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-90f4bb29-f3e1-4e92-a866-4227fe6d6228 tempest-VolumesListAdminTestJSON-209193959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:50:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-90f4bb29-f3e1-4e92-a866-4227fe6d6228 tempest-VolumesListAdminTestJSON-209193959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:50:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-90f4bb29-f3e1-4e92-a866-4227fe6d6228 tempest-VolumesListAdminTestJSON-209193959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:50:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-90f4bb29-f3e1-4e92-a866-4227fe6d6228 tempest-VolumesListAdminTestJSON-209193959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:50:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-90f4bb29-f3e1-4e92-a866-4227fe6d6228 tempest-VolumesListAdminTestJSON-209193959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:34 devstack sudo[95566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:50:34 devstack sudo[95566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:34 devstack sudo[95559]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d47582c0-8068-4f0a-923a-925defd02a88 tempest-SnapshotsActionsTest-1297661370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.44f911ee-a5c0-4d52-9e4a-7ffdddc5d550" returned: 0 in 0.534s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-d47582c0-8068-4f0a-923a-925defd02a88 tempest-SnapshotsActionsTest-1297661370 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d50918bc-f0e8-4572-bceb-84e9d767c65e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 17:50:34 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b9bd05-2585-421c-9bbc-1b4fc9984afa]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:50:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d47582c0-8068-4f0a-923a-925defd02a88 tempest-SnapshotsActionsTest-1297661370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:35 devstack sudo[95568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240 Nov 06 17:50:35 devstack sudo[95568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:35 devstack sudo[95566]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-90f4bb29-f3e1-4e92-a866-4227fe6d6228 tempest-VolumesListAdminTestJSON-209193959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.440s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:35 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-90f4bb29-f3e1-4e92-a866-4227fe6d6228 tempest-VolumesListAdminTestJSON-209193959 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:50:35 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-90f4bb29-f3e1-4e92-a866-4227fe6d6228 tempest-VolumesListAdminTestJSON-209193959 None] Deleted volume successfully. Nov 06 17:50:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-90f4bb29-f3e1-4e92-a866-4227fe6d6228 tempest-VolumesListAdminTestJSON-209193959 None] Lock "cinder-4bf6244d-0066-4a18-bddc-eb0900dd7864-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:50:35 devstack sudo[95568]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d47582c0-8068-4f0a-923a-925defd02a88 tempest-SnapshotsActionsTest-1297661370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240" returned: 0 in 0.462s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:35 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-d47582c0-8068-4f0a-923a-925defd02a88 tempest-SnapshotsActionsTest-1297661370 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d50918bc-f0e8-4572-bceb-84e9d767c65e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 17:50:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d47582c0-8068-4f0a-923a-925defd02a88 tempest-SnapshotsActionsTest-1297661370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.44f911ee-a5c0-4d52-9e4a-7ffdddc5d550 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:35 devstack sudo[95575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.44f911ee-a5c0-4d52-9e4a-7ffdddc5d550 Nov 06 17:50:35 devstack sudo[95575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:35 devstack sudo[95575]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d47582c0-8068-4f0a-923a-925defd02a88 tempest-SnapshotsActionsTest-1297661370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.44f911ee-a5c0-4d52-9e4a-7ffdddc5d550" returned: 0 in 0.568s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d47582c0-8068-4f0a-923a-925defd02a88 tempest-SnapshotsActionsTest-1297661370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.44f911ee-a5c0-4d52-9e4a-7ffdddc5d550 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:35 devstack sudo[95608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.44f911ee-a5c0-4d52-9e4a-7ffdddc5d550 Nov 06 17:50:35 devstack sudo[95608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:36 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-77f05f15-7ff1-4b94-9dc3-9b5c2a732dcd req-aa5c2955-f77e-400a-ac8f-a565fea29c34 tempest-AttachVolumeNegativeTest-577825985 None] Terminate volume connection completed successfully. Nov 06 17:50:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-77f05f15-7ff1-4b94-9dc3-9b5c2a732dcd req-aa5c2955-f77e-400a-ac8f-a565fea29c34 tempest-AttachVolumeNegativeTest-577825985 None] Deleting attachment 2e6b6091-c5b4-41bb-93d1-63c59b80ae23. {{(pid=87068) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 17:50:36 devstack sudo[95608]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d47582c0-8068-4f0a-923a-925defd02a88 tempest-SnapshotsActionsTest-1297661370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.44f911ee-a5c0-4d52-9e4a-7ffdddc5d550" returned: 0 in 0.363s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d47582c0-8068-4f0a-923a-925defd02a88 tempest-SnapshotsActionsTest-1297661370 None] Lock "cinder-quobyte-44f911ee-a5c0-4d52-9e4a-7ffdddc5d550" released by "_delete_snapshot" :: held 2.074s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:50:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d47582c0-8068-4f0a-923a-925defd02a88 tempest-SnapshotsActionsTest-1297661370 None] Lock "cinder-quobyte-d50918bc-f0e8-4572-bceb-84e9d767c65e" released by "delete_snapshot" :: held 2.108s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:50:36 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-d47582c0-8068-4f0a-923a-925defd02a88 tempest-SnapshotsActionsTest-1297661370 None] Created reservations ['e211f211-898d-496a-9bb9-e5318270a60e', 'f2219756-bbb5-4ab2-8189-31d01749da4e', '324860e1-97aa-440b-a30a-4d91ddacd080', '30a07985-8d85-407e-b507-a9619232e998'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:50:36 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-d47582c0-8068-4f0a-923a-925defd02a88 tempest-SnapshotsActionsTest-1297661370 None] Delete snapshot completed successfully. Nov 06 17:50:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d47582c0-8068-4f0a-923a-925defd02a88 tempest-SnapshotsActionsTest-1297661370 None] Lock "cinder-44f911ee-a5c0-4d52-9e4a-7ffdddc5d550-delete_snapshot" released by "delete_snapshot" :: held 2.277s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:50:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-744387ce-bd60-4cbd-9141-a013e033b6af tempest-SnapshotsActionsTest-284033357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:50:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-744387ce-bd60-4cbd-9141-a013e033b6af tempest-SnapshotsActionsTest-284033357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:50:37 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-744387ce-bd60-4cbd-9141-a013e033b6af tempest-SnapshotsActionsTest-284033357 None] Creating offline snapshot 7ac9e364-c0de-4f9d-9e6e-0b7702a6914e of volume d50918bc-f0e8-4572-bceb-84e9d767c65e {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 17:50:37 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51c2401-a895-4fd0-b300-658662813be6]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:50:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-744387ce-bd60-4cbd-9141-a013e033b6af tempest-SnapshotsActionsTest-284033357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:38 devstack sudo[95633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240 Nov 06 17:50:38 devstack sudo[95633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:38 devstack sudo[95633]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-744387ce-bd60-4cbd-9141-a013e033b6af tempest-SnapshotsActionsTest-284033357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240" returned: 0 in 0.477s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-744387ce-bd60-4cbd-9141-a013e033b6af tempest-SnapshotsActionsTest-284033357 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d50918bc-f0e8-4572-bceb-84e9d767c65e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 17:50:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-744387ce-bd60-4cbd-9141-a013e033b6af tempest-SnapshotsActionsTest-284033357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.7ac9e364-c0de-4f9d-9e6e-0b7702a6914e 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:38 devstack sudo[95640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.7ac9e364-c0de-4f9d-9e6e-0b7702a6914e 1G Nov 06 17:50:38 devstack sudo[95640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:39 devstack sudo[95640]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-744387ce-bd60-4cbd-9141-a013e033b6af tempest-SnapshotsActionsTest-284033357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.7ac9e364-c0de-4f9d-9e6e-0b7702a6914e 1G" returned: 0 in 0.597s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-744387ce-bd60-4cbd-9141-a013e033b6af tempest-SnapshotsActionsTest-284033357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.7ac9e364-c0de-4f9d-9e6e-0b7702a6914e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:39 devstack sudo[95646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.7ac9e364-c0de-4f9d-9e6e-0b7702a6914e Nov 06 17:50:39 devstack sudo[95646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:39 devstack sudo[95646]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-744387ce-bd60-4cbd-9141-a013e033b6af tempest-SnapshotsActionsTest-284033357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.7ac9e364-c0de-4f9d-9e6e-0b7702a6914e" returned: 0 in 0.335s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:39 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-744387ce-bd60-4cbd-9141-a013e033b6af tempest-SnapshotsActionsTest-284033357 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.7ac9e364-c0de-4f9d-9e6e-0b7702a6914e is being set with open permissions: ugo+rw Nov 06 17:50:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-744387ce-bd60-4cbd-9141-a013e033b6af tempest-SnapshotsActionsTest-284033357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.7ac9e364-c0de-4f9d-9e6e-0b7702a6914e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:39 devstack sudo[95652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.7ac9e364-c0de-4f9d-9e6e-0b7702a6914e Nov 06 17:50:39 devstack sudo[95652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:39 devstack sudo[95652]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-744387ce-bd60-4cbd-9141-a013e033b6af tempest-SnapshotsActionsTest-284033357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.7ac9e364-c0de-4f9d-9e6e-0b7702a6914e" returned: 0 in 0.375s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-744387ce-bd60-4cbd-9141-a013e033b6af tempest-SnapshotsActionsTest-284033357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.927s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:50:39 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-744387ce-bd60-4cbd-9141-a013e033b6af tempest-SnapshotsActionsTest-284033357 None] Create snapshot completed successfully Nov 06 17:50:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6ebe4993-41ce-447b-a1af-1bfd1c6105eb tempest-SnapshotsActionsTest-1297661370 None] Acquiring lock "cinder-7ac9e364-c0de-4f9d-9e6e-0b7702a6914e-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:50:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6ebe4993-41ce-447b-a1af-1bfd1c6105eb tempest-SnapshotsActionsTest-1297661370 None] Lock "cinder-7ac9e364-c0de-4f9d-9e6e-0b7702a6914e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:50:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6ebe4993-41ce-447b-a1af-1bfd1c6105eb tempest-SnapshotsActionsTest-1297661370 None] Acquiring lock "cinder-quobyte-d50918bc-f0e8-4572-bceb-84e9d767c65e" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:50:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6ebe4993-41ce-447b-a1af-1bfd1c6105eb tempest-SnapshotsActionsTest-1297661370 None] Lock "cinder-quobyte-d50918bc-f0e8-4572-bceb-84e9d767c65e" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:50:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6ebe4993-41ce-447b-a1af-1bfd1c6105eb tempest-SnapshotsActionsTest-1297661370 None] Acquiring lock "cinder-quobyte-7ac9e364-c0de-4f9d-9e6e-0b7702a6914e" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:50:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6ebe4993-41ce-447b-a1af-1bfd1c6105eb tempest-SnapshotsActionsTest-1297661370 None] Lock "cinder-quobyte-7ac9e364-c0de-4f9d-9e6e-0b7702a6914e" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:50:40 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-6ebe4993-41ce-447b-a1af-1bfd1c6105eb tempest-SnapshotsActionsTest-1297661370 None] Deleting offline snapshot 7ac9e364-c0de-4f9d-9e6e-0b7702a6914e of volume d50918bc-f0e8-4572-bceb-84e9d767c65e {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 17:50:40 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-6ebe4993-41ce-447b-a1af-1bfd1c6105eb tempest-SnapshotsActionsTest-1297661370 None] snapshot_file for this snap is: volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.7ac9e364-c0de-4f9d-9e6e-0b7702a6914e {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 17:50:40 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02ae03c-9faf-4237-8c11-bbe3c9797073]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:50:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6ebe4993-41ce-447b-a1af-1bfd1c6105eb tempest-SnapshotsActionsTest-1297661370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.7ac9e364-c0de-4f9d-9e6e-0b7702a6914e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:40 devstack sudo[95657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.7ac9e364-c0de-4f9d-9e6e-0b7702a6914e Nov 06 17:50:40 devstack sudo[95657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:40 devstack sudo[95657]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6ebe4993-41ce-447b-a1af-1bfd1c6105eb tempest-SnapshotsActionsTest-1297661370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.7ac9e364-c0de-4f9d-9e6e-0b7702a6914e" returned: 0 in 0.459s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:40 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-6ebe4993-41ce-447b-a1af-1bfd1c6105eb tempest-SnapshotsActionsTest-1297661370 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d50918bc-f0e8-4572-bceb-84e9d767c65e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 17:50:40 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80e34dc-8373-46e8-b685-5f76c3848d83]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:50:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6ebe4993-41ce-447b-a1af-1bfd1c6105eb tempest-SnapshotsActionsTest-1297661370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:41 devstack sudo[95662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240 Nov 06 17:50:41 devstack sudo[95662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:41 devstack sudo[95662]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6ebe4993-41ce-447b-a1af-1bfd1c6105eb tempest-SnapshotsActionsTest-1297661370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240" returned: 0 in 0.445s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:41 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-6ebe4993-41ce-447b-a1af-1bfd1c6105eb tempest-SnapshotsActionsTest-1297661370 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d50918bc-f0e8-4572-bceb-84e9d767c65e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 17:50:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6ebe4993-41ce-447b-a1af-1bfd1c6105eb tempest-SnapshotsActionsTest-1297661370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.7ac9e364-c0de-4f9d-9e6e-0b7702a6914e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:41 devstack sudo[95667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.7ac9e364-c0de-4f9d-9e6e-0b7702a6914e Nov 06 17:50:41 devstack sudo[95667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:41 devstack sudo[95667]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6ebe4993-41ce-447b-a1af-1bfd1c6105eb tempest-SnapshotsActionsTest-1297661370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.7ac9e364-c0de-4f9d-9e6e-0b7702a6914e" returned: 0 in 0.490s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6ebe4993-41ce-447b-a1af-1bfd1c6105eb tempest-SnapshotsActionsTest-1297661370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.7ac9e364-c0de-4f9d-9e6e-0b7702a6914e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:41 devstack sudo[95674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.7ac9e364-c0de-4f9d-9e6e-0b7702a6914e Nov 06 17:50:41 devstack sudo[95674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:42 devstack sudo[95674]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6ebe4993-41ce-447b-a1af-1bfd1c6105eb tempest-SnapshotsActionsTest-1297661370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.7ac9e364-c0de-4f9d-9e6e-0b7702a6914e" returned: 0 in 0.374s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:42 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6ebe4993-41ce-447b-a1af-1bfd1c6105eb tempest-SnapshotsActionsTest-1297661370 None] Lock "cinder-quobyte-7ac9e364-c0de-4f9d-9e6e-0b7702a6914e" released by "_delete_snapshot" :: held 1.924s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:50:42 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6ebe4993-41ce-447b-a1af-1bfd1c6105eb tempest-SnapshotsActionsTest-1297661370 None] Lock "cinder-quobyte-d50918bc-f0e8-4572-bceb-84e9d767c65e" released by "delete_snapshot" :: held 1.957s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:50:42 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-6ebe4993-41ce-447b-a1af-1bfd1c6105eb tempest-SnapshotsActionsTest-1297661370 None] Created reservations ['2e10e526-7758-40d1-9da3-75164304df2c', '0e1da6e1-0931-4c3e-ab78-f7fd2c826fbb', '046ccdaf-7fa8-4f77-940b-2c2d48c99fc4', 'b6853823-719a-4c52-ba6c-a38d31680432'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:50:42 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-6ebe4993-41ce-447b-a1af-1bfd1c6105eb tempest-SnapshotsActionsTest-1297661370 None] Delete snapshot completed successfully. Nov 06 17:50:42 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6ebe4993-41ce-447b-a1af-1bfd1c6105eb tempest-SnapshotsActionsTest-1297661370 None] Lock "cinder-7ac9e364-c0de-4f9d-9e6e-0b7702a6914e-delete_snapshot" released by "delete_snapshot" :: held 2.196s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:50:42 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-df63858f-3a08-442e-a7fb-7481de01ead8 tempest-AttachVolumeNegativeTest-577825985 None] Acquiring lock "cinder-25f3c2c8-fe4b-4576-a10d-6d94e42c0bc8-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:50:42 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-df63858f-3a08-442e-a7fb-7481de01ead8 tempest-AttachVolumeNegativeTest-577825985 None] Lock "cinder-25f3c2c8-fe4b-4576-a10d-6d94e42c0bc8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:50:42 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-df63858f-3a08-442e-a7fb-7481de01ead8 tempest-AttachVolumeNegativeTest-577825985 None] Acquiring lock "cinder-quobyte-25f3c2c8-fe4b-4576-a10d-6d94e42c0bc8" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:50:42 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-df63858f-3a08-442e-a7fb-7481de01ead8 tempest-AttachVolumeNegativeTest-577825985 None] Lock "cinder-quobyte-25f3c2c8-fe4b-4576-a10d-6d94e42c0bc8" acquired by "delete_volume" :: waited 0.025s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:50:42 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1244433-636b-458e-bbf7-027354da99b9]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:50:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-df63858f-3a08-442e-a7fb-7481de01ead8 tempest-AttachVolumeNegativeTest-577825985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-25f3c2c8-fe4b-4576-a10d-6d94e42c0bc8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:43 devstack sudo[95677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-25f3c2c8-fe4b-4576-a10d-6d94e42c0bc8 Nov 06 17:50:43 devstack sudo[95677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:43 devstack sudo[95677]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-df63858f-3a08-442e-a7fb-7481de01ead8 tempest-AttachVolumeNegativeTest-577825985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-25f3c2c8-fe4b-4576-a10d-6d94e42c0bc8" returned: 0 in 0.434s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-df63858f-3a08-442e-a7fb-7481de01ead8 tempest-AttachVolumeNegativeTest-577825985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-25f3c2c8-fe4b-4576-a10d-6d94e42c0bc8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:43 devstack sudo[95683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-25f3c2c8-fe4b-4576-a10d-6d94e42c0bc8 Nov 06 17:50:43 devstack sudo[95683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:43 devstack sudo[95683]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-df63858f-3a08-442e-a7fb-7481de01ead8 tempest-AttachVolumeNegativeTest-577825985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-25f3c2c8-fe4b-4576-a10d-6d94e42c0bc8" returned: 0 in 0.376s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:43 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-df63858f-3a08-442e-a7fb-7481de01ead8 tempest-AttachVolumeNegativeTest-577825985 None] Lock "cinder-quobyte-25f3c2c8-fe4b-4576-a10d-6d94e42c0bc8" released by "delete_volume" :: held 0.887s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:50:43 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-df63858f-3a08-442e-a7fb-7481de01ead8 tempest-AttachVolumeNegativeTest-577825985 None] Created reservations ['fe7b977c-1d67-43f2-b9c8-668edb5b42ff', 'fc89b50f-2ef5-4ca2-b615-37fa762fc9a8', '3a2f0539-3fb4-49dc-aa41-3b9c44b9fa99', '33705c2c-4e07-4185-8c68-54294017a2c0'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:50:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-df63858f-3a08-442e-a7fb-7481de01ead8 tempest-AttachVolumeNegativeTest-577825985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:50:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-df63858f-3a08-442e-a7fb-7481de01ead8 tempest-AttachVolumeNegativeTest-577825985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:50:44 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-df63858f-3a08-442e-a7fb-7481de01ead8 tempest-AttachVolumeNegativeTest-577825985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:50:44 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-df63858f-3a08-442e-a7fb-7481de01ead8 tempest-AttachVolumeNegativeTest-577825985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:50:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-df63858f-3a08-442e-a7fb-7481de01ead8 tempest-AttachVolumeNegativeTest-577825985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:50:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-df63858f-3a08-442e-a7fb-7481de01ead8 tempest-AttachVolumeNegativeTest-577825985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:44 devstack sudo[95720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:50:44 devstack sudo[95720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:44 devstack sudo[95720]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-df63858f-3a08-442e-a7fb-7481de01ead8 tempest-AttachVolumeNegativeTest-577825985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.319s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:44 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-df63858f-3a08-442e-a7fb-7481de01ead8 tempest-AttachVolumeNegativeTest-577825985 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:50:44 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-df63858f-3a08-442e-a7fb-7481de01ead8 tempest-AttachVolumeNegativeTest-577825985 None] Deleted volume successfully. Nov 06 17:50:44 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-df63858f-3a08-442e-a7fb-7481de01ead8 tempest-AttachVolumeNegativeTest-577825985 None] Lock "cinder-25f3c2c8-fe4b-4576-a10d-6d94e42c0bc8-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:50:44 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-0d42c48c-8747-437a-bfc9-3879f8eddde7 tempest-SnapshotsActionsTest-284033357 None] Acquiring lock "cinder-92a02276-7ba6-4d17-bd33-79a5f5824240-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:50:44 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-0d42c48c-8747-437a-bfc9-3879f8eddde7 tempest-SnapshotsActionsTest-284033357 None] Lock "cinder-92a02276-7ba6-4d17-bd33-79a5f5824240-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:50:44 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-0d42c48c-8747-437a-bfc9-3879f8eddde7 tempest-SnapshotsActionsTest-284033357 None] Acquiring lock "cinder-quobyte-d50918bc-f0e8-4572-bceb-84e9d767c65e" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:50:44 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-0d42c48c-8747-437a-bfc9-3879f8eddde7 tempest-SnapshotsActionsTest-284033357 None] Lock "cinder-quobyte-d50918bc-f0e8-4572-bceb-84e9d767c65e" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:50:44 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-0d42c48c-8747-437a-bfc9-3879f8eddde7 tempest-SnapshotsActionsTest-284033357 None] Acquiring lock "cinder-quobyte-92a02276-7ba6-4d17-bd33-79a5f5824240" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:50:44 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-0d42c48c-8747-437a-bfc9-3879f8eddde7 tempest-SnapshotsActionsTest-284033357 None] Lock "cinder-quobyte-92a02276-7ba6-4d17-bd33-79a5f5824240" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:50:44 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-0d42c48c-8747-437a-bfc9-3879f8eddde7 tempest-SnapshotsActionsTest-284033357 None] Deleting offline snapshot 92a02276-7ba6-4d17-bd33-79a5f5824240 of volume d50918bc-f0e8-4572-bceb-84e9d767c65e {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 17:50:44 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-0d42c48c-8747-437a-bfc9-3879f8eddde7 tempest-SnapshotsActionsTest-284033357 None] snapshot_file for this snap is: volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 17:50:44 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[89aa5a6d-9f21-4991-9ec0-bccc9445c1cd]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:50:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0d42c48c-8747-437a-bfc9-3879f8eddde7 tempest-SnapshotsActionsTest-284033357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:44 devstack sudo[95725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240 Nov 06 17:50:44 devstack sudo[95725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:45 devstack sudo[95725]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0d42c48c-8747-437a-bfc9-3879f8eddde7 tempest-SnapshotsActionsTest-284033357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240" returned: 0 in 0.496s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:45 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-0d42c48c-8747-437a-bfc9-3879f8eddde7 tempest-SnapshotsActionsTest-284033357 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d50918bc-f0e8-4572-bceb-84e9d767c65e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 17:50:45 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2bad69-196e-41b7-81c6-85699b67798a]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:50:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0d42c48c-8747-437a-bfc9-3879f8eddde7 tempest-SnapshotsActionsTest-284033357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:45 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-52476365-85c6-45d4-9a18-b827e5ae14e5 tempest-AttachVolumeNegativeTest-577825985 None] Acquiring lock "cinder-f579ad7b-ab63-42e0-ac9e-eb6cbc816c23-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:50:45 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-52476365-85c6-45d4-9a18-b827e5ae14e5 tempest-AttachVolumeNegativeTest-577825985 None] Lock "cinder-f579ad7b-ab63-42e0-ac9e-eb6cbc816c23-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:50:45 devstack sudo[95731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e Nov 06 17:50:45 devstack sudo[95731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:45 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-52476365-85c6-45d4-9a18-b827e5ae14e5 tempest-AttachVolumeNegativeTest-577825985 None] Acquiring lock "cinder-quobyte-f579ad7b-ab63-42e0-ac9e-eb6cbc816c23" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:50:45 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-52476365-85c6-45d4-9a18-b827e5ae14e5 tempest-AttachVolumeNegativeTest-577825985 None] Lock "cinder-quobyte-f579ad7b-ab63-42e0-ac9e-eb6cbc816c23" acquired by "delete_volume" :: waited 0.024s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:50:45 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40e48f3-5177-41e4-9620-29be383b4936]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:50:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-52476365-85c6-45d4-9a18-b827e5ae14e5 tempest-AttachVolumeNegativeTest-577825985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f579ad7b-ab63-42e0-ac9e-eb6cbc816c23 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:45 devstack sudo[95733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f579ad7b-ab63-42e0-ac9e-eb6cbc816c23 Nov 06 17:50:45 devstack sudo[95733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:45 devstack sudo[95731]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0d42c48c-8747-437a-bfc9-3879f8eddde7 tempest-SnapshotsActionsTest-284033357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e" returned: 0 in 0.522s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0d42c48c-8747-437a-bfc9-3879f8eddde7 tempest-SnapshotsActionsTest-284033357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:45 devstack sudo[95738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240 Nov 06 17:50:45 devstack sudo[95738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:46 devstack sudo[95733]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-52476365-85c6-45d4-9a18-b827e5ae14e5 tempest-AttachVolumeNegativeTest-577825985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f579ad7b-ab63-42e0-ac9e-eb6cbc816c23" returned: 0 in 0.616s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-52476365-85c6-45d4-9a18-b827e5ae14e5 tempest-AttachVolumeNegativeTest-577825985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f579ad7b-ab63-42e0-ac9e-eb6cbc816c23 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:46 devstack sudo[95747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f579ad7b-ab63-42e0-ac9e-eb6cbc816c23 Nov 06 17:50:46 devstack sudo[95747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:46 devstack sudo[95738]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0d42c48c-8747-437a-bfc9-3879f8eddde7 tempest-SnapshotsActionsTest-284033357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240" returned: 0 in 0.433s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0d42c48c-8747-437a-bfc9-3879f8eddde7 tempest-SnapshotsActionsTest-284033357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:46 devstack sudo[95749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240 Nov 06 17:50:46 devstack sudo[95749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:46 devstack sudo[95747]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-52476365-85c6-45d4-9a18-b827e5ae14e5 tempest-AttachVolumeNegativeTest-577825985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f579ad7b-ab63-42e0-ac9e-eb6cbc816c23" returned: 0 in 0.417s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:46 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-52476365-85c6-45d4-9a18-b827e5ae14e5 tempest-AttachVolumeNegativeTest-577825985 None] Lock "cinder-quobyte-f579ad7b-ab63-42e0-ac9e-eb6cbc816c23" released by "delete_volume" :: held 1.108s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:50:46 devstack sudo[95749]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0d42c48c-8747-437a-bfc9-3879f8eddde7 tempest-SnapshotsActionsTest-284033357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e.92a02276-7ba6-4d17-bd33-79a5f5824240" returned: 0 in 0.360s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:46 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-0d42c48c-8747-437a-bfc9-3879f8eddde7 tempest-SnapshotsActionsTest-284033357 None] Lock "cinder-quobyte-92a02276-7ba6-4d17-bd33-79a5f5824240" released by "_delete_snapshot" :: held 1.997s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:50:46 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-0d42c48c-8747-437a-bfc9-3879f8eddde7 tempest-SnapshotsActionsTest-284033357 None] Lock "cinder-quobyte-d50918bc-f0e8-4572-bceb-84e9d767c65e" released by "delete_snapshot" :: held 2.036s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:50:46 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-52476365-85c6-45d4-9a18-b827e5ae14e5 tempest-AttachVolumeNegativeTest-577825985 None] Created reservations ['86b6bd53-c79d-41e8-8213-0f6c1ff7f87d', '39c0ab43-81df-4db0-b40b-1913cc9125cd', 'c19767d5-3385-4b68-891b-5e810474df59', '695f7883-9cf6-4754-91db-7c3e6d2b128a'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:50:46 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-0d42c48c-8747-437a-bfc9-3879f8eddde7 tempest-SnapshotsActionsTest-284033357 None] Created reservations ['55948be2-8301-4707-8cb9-f17babd9d77a', '597e7714-e221-4679-9f8f-d626e985a6bb', 'ad1664e6-625a-4dbb-8d80-16e8d6b0bc93', 'c88d6930-92de-4c71-b989-2a48904d02d5'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:50:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-52476365-85c6-45d4-9a18-b827e5ae14e5 tempest-AttachVolumeNegativeTest-577825985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:50:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-52476365-85c6-45d4-9a18-b827e5ae14e5 tempest-AttachVolumeNegativeTest-577825985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:50:46 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-52476365-85c6-45d4-9a18-b827e5ae14e5 tempest-AttachVolumeNegativeTest-577825985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:50:46 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-52476365-85c6-45d4-9a18-b827e5ae14e5 tempest-AttachVolumeNegativeTest-577825985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:50:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-52476365-85c6-45d4-9a18-b827e5ae14e5 tempest-AttachVolumeNegativeTest-577825985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:50:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-52476365-85c6-45d4-9a18-b827e5ae14e5 tempest-AttachVolumeNegativeTest-577825985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:46 devstack sudo[95753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:50:46 devstack sudo[95753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:46 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-0d42c48c-8747-437a-bfc9-3879f8eddde7 tempest-SnapshotsActionsTest-284033357 None] Delete snapshot completed successfully. Nov 06 17:50:46 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-0d42c48c-8747-437a-bfc9-3879f8eddde7 tempest-SnapshotsActionsTest-284033357 None] Lock "cinder-92a02276-7ba6-4d17-bd33-79a5f5824240-delete_snapshot" released by "delete_snapshot" :: held 2.317s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:50:47 devstack sudo[95753]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-52476365-85c6-45d4-9a18-b827e5ae14e5 tempest-AttachVolumeNegativeTest-577825985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.286s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:47 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-52476365-85c6-45d4-9a18-b827e5ae14e5 tempest-AttachVolumeNegativeTest-577825985 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:50:47 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-52476365-85c6-45d4-9a18-b827e5ae14e5 tempest-AttachVolumeNegativeTest-577825985 None] Deleted volume successfully. Nov 06 17:50:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-52476365-85c6-45d4-9a18-b827e5ae14e5 tempest-AttachVolumeNegativeTest-577825985 None] Lock "cinder-f579ad7b-ab63-42e0-ac9e-eb6cbc816c23-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:50:47 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-97548264-eb52-4c08-a975-2d844730099c tempest-SnapshotMetadataTestJSON-138344651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:50:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-97548264-eb52-4c08-a975-2d844730099c tempest-SnapshotMetadataTestJSON-138344651 None] Flow 'volume_create_manager' (032d62f5-8eb2-4416-aa28-c4fa1414ea46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:50:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-97548264-eb52-4c08-a975-2d844730099c tempest-SnapshotMetadataTestJSON-138344651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fc1df3a-0956-426d-a972-c408794d67a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:50:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-3bd96650-4203-44d7-8bb7-b3b7c5aaf27e tempest-AttachVolumeNegativeTest-577825985 None] Acquiring lock "cinder-a6e2c1d5-a6b9-4004-957a-95538b36bc89-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:50:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-97548264-eb52-4c08-a975-2d844730099c tempest-SnapshotMetadataTestJSON-138344651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fc1df3a-0956-426d-a972-c408794d67a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:50:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-154735475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af5a7e83-82a5-4101-9f04-bf46cee37b47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9b35bbc1ab44ccd8fc22cd94ad7a849',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:50:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:50:48Z,use_quota=True,user_id='a3b854032a4b4032835b792d2aaee9eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:50:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-97548264-eb52-4c08-a975-2d844730099c tempest-SnapshotMetadataTestJSON-138344651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc738813-b075-47b8-b9c8-8b545c2637c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:50:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-97548264-eb52-4c08-a975-2d844730099c tempest-SnapshotMetadataTestJSON-138344651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc738813-b075-47b8-b9c8-8b545c2637c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:50:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-97548264-eb52-4c08-a975-2d844730099c tempest-SnapshotMetadataTestJSON-138344651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b2885d7-4c48-4e0e-93e8-c87d5b25044b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:50:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-97548264-eb52-4c08-a975-2d844730099c tempest-SnapshotMetadataTestJSON-138344651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b2885d7-4c48-4e0e-93e8-c87d5b25044b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af5a7e83-82a5-4101-9f04-bf46cee37b47', 'volume_name': 'volume-af5a7e83-82a5-4101-9f04-bf46cee37b47', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:50:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-97548264-eb52-4c08-a975-2d844730099c tempest-SnapshotMetadataTestJSON-138344651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a7c76c4-7c93-4a46-8429-f0ec3834564b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:50:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-97548264-eb52-4c08-a975-2d844730099c tempest-SnapshotMetadataTestJSON-138344651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a7c76c4-7c93-4a46-8429-f0ec3834564b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:50:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-97548264-eb52-4c08-a975-2d844730099c tempest-SnapshotMetadataTestJSON-138344651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6734605d-050b-481c-b88c-fe7a776738f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:50:47 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-97548264-eb52-4c08-a975-2d844730099c tempest-SnapshotMetadataTestJSON-138344651 None] Volume af5a7e83-82a5-4101-9f04-bf46cee37b47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af5a7e83-82a5-4101-9f04-bf46cee37b47', 'volume_size': 1} Nov 06 17:50:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-97548264-eb52-4c08-a975-2d844730099c tempest-SnapshotMetadataTestJSON-138344651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:50:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-97548264-eb52-4c08-a975-2d844730099c tempest-SnapshotMetadataTestJSON-138344651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:50:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-97548264-eb52-4c08-a975-2d844730099c tempest-SnapshotMetadataTestJSON-138344651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:50:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-154735475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af5a7e83-82a5-4101-9f04-bf46cee37b47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9b35bbc1ab44ccd8fc22cd94ad7a849',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:50:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:50:48Z,use_quota=True,user_id='a3b854032a4b4032835b792d2aaee9eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:50:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-97548264-eb52-4c08-a975-2d844730099c tempest-SnapshotMetadataTestJSON-138344651 None] Creating volume af5a7e83-82a5-4101-9f04-bf46cee37b47 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:50:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-97548264-eb52-4c08-a975-2d844730099c tempest-SnapshotMetadataTestJSON-138344651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:50:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-97548264-eb52-4c08-a975-2d844730099c tempest-SnapshotMetadataTestJSON-138344651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:50:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-97548264-eb52-4c08-a975-2d844730099c tempest-SnapshotMetadataTestJSON-138344651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:50:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-97548264-eb52-4c08-a975-2d844730099c tempest-SnapshotMetadataTestJSON-138344651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:50:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-97548264-eb52-4c08-a975-2d844730099c tempest-SnapshotMetadataTestJSON-138344651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:50:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-97548264-eb52-4c08-a975-2d844730099c tempest-SnapshotMetadataTestJSON-138344651 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:50:47 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-97548264-eb52-4c08-a975-2d844730099c tempest-SnapshotMetadataTestJSON-138344651 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:50:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97548264-eb52-4c08-a975-2d844730099c tempest-SnapshotMetadataTestJSON-138344651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-af5a7e83-82a5-4101-9f04-bf46cee37b47 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-853feb92-8b2e-4a26-ad2f-4961c3984df2 tempest-SnapshotsActionsTest-284033357 None] Acquiring lock "cinder-d50918bc-f0e8-4572-bceb-84e9d767c65e-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:50:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-3bd96650-4203-44d7-8bb7-b3b7c5aaf27e tempest-AttachVolumeNegativeTest-577825985 None] Lock "cinder-a6e2c1d5-a6b9-4004-957a-95538b36bc89-delete_volume" acquired by "delete_volume" :: waited 0.118s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:50:47 devstack sudo[95756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-af5a7e83-82a5-4101-9f04-bf46cee37b47 1073741824 Nov 06 17:50:47 devstack sudo[95756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:48 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-853feb92-8b2e-4a26-ad2f-4961c3984df2 tempest-SnapshotsActionsTest-284033357 None] Lock "cinder-d50918bc-f0e8-4572-bceb-84e9d767c65e-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:50:48 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-3bd96650-4203-44d7-8bb7-b3b7c5aaf27e tempest-AttachVolumeNegativeTest-577825985 None] Acquiring lock "cinder-quobyte-a6e2c1d5-a6b9-4004-957a-95538b36bc89" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:50:48 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-3bd96650-4203-44d7-8bb7-b3b7c5aaf27e tempest-AttachVolumeNegativeTest-577825985 None] Lock "cinder-quobyte-a6e2c1d5-a6b9-4004-957a-95538b36bc89" acquired by "delete_volume" :: waited 0.035s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:50:48 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-853feb92-8b2e-4a26-ad2f-4961c3984df2 tempest-SnapshotsActionsTest-284033357 None] Acquiring lock "cinder-quobyte-d50918bc-f0e8-4572-bceb-84e9d767c65e" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:50:48 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-853feb92-8b2e-4a26-ad2f-4961c3984df2 tempest-SnapshotsActionsTest-284033357 None] Lock "cinder-quobyte-d50918bc-f0e8-4572-bceb-84e9d767c65e" acquired by "delete_volume" :: waited 0.022s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:50:48 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b6535ed-d928-45f3-8e51-a0d1ca046669]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:50:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3bd96650-4203-44d7-8bb7-b3b7c5aaf27e tempest-AttachVolumeNegativeTest-577825985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a6e2c1d5-a6b9-4004-957a-95538b36bc89 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:48 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dca71d0-50a7-43df-9ff5-c47d7e4ec289]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:50:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-853feb92-8b2e-4a26-ad2f-4961c3984df2 tempest-SnapshotsActionsTest-284033357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:48 devstack sudo[95759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a6e2c1d5-a6b9-4004-957a-95538b36bc89 Nov 06 17:50:48 devstack sudo[95759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:48 devstack sudo[95760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e Nov 06 17:50:48 devstack sudo[95760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:48 devstack sudo[95756]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97548264-eb52-4c08-a975-2d844730099c tempest-SnapshotMetadataTestJSON-138344651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-af5a7e83-82a5-4101-9f04-bf46cee37b47 1073741824" returned: 0 in 0.610s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97548264-eb52-4c08-a975-2d844730099c tempest-SnapshotMetadataTestJSON-138344651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-af5a7e83-82a5-4101-9f04-bf46cee37b47 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:48 devstack sudo[95772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-af5a7e83-82a5-4101-9f04-bf46cee37b47 Nov 06 17:50:48 devstack sudo[95772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:48 devstack sudo[95760]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:48 devstack sudo[95759]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3bd96650-4203-44d7-8bb7-b3b7c5aaf27e tempest-AttachVolumeNegativeTest-577825985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a6e2c1d5-a6b9-4004-957a-95538b36bc89" returned: 0 in 0.587s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-853feb92-8b2e-4a26-ad2f-4961c3984df2 tempest-SnapshotsActionsTest-284033357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e" returned: 0 in 0.570s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3bd96650-4203-44d7-8bb7-b3b7c5aaf27e tempest-AttachVolumeNegativeTest-577825985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a6e2c1d5-a6b9-4004-957a-95538b36bc89 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-853feb92-8b2e-4a26-ad2f-4961c3984df2 tempest-SnapshotsActionsTest-284033357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:48 devstack sudo[95776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a6e2c1d5-a6b9-4004-957a-95538b36bc89 Nov 06 17:50:48 devstack sudo[95776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:48 devstack sudo[95777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e Nov 06 17:50:48 devstack sudo[95777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:49 devstack sudo[95772]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97548264-eb52-4c08-a975-2d844730099c tempest-SnapshotMetadataTestJSON-138344651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-af5a7e83-82a5-4101-9f04-bf46cee37b47" returned: 0 in 0.414s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-97548264-eb52-4c08-a975-2d844730099c tempest-SnapshotMetadataTestJSON-138344651 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:50:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-97548264-eb52-4c08-a975-2d844730099c tempest-SnapshotMetadataTestJSON-138344651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:50:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-97548264-eb52-4c08-a975-2d844730099c tempest-SnapshotMetadataTestJSON-138344651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6734605d-050b-481c-b88c-fe7a776738f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af5a7e83-82a5-4101-9f04-bf46cee37b47', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:50:49 devstack sudo[95777]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-97548264-eb52-4c08-a975-2d844730099c tempest-SnapshotMetadataTestJSON-138344651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b047c413-34d8-4805-b1b0-fe2ef7accf84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:50:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-853feb92-8b2e-4a26-ad2f-4961c3984df2 tempest-SnapshotsActionsTest-284033357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d50918bc-f0e8-4572-bceb-84e9d767c65e" returned: 0 in 0.341s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:49 devstack sudo[95776]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3bd96650-4203-44d7-8bb7-b3b7c5aaf27e tempest-AttachVolumeNegativeTest-577825985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a6e2c1d5-a6b9-4004-957a-95538b36bc89" returned: 0 in 0.378s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:49 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-853feb92-8b2e-4a26-ad2f-4961c3984df2 tempest-SnapshotsActionsTest-284033357 None] Lock "cinder-quobyte-d50918bc-f0e8-4572-bceb-84e9d767c65e" released by "delete_volume" :: held 1.018s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:50:49 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-97548264-eb52-4c08-a975-2d844730099c tempest-SnapshotMetadataTestJSON-138344651 None] Volume volume-af5a7e83-82a5-4101-9f04-bf46cee37b47 (af5a7e83-82a5-4101-9f04-bf46cee37b47): created successfully Nov 06 17:50:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-97548264-eb52-4c08-a975-2d844730099c tempest-SnapshotMetadataTestJSON-138344651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b047c413-34d8-4805-b1b0-fe2ef7accf84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:50:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-97548264-eb52-4c08-a975-2d844730099c tempest-SnapshotMetadataTestJSON-138344651 None] Flow 'volume_create_manager' (032d62f5-8eb2-4416-aa28-c4fa1414ea46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:50:49 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-3bd96650-4203-44d7-8bb7-b3b7c5aaf27e tempest-AttachVolumeNegativeTest-577825985 None] Lock "cinder-quobyte-a6e2c1d5-a6b9-4004-957a-95538b36bc89" released by "delete_volume" :: held 1.091s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:50:49 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-97548264-eb52-4c08-a975-2d844730099c tempest-SnapshotMetadataTestJSON-138344651 None] Created volume successfully. Nov 06 17:50:49 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-853feb92-8b2e-4a26-ad2f-4961c3984df2 tempest-SnapshotsActionsTest-284033357 None] Created reservations ['2b2253ba-ca44-40dd-a279-e01da12b7b90', '7e1b1f57-32e2-47f3-8891-361a5d1e67f5', '16f48a03-f4f3-4c04-83bc-a4344aa45f2d', '4153e606-c47f-49c7-90bd-2e29887e41ad'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:50:49 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-3bd96650-4203-44d7-8bb7-b3b7c5aaf27e tempest-AttachVolumeNegativeTest-577825985 None] Created reservations ['53facc5f-8a97-45f6-9260-c097e1d82126', 'ad8232e4-afaf-4d11-b283-f1820b25f3e0', '2ac051b4-c150-45af-ba01-26f50e19f5c8', '77edf680-0d4d-4323-aa54-f4c1e7526655'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:50:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-853feb92-8b2e-4a26-ad2f-4961c3984df2 tempest-SnapshotsActionsTest-284033357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:50:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-853feb92-8b2e-4a26-ad2f-4961c3984df2 tempest-SnapshotsActionsTest-284033357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:50:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-853feb92-8b2e-4a26-ad2f-4961c3984df2 tempest-SnapshotsActionsTest-284033357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:50:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-853feb92-8b2e-4a26-ad2f-4961c3984df2 tempest-SnapshotsActionsTest-284033357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:50:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-853feb92-8b2e-4a26-ad2f-4961c3984df2 tempest-SnapshotsActionsTest-284033357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:50:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-853feb92-8b2e-4a26-ad2f-4961c3984df2 tempest-SnapshotsActionsTest-284033357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:49 devstack sudo[95784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:50:49 devstack sudo[95784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3bd96650-4203-44d7-8bb7-b3b7c5aaf27e tempest-AttachVolumeNegativeTest-577825985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:50:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3bd96650-4203-44d7-8bb7-b3b7c5aaf27e tempest-AttachVolumeNegativeTest-577825985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:50:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3bd96650-4203-44d7-8bb7-b3b7c5aaf27e tempest-AttachVolumeNegativeTest-577825985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:50:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3bd96650-4203-44d7-8bb7-b3b7c5aaf27e tempest-AttachVolumeNegativeTest-577825985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:50:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3bd96650-4203-44d7-8bb7-b3b7c5aaf27e tempest-AttachVolumeNegativeTest-577825985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:50:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3bd96650-4203-44d7-8bb7-b3b7c5aaf27e tempest-AttachVolumeNegativeTest-577825985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:49 devstack sudo[95786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:50:49 devstack sudo[95786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:49 devstack sudo[95784]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-853feb92-8b2e-4a26-ad2f-4961c3984df2 tempest-SnapshotsActionsTest-284033357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.285s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:49 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-853feb92-8b2e-4a26-ad2f-4961c3984df2 tempest-SnapshotsActionsTest-284033357 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:50:49 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-853feb92-8b2e-4a26-ad2f-4961c3984df2 tempest-SnapshotsActionsTest-284033357 None] Deleted volume successfully. Nov 06 17:50:49 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-853feb92-8b2e-4a26-ad2f-4961c3984df2 tempest-SnapshotsActionsTest-284033357 None] Lock "cinder-d50918bc-f0e8-4572-bceb-84e9d767c65e-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:50:49 devstack sudo[95786]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3bd96650-4203-44d7-8bb7-b3b7c5aaf27e tempest-AttachVolumeNegativeTest-577825985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.309s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:49 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-3bd96650-4203-44d7-8bb7-b3b7c5aaf27e tempest-AttachVolumeNegativeTest-577825985 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:50:49 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-3bd96650-4203-44d7-8bb7-b3b7c5aaf27e tempest-AttachVolumeNegativeTest-577825985 None] Deleted volume successfully. Nov 06 17:50:49 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-3bd96650-4203-44d7-8bb7-b3b7c5aaf27e tempest-AttachVolumeNegativeTest-577825985 None] Lock "cinder-a6e2c1d5-a6b9-4004-957a-95538b36bc89-delete_volume" released by "delete_volume" :: held 1.853s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:50:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-22586b9f-068c-4049-9882-178490f76612 tempest-SnapshotMetadataTestJSON-138344651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:50:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-22586b9f-068c-4049-9882-178490f76612 tempest-SnapshotMetadataTestJSON-138344651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:50:50 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-22586b9f-068c-4049-9882-178490f76612 tempest-SnapshotMetadataTestJSON-138344651 None] Creating offline snapshot 8655ad66-0327-4c58-893d-5695aff74627 of volume af5a7e83-82a5-4101-9f04-bf46cee37b47 {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 17:50:50 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fafabaf-b78b-4662-b346-f7a7bc707bdc]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:50:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-22586b9f-068c-4049-9882-178490f76612 tempest-SnapshotMetadataTestJSON-138344651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-af5a7e83-82a5-4101-9f04-bf46cee37b47 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:50 devstack sudo[95791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-af5a7e83-82a5-4101-9f04-bf46cee37b47 Nov 06 17:50:50 devstack sudo[95791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:50 devstack sudo[95791]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-22586b9f-068c-4049-9882-178490f76612 tempest-SnapshotMetadataTestJSON-138344651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-af5a7e83-82a5-4101-9f04-bf46cee37b47" returned: 0 in 0.446s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-22586b9f-068c-4049-9882-178490f76612 tempest-SnapshotMetadataTestJSON-138344651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-af5a7e83-82a5-4101-9f04-bf46cee37b47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-af5a7e83-82a5-4101-9f04-bf46cee37b47.8655ad66-0327-4c58-893d-5695aff74627 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:50 devstack sudo[95796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-af5a7e83-82a5-4101-9f04-bf46cee37b47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-af5a7e83-82a5-4101-9f04-bf46cee37b47.8655ad66-0327-4c58-893d-5695aff74627 1G Nov 06 17:50:50 devstack sudo[95796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:51 devstack sudo[95796]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-22586b9f-068c-4049-9882-178490f76612 tempest-SnapshotMetadataTestJSON-138344651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-af5a7e83-82a5-4101-9f04-bf46cee37b47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-af5a7e83-82a5-4101-9f04-bf46cee37b47.8655ad66-0327-4c58-893d-5695aff74627 1G" returned: 0 in 0.596s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-22586b9f-068c-4049-9882-178490f76612 tempest-SnapshotMetadataTestJSON-138344651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af5a7e83-82a5-4101-9f04-bf46cee37b47 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-af5a7e83-82a5-4101-9f04-bf46cee37b47.8655ad66-0327-4c58-893d-5695aff74627 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:51 devstack sudo[95803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af5a7e83-82a5-4101-9f04-bf46cee37b47 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-af5a7e83-82a5-4101-9f04-bf46cee37b47.8655ad66-0327-4c58-893d-5695aff74627 Nov 06 17:50:51 devstack sudo[95803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:51 devstack sudo[95803]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-22586b9f-068c-4049-9882-178490f76612 tempest-SnapshotMetadataTestJSON-138344651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af5a7e83-82a5-4101-9f04-bf46cee37b47 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-af5a7e83-82a5-4101-9f04-bf46cee37b47.8655ad66-0327-4c58-893d-5695aff74627" returned: 0 in 0.535s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:51 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-22586b9f-068c-4049-9882-178490f76612 tempest-SnapshotMetadataTestJSON-138344651 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-af5a7e83-82a5-4101-9f04-bf46cee37b47.8655ad66-0327-4c58-893d-5695aff74627 is being set with open permissions: ugo+rw Nov 06 17:50:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-22586b9f-068c-4049-9882-178490f76612 tempest-SnapshotMetadataTestJSON-138344651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-af5a7e83-82a5-4101-9f04-bf46cee37b47.8655ad66-0327-4c58-893d-5695aff74627 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:51 devstack sudo[95817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-af5a7e83-82a5-4101-9f04-bf46cee37b47.8655ad66-0327-4c58-893d-5695aff74627 Nov 06 17:50:51 devstack sudo[95817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:52 devstack sudo[95817]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-22586b9f-068c-4049-9882-178490f76612 tempest-SnapshotMetadataTestJSON-138344651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-af5a7e83-82a5-4101-9f04-bf46cee37b47.8655ad66-0327-4c58-893d-5695aff74627" returned: 0 in 0.384s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-22586b9f-068c-4049-9882-178490f76612 tempest-SnapshotMetadataTestJSON-138344651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-af5a7e83-82a5-4101-9f04-bf46cee37b47.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:52 devstack sudo[95821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-af5a7e83-82a5-4101-9f04-bf46cee37b47.info Nov 06 17:50:52 devstack sudo[95821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:52 devstack sudo[95821]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-22586b9f-068c-4049-9882-178490f76612 tempest-SnapshotMetadataTestJSON-138344651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-af5a7e83-82a5-4101-9f04-bf46cee37b47.info" returned: 0 in 0.412s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:52 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-22586b9f-068c-4049-9882-178490f76612 tempest-SnapshotMetadataTestJSON-138344651 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-af5a7e83-82a5-4101-9f04-bf46cee37b47.info is being set with open permissions: ugo+rw Nov 06 17:50:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-22586b9f-068c-4049-9882-178490f76612 tempest-SnapshotMetadataTestJSON-138344651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-af5a7e83-82a5-4101-9f04-bf46cee37b47.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:52 devstack sudo[95824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-af5a7e83-82a5-4101-9f04-bf46cee37b47.info Nov 06 17:50:52 devstack sudo[95824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:52 devstack sudo[95824]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-22586b9f-068c-4049-9882-178490f76612 tempest-SnapshotMetadataTestJSON-138344651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-af5a7e83-82a5-4101-9f04-bf46cee37b47.info" returned: 0 in 0.346s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-22586b9f-068c-4049-9882-178490f76612 tempest-SnapshotMetadataTestJSON-138344651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.871s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:50:53 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-22586b9f-068c-4049-9882-178490f76612 tempest-SnapshotMetadataTestJSON-138344651 None] Create snapshot completed successfully Nov 06 17:50:54 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 17:50:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:50:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:50:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:50:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:50:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:50:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:54 devstack sudo[95847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:50:54 devstack sudo[95847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:54 devstack sudo[95847]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.479s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:54 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:50:54 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running periodic task VolumeManager._thread_info {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 17:50:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] thread count: 28 {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 17:50:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] thread info: [<_MainThread(MainThread, started 133940619505792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 17:50:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2eb5d109-a209-4253-b97a-2ed7d2087f67 tempest-SnapshotMetadataTestJSON-138344651 None] Acquiring lock "cinder-8655ad66-0327-4c58-893d-5695aff74627-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:50:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2eb5d109-a209-4253-b97a-2ed7d2087f67 tempest-SnapshotMetadataTestJSON-138344651 None] Lock "cinder-8655ad66-0327-4c58-893d-5695aff74627-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:50:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2eb5d109-a209-4253-b97a-2ed7d2087f67 tempest-SnapshotMetadataTestJSON-138344651 None] Acquiring lock "cinder-quobyte-af5a7e83-82a5-4101-9f04-bf46cee37b47" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:50:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2eb5d109-a209-4253-b97a-2ed7d2087f67 tempest-SnapshotMetadataTestJSON-138344651 None] Lock "cinder-quobyte-af5a7e83-82a5-4101-9f04-bf46cee37b47" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:50:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2eb5d109-a209-4253-b97a-2ed7d2087f67 tempest-SnapshotMetadataTestJSON-138344651 None] Acquiring lock "cinder-quobyte-8655ad66-0327-4c58-893d-5695aff74627" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:50:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2eb5d109-a209-4253-b97a-2ed7d2087f67 tempest-SnapshotMetadataTestJSON-138344651 None] Lock "cinder-quobyte-8655ad66-0327-4c58-893d-5695aff74627" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:50:55 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-2eb5d109-a209-4253-b97a-2ed7d2087f67 tempest-SnapshotMetadataTestJSON-138344651 None] Deleting offline snapshot 8655ad66-0327-4c58-893d-5695aff74627 of volume af5a7e83-82a5-4101-9f04-bf46cee37b47 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 17:50:55 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-2eb5d109-a209-4253-b97a-2ed7d2087f67 tempest-SnapshotMetadataTestJSON-138344651 None] snapshot_file for this snap is: volume-af5a7e83-82a5-4101-9f04-bf46cee37b47.8655ad66-0327-4c58-893d-5695aff74627 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 17:50:55 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e59991d-ec08-4d73-b8c8-a00a8c2e692b]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:50:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2eb5d109-a209-4253-b97a-2ed7d2087f67 tempest-SnapshotMetadataTestJSON-138344651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-af5a7e83-82a5-4101-9f04-bf46cee37b47.8655ad66-0327-4c58-893d-5695aff74627 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:55 devstack sudo[95850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-af5a7e83-82a5-4101-9f04-bf46cee37b47.8655ad66-0327-4c58-893d-5695aff74627 Nov 06 17:50:55 devstack sudo[95850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:55 devstack sudo[95850]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2eb5d109-a209-4253-b97a-2ed7d2087f67 tempest-SnapshotMetadataTestJSON-138344651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-af5a7e83-82a5-4101-9f04-bf46cee37b47.8655ad66-0327-4c58-893d-5695aff74627" returned: 0 in 0.515s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:55 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-2eb5d109-a209-4253-b97a-2ed7d2087f67 tempest-SnapshotMetadataTestJSON-138344651 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af5a7e83-82a5-4101-9f04-bf46cee37b47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 17:50:55 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[3acca740-7c7f-41c4-ac35-ad850590d8b6]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:50:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2eb5d109-a209-4253-b97a-2ed7d2087f67 tempest-SnapshotMetadataTestJSON-138344651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-af5a7e83-82a5-4101-9f04-bf46cee37b47 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:56 devstack sudo[95855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-af5a7e83-82a5-4101-9f04-bf46cee37b47 Nov 06 17:50:56 devstack sudo[95855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:56 devstack sudo[95855]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2eb5d109-a209-4253-b97a-2ed7d2087f67 tempest-SnapshotMetadataTestJSON-138344651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-af5a7e83-82a5-4101-9f04-bf46cee37b47" returned: 0 in 0.452s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2eb5d109-a209-4253-b97a-2ed7d2087f67 tempest-SnapshotMetadataTestJSON-138344651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-af5a7e83-82a5-4101-9f04-bf46cee37b47.8655ad66-0327-4c58-893d-5695aff74627 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:56 devstack sudo[95864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-af5a7e83-82a5-4101-9f04-bf46cee37b47.8655ad66-0327-4c58-893d-5695aff74627 Nov 06 17:50:56 devstack sudo[95864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:56 devstack sudo[95864]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2eb5d109-a209-4253-b97a-2ed7d2087f67 tempest-SnapshotMetadataTestJSON-138344651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-af5a7e83-82a5-4101-9f04-bf46cee37b47.8655ad66-0327-4c58-893d-5695aff74627" returned: 0 in 0.623s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2eb5d109-a209-4253-b97a-2ed7d2087f67 tempest-SnapshotMetadataTestJSON-138344651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-af5a7e83-82a5-4101-9f04-bf46cee37b47.8655ad66-0327-4c58-893d-5695aff74627 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:57 devstack sudo[95881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-af5a7e83-82a5-4101-9f04-bf46cee37b47.8655ad66-0327-4c58-893d-5695aff74627 Nov 06 17:50:57 devstack sudo[95881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:57 devstack sudo[95881]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2eb5d109-a209-4253-b97a-2ed7d2087f67 tempest-SnapshotMetadataTestJSON-138344651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-af5a7e83-82a5-4101-9f04-bf46cee37b47.8655ad66-0327-4c58-893d-5695aff74627" returned: 0 in 0.356s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2eb5d109-a209-4253-b97a-2ed7d2087f67 tempest-SnapshotMetadataTestJSON-138344651 None] Lock "cinder-quobyte-8655ad66-0327-4c58-893d-5695aff74627" released by "_delete_snapshot" :: held 2.131s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:50:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2eb5d109-a209-4253-b97a-2ed7d2087f67 tempest-SnapshotMetadataTestJSON-138344651 None] Lock "cinder-quobyte-af5a7e83-82a5-4101-9f04-bf46cee37b47" released by "delete_snapshot" :: held 2.162s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:50:57 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-2eb5d109-a209-4253-b97a-2ed7d2087f67 tempest-SnapshotMetadataTestJSON-138344651 None] Created reservations ['fec5e900-dd5b-49b5-8045-d002891c4583', 'b7f6c5f2-68e7-46b6-947f-b8d0ea608c70', '27391769-32fb-4331-ba75-2704414cd99b', 'b092b81e-0114-45f2-8d24-c4f8bb320d51'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:50:57 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-2eb5d109-a209-4253-b97a-2ed7d2087f67 tempest-SnapshotMetadataTestJSON-138344651 None] Delete snapshot completed successfully. Nov 06 17:50:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2eb5d109-a209-4253-b97a-2ed7d2087f67 tempest-SnapshotMetadataTestJSON-138344651 None] Lock "cinder-8655ad66-0327-4c58-893d-5695aff74627-delete_snapshot" released by "delete_snapshot" :: held 2.451s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:50:58 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4900bdfc-8f70-458d-82ac-fcc3a9d7ffc8 tempest-SnapshotMetadataTestJSON-138344651 None] Acquiring lock "cinder-af5a7e83-82a5-4101-9f04-bf46cee37b47-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:50:58 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4900bdfc-8f70-458d-82ac-fcc3a9d7ffc8 tempest-SnapshotMetadataTestJSON-138344651 None] Lock "cinder-af5a7e83-82a5-4101-9f04-bf46cee37b47-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:50:58 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4900bdfc-8f70-458d-82ac-fcc3a9d7ffc8 tempest-SnapshotMetadataTestJSON-138344651 None] Acquiring lock "cinder-quobyte-af5a7e83-82a5-4101-9f04-bf46cee37b47" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:50:58 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4900bdfc-8f70-458d-82ac-fcc3a9d7ffc8 tempest-SnapshotMetadataTestJSON-138344651 None] Lock "cinder-quobyte-af5a7e83-82a5-4101-9f04-bf46cee37b47" acquired by "delete_volume" :: waited 0.035s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:50:58 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6cd17a-9ed8-4e8e-9e05-509a196d492e]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:50:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4900bdfc-8f70-458d-82ac-fcc3a9d7ffc8 tempest-SnapshotMetadataTestJSON-138344651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-af5a7e83-82a5-4101-9f04-bf46cee37b47 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:59 devstack sudo[95937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-af5a7e83-82a5-4101-9f04-bf46cee37b47 Nov 06 17:50:59 devstack sudo[95937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:50:59 devstack sudo[95937]: pam_unix(sudo:session): session closed for user root Nov 06 17:50:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4900bdfc-8f70-458d-82ac-fcc3a9d7ffc8 tempest-SnapshotMetadataTestJSON-138344651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-af5a7e83-82a5-4101-9f04-bf46cee37b47" returned: 0 in 0.714s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:50:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4900bdfc-8f70-458d-82ac-fcc3a9d7ffc8 tempest-SnapshotMetadataTestJSON-138344651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-af5a7e83-82a5-4101-9f04-bf46cee37b47 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:50:59 devstack sudo[95954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-af5a7e83-82a5-4101-9f04-bf46cee37b47 Nov 06 17:50:59 devstack sudo[95954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:00 devstack sudo[95954]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4900bdfc-8f70-458d-82ac-fcc3a9d7ffc8 tempest-SnapshotMetadataTestJSON-138344651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-af5a7e83-82a5-4101-9f04-bf46cee37b47" returned: 0 in 0.554s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:00 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4900bdfc-8f70-458d-82ac-fcc3a9d7ffc8 tempest-SnapshotMetadataTestJSON-138344651 None] Lock "cinder-quobyte-af5a7e83-82a5-4101-9f04-bf46cee37b47" released by "delete_volume" :: held 1.489s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:51:00 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-4900bdfc-8f70-458d-82ac-fcc3a9d7ffc8 tempest-SnapshotMetadataTestJSON-138344651 None] Created reservations ['ebf648f4-e294-4891-9b1e-2c98225ce25d', 'c02d3f19-05e1-4d36-b1dc-8b0c91eb808c', 'd4a672b8-069f-47b5-a412-a0568c9ce550', '0efad462-cdb5-41e6-8fb2-6802a7c09dbd'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:51:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4900bdfc-8f70-458d-82ac-fcc3a9d7ffc8 tempest-SnapshotMetadataTestJSON-138344651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:51:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4900bdfc-8f70-458d-82ac-fcc3a9d7ffc8 tempest-SnapshotMetadataTestJSON-138344651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:51:00 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4900bdfc-8f70-458d-82ac-fcc3a9d7ffc8 tempest-SnapshotMetadataTestJSON-138344651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:51:00 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4900bdfc-8f70-458d-82ac-fcc3a9d7ffc8 tempest-SnapshotMetadataTestJSON-138344651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:51:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4900bdfc-8f70-458d-82ac-fcc3a9d7ffc8 tempest-SnapshotMetadataTestJSON-138344651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:51:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4900bdfc-8f70-458d-82ac-fcc3a9d7ffc8 tempest-SnapshotMetadataTestJSON-138344651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:00 devstack sudo[95963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:51:00 devstack sudo[95963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:01 devstack sudo[95963]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4900bdfc-8f70-458d-82ac-fcc3a9d7ffc8 tempest-SnapshotMetadataTestJSON-138344651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.448s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:01 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-4900bdfc-8f70-458d-82ac-fcc3a9d7ffc8 tempest-SnapshotMetadataTestJSON-138344651 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:51:01 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-4900bdfc-8f70-458d-82ac-fcc3a9d7ffc8 tempest-SnapshotMetadataTestJSON-138344651 None] Deleted volume successfully. Nov 06 17:51:01 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4900bdfc-8f70-458d-82ac-fcc3a9d7ffc8 tempest-SnapshotMetadataTestJSON-138344651 None] Lock "cinder-af5a7e83-82a5-4101-9f04-bf46cee37b47-delete_volume" released by "delete_volume" :: held 2.648s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:51:06 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-97e9ba9d-c02e-44ff-bdb0-66d055af6138 tempest-VolumeQuotasNegativeTestJSON-169985760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:51:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-97e9ba9d-c02e-44ff-bdb0-66d055af6138 tempest-VolumeQuotasNegativeTestJSON-169985760 None] Flow 'volume_create_manager' (a13282a1-1b34-47f7-be9e-f720e6523ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:51:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-97e9ba9d-c02e-44ff-bdb0-66d055af6138 tempest-VolumeQuotasNegativeTestJSON-169985760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41773d19-c953-4128-a257-47ec7f6c91ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:51:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-97e9ba9d-c02e-44ff-bdb0-66d055af6138 tempest-VolumeQuotasNegativeTestJSON-169985760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41773d19-c953-4128-a257-47ec7f6c91ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:51:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1039759422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4635a96e-2b17-4137-9b9c-e2f2e299aafe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1d1528693404e4fafa9e1bb383437b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:51:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:51:07Z,use_quota=True,user_id='0bd7c645bf4441899e72b9ee9bb259e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:51:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-97e9ba9d-c02e-44ff-bdb0-66d055af6138 tempest-VolumeQuotasNegativeTestJSON-169985760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80e296e3-dd0d-4e8a-bdaf-ff11097d1771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:51:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-97e9ba9d-c02e-44ff-bdb0-66d055af6138 tempest-VolumeQuotasNegativeTestJSON-169985760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80e296e3-dd0d-4e8a-bdaf-ff11097d1771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:51:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-97e9ba9d-c02e-44ff-bdb0-66d055af6138 tempest-VolumeQuotasNegativeTestJSON-169985760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e9ccaa0-d91b-46d6-ac98-72407e1a76b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:51:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-97e9ba9d-c02e-44ff-bdb0-66d055af6138 tempest-VolumeQuotasNegativeTestJSON-169985760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e9ccaa0-d91b-46d6-ac98-72407e1a76b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4635a96e-2b17-4137-9b9c-e2f2e299aafe', 'volume_name': 'volume-4635a96e-2b17-4137-9b9c-e2f2e299aafe', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:51:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-97e9ba9d-c02e-44ff-bdb0-66d055af6138 tempest-VolumeQuotasNegativeTestJSON-169985760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abcea0d8-2b37-4ec3-9519-05decc5e253b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:51:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-97e9ba9d-c02e-44ff-bdb0-66d055af6138 tempest-VolumeQuotasNegativeTestJSON-169985760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abcea0d8-2b37-4ec3-9519-05decc5e253b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:51:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-97e9ba9d-c02e-44ff-bdb0-66d055af6138 tempest-VolumeQuotasNegativeTestJSON-169985760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b22d0a4a-bdc6-47a7-8bc1-b033b633d00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:51:07 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-97e9ba9d-c02e-44ff-bdb0-66d055af6138 tempest-VolumeQuotasNegativeTestJSON-169985760 None] Volume 4635a96e-2b17-4137-9b9c-e2f2e299aafe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4635a96e-2b17-4137-9b9c-e2f2e299aafe', 'volume_size': 1} Nov 06 17:51:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-97e9ba9d-c02e-44ff-bdb0-66d055af6138 tempest-VolumeQuotasNegativeTestJSON-169985760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:51:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-97e9ba9d-c02e-44ff-bdb0-66d055af6138 tempest-VolumeQuotasNegativeTestJSON-169985760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:51:07 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-97e9ba9d-c02e-44ff-bdb0-66d055af6138 tempest-VolumeQuotasNegativeTestJSON-169985760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:51:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1039759422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4635a96e-2b17-4137-9b9c-e2f2e299aafe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1d1528693404e4fafa9e1bb383437b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:51:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:51:07Z,use_quota=True,user_id='0bd7c645bf4441899e72b9ee9bb259e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:51:07 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-97e9ba9d-c02e-44ff-bdb0-66d055af6138 tempest-VolumeQuotasNegativeTestJSON-169985760 None] Creating volume 4635a96e-2b17-4137-9b9c-e2f2e299aafe {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:51:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-97e9ba9d-c02e-44ff-bdb0-66d055af6138 tempest-VolumeQuotasNegativeTestJSON-169985760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:51:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-97e9ba9d-c02e-44ff-bdb0-66d055af6138 tempest-VolumeQuotasNegativeTestJSON-169985760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:51:07 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-97e9ba9d-c02e-44ff-bdb0-66d055af6138 tempest-VolumeQuotasNegativeTestJSON-169985760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:51:07 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-97e9ba9d-c02e-44ff-bdb0-66d055af6138 tempest-VolumeQuotasNegativeTestJSON-169985760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:51:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-97e9ba9d-c02e-44ff-bdb0-66d055af6138 tempest-VolumeQuotasNegativeTestJSON-169985760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:51:07 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-97e9ba9d-c02e-44ff-bdb0-66d055af6138 tempest-VolumeQuotasNegativeTestJSON-169985760 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:51:07 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-97e9ba9d-c02e-44ff-bdb0-66d055af6138 tempest-VolumeQuotasNegativeTestJSON-169985760 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:51:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97e9ba9d-c02e-44ff-bdb0-66d055af6138 tempest-VolumeQuotasNegativeTestJSON-169985760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4635a96e-2b17-4137-9b9c-e2f2e299aafe 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:07 devstack sudo[96012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4635a96e-2b17-4137-9b9c-e2f2e299aafe 1073741824 Nov 06 17:51:07 devstack sudo[96012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:08 devstack sudo[96012]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97e9ba9d-c02e-44ff-bdb0-66d055af6138 tempest-VolumeQuotasNegativeTestJSON-169985760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4635a96e-2b17-4137-9b9c-e2f2e299aafe 1073741824" returned: 0 in 1.138s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97e9ba9d-c02e-44ff-bdb0-66d055af6138 tempest-VolumeQuotasNegativeTestJSON-169985760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4635a96e-2b17-4137-9b9c-e2f2e299aafe {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:08 devstack sudo[96018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4635a96e-2b17-4137-9b9c-e2f2e299aafe Nov 06 17:51:08 devstack sudo[96018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:09 devstack sudo[96018]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97e9ba9d-c02e-44ff-bdb0-66d055af6138 tempest-VolumeQuotasNegativeTestJSON-169985760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4635a96e-2b17-4137-9b9c-e2f2e299aafe" returned: 0 in 0.689s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:09 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-97e9ba9d-c02e-44ff-bdb0-66d055af6138 tempest-VolumeQuotasNegativeTestJSON-169985760 None] <== create_volume: return (1956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:51:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-97e9ba9d-c02e-44ff-bdb0-66d055af6138 tempest-VolumeQuotasNegativeTestJSON-169985760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.961s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:51:09 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:UPDATE=148,cinder:SELECT=126,cinder:DELETE=14,cinder:INSERT=44 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 17:51:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-97e9ba9d-c02e-44ff-bdb0-66d055af6138 tempest-VolumeQuotasNegativeTestJSON-169985760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b22d0a4a-bdc6-47a7-8bc1-b033b633d00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4635a96e-2b17-4137-9b9c-e2f2e299aafe', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:51:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-97e9ba9d-c02e-44ff-bdb0-66d055af6138 tempest-VolumeQuotasNegativeTestJSON-169985760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88dd9a76-1316-4cfc-80c6-c720e2426e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:51:09 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=125,cinder:INSERT=34,cinder:UPDATE=158,cinder:DELETE=10 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 17:51:09 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-97e9ba9d-c02e-44ff-bdb0-66d055af6138 tempest-VolumeQuotasNegativeTestJSON-169985760 None] Volume volume-4635a96e-2b17-4137-9b9c-e2f2e299aafe (4635a96e-2b17-4137-9b9c-e2f2e299aafe): created successfully Nov 06 17:51:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-97e9ba9d-c02e-44ff-bdb0-66d055af6138 tempest-VolumeQuotasNegativeTestJSON-169985760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88dd9a76-1316-4cfc-80c6-c720e2426e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:51:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-97e9ba9d-c02e-44ff-bdb0-66d055af6138 tempest-VolumeQuotasNegativeTestJSON-169985760 None] Flow 'volume_create_manager' (a13282a1-1b34-47f7-be9e-f720e6523ba8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:51:09 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-97e9ba9d-c02e-44ff-bdb0-66d055af6138 tempest-VolumeQuotasNegativeTestJSON-169985760 None] Created volume successfully. Nov 06 17:51:10 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a464f8a-f676-4086-aef7-50b1d3296051 tempest-VolumesDeleteCascade-1850397670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:51:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3a464f8a-f676-4086-aef7-50b1d3296051 tempest-VolumesDeleteCascade-1850397670 None] Flow 'volume_create_manager' (319ef1e9-2430-4336-aff2-c8fde170e449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:51:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3a464f8a-f676-4086-aef7-50b1d3296051 tempest-VolumesDeleteCascade-1850397670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea2ebcbd-a5d4-494e-a155-11209117d4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:51:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3a464f8a-f676-4086-aef7-50b1d3296051 tempest-VolumesDeleteCascade-1850397670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea2ebcbd-a5d4-494e-a155-11209117d4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:51:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-661914951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d92ebd2-f7f5-4495-af28-3a4d7922bd3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881549d4ad124184a7aac736a8a61439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:51:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:51:11Z,use_quota=True,user_id='c69738ee987d43309b9f39757c5c11e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:51:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3a464f8a-f676-4086-aef7-50b1d3296051 tempest-VolumesDeleteCascade-1850397670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b380d97d-0522-4e0d-b6ca-cd257920432a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:51:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3a464f8a-f676-4086-aef7-50b1d3296051 tempest-VolumesDeleteCascade-1850397670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b380d97d-0522-4e0d-b6ca-cd257920432a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:51:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3a464f8a-f676-4086-aef7-50b1d3296051 tempest-VolumesDeleteCascade-1850397670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30ffd6cc-c0f5-4c97-b5d2-1545e5d39c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:51:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3a464f8a-f676-4086-aef7-50b1d3296051 tempest-VolumesDeleteCascade-1850397670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30ffd6cc-c0f5-4c97-b5d2-1545e5d39c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d92ebd2-f7f5-4495-af28-3a4d7922bd3e', 'volume_name': 'volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:51:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3a464f8a-f676-4086-aef7-50b1d3296051 tempest-VolumesDeleteCascade-1850397670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (323c3375-b71c-4500-b032-0eafc56c8065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:51:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3a464f8a-f676-4086-aef7-50b1d3296051 tempest-VolumesDeleteCascade-1850397670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (323c3375-b71c-4500-b032-0eafc56c8065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:51:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3a464f8a-f676-4086-aef7-50b1d3296051 tempest-VolumesDeleteCascade-1850397670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7c28bbd-bc24-453e-959c-c4a04dab0142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:51:11 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-3a464f8a-f676-4086-aef7-50b1d3296051 tempest-VolumesDeleteCascade-1850397670 None] Volume 3d92ebd2-f7f5-4495-af28-3a4d7922bd3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e', 'volume_size': 1} Nov 06 17:51:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3a464f8a-f676-4086-aef7-50b1d3296051 tempest-VolumesDeleteCascade-1850397670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:51:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3a464f8a-f676-4086-aef7-50b1d3296051 tempest-VolumesDeleteCascade-1850397670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:51:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3a464f8a-f676-4086-aef7-50b1d3296051 tempest-VolumesDeleteCascade-1850397670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:51:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-661914951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d92ebd2-f7f5-4495-af28-3a4d7922bd3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881549d4ad124184a7aac736a8a61439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:51:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:51:11Z,use_quota=True,user_id='c69738ee987d43309b9f39757c5c11e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:51:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-3a464f8a-f676-4086-aef7-50b1d3296051 tempest-VolumesDeleteCascade-1850397670 None] Creating volume 3d92ebd2-f7f5-4495-af28-3a4d7922bd3e {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:51:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3a464f8a-f676-4086-aef7-50b1d3296051 tempest-VolumesDeleteCascade-1850397670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:51:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3a464f8a-f676-4086-aef7-50b1d3296051 tempest-VolumesDeleteCascade-1850397670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:51:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3a464f8a-f676-4086-aef7-50b1d3296051 tempest-VolumesDeleteCascade-1850397670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:51:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3a464f8a-f676-4086-aef7-50b1d3296051 tempest-VolumesDeleteCascade-1850397670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:51:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3a464f8a-f676-4086-aef7-50b1d3296051 tempest-VolumesDeleteCascade-1850397670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:51:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3a464f8a-f676-4086-aef7-50b1d3296051 tempest-VolumesDeleteCascade-1850397670 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:51:11 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-3a464f8a-f676-4086-aef7-50b1d3296051 tempest-VolumesDeleteCascade-1850397670 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:51:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3a464f8a-f676-4086-aef7-50b1d3296051 tempest-VolumesDeleteCascade-1850397670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:11 devstack sudo[96053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e 1073741824 Nov 06 17:51:11 devstack sudo[96053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:11 devstack sudo[96053]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3a464f8a-f676-4086-aef7-50b1d3296051 tempest-VolumesDeleteCascade-1850397670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e 1073741824" returned: 0 in 0.904s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3a464f8a-f676-4086-aef7-50b1d3296051 tempest-VolumesDeleteCascade-1850397670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:12 devstack sudo[96064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e Nov 06 17:51:12 devstack sudo[96064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:12 devstack sudo[96064]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3a464f8a-f676-4086-aef7-50b1d3296051 tempest-VolumesDeleteCascade-1850397670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e" returned: 0 in 0.420s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:12 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3a464f8a-f676-4086-aef7-50b1d3296051 tempest-VolumesDeleteCascade-1850397670 None] <== create_volume: return (1385ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:51:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3a464f8a-f676-4086-aef7-50b1d3296051 tempest-VolumesDeleteCascade-1850397670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.391s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:51:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3a464f8a-f676-4086-aef7-50b1d3296051 tempest-VolumesDeleteCascade-1850397670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7c28bbd-bc24-453e-959c-c4a04dab0142) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:51:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3a464f8a-f676-4086-aef7-50b1d3296051 tempest-VolumesDeleteCascade-1850397670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (832f7022-502f-4c24-8b0b-0cfd290d0f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:51:12 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-3a464f8a-f676-4086-aef7-50b1d3296051 tempest-VolumesDeleteCascade-1850397670 None] Volume volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e (3d92ebd2-f7f5-4495-af28-3a4d7922bd3e): created successfully Nov 06 17:51:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3a464f8a-f676-4086-aef7-50b1d3296051 tempest-VolumesDeleteCascade-1850397670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (832f7022-502f-4c24-8b0b-0cfd290d0f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:51:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3a464f8a-f676-4086-aef7-50b1d3296051 tempest-VolumesDeleteCascade-1850397670 None] Flow 'volume_create_manager' (319ef1e9-2430-4336-aff2-c8fde170e449) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:51:12 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-3a464f8a-f676-4086-aef7-50b1d3296051 tempest-VolumesDeleteCascade-1850397670 None] Created volume successfully. Nov 06 17:51:12 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a58f2169-6a74-4566-a684-b325d8d0a3a2 tempest-VolumeQuotasNegativeTestJSON-169985760 None] Acquiring lock "cinder-4635a96e-2b17-4137-9b9c-e2f2e299aafe-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:51:12 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a58f2169-6a74-4566-a684-b325d8d0a3a2 tempest-VolumeQuotasNegativeTestJSON-169985760 None] Lock "cinder-4635a96e-2b17-4137-9b9c-e2f2e299aafe-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:51:12 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a58f2169-6a74-4566-a684-b325d8d0a3a2 tempest-VolumeQuotasNegativeTestJSON-169985760 None] Acquiring lock "cinder-quobyte-4635a96e-2b17-4137-9b9c-e2f2e299aafe" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:51:12 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a58f2169-6a74-4566-a684-b325d8d0a3a2 tempest-VolumeQuotasNegativeTestJSON-169985760 None] Lock "cinder-quobyte-4635a96e-2b17-4137-9b9c-e2f2e299aafe" acquired by "delete_volume" :: waited 0.040s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:51:12 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d8dd89-4707-4442-afb8-e8a8c5742348]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:51:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a58f2169-6a74-4566-a684-b325d8d0a3a2 tempest-VolumeQuotasNegativeTestJSON-169985760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4635a96e-2b17-4137-9b9c-e2f2e299aafe {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:13 devstack sudo[96069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4635a96e-2b17-4137-9b9c-e2f2e299aafe Nov 06 17:51:13 devstack sudo[96069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0e60d02a-9703-4c02-9dbd-7d95011cdc3a tempest-VolumesDeleteCascade-1850397670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:51:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0e60d02a-9703-4c02-9dbd-7d95011cdc3a tempest-VolumesDeleteCascade-1850397670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:51:13 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-0e60d02a-9703-4c02-9dbd-7d95011cdc3a tempest-VolumesDeleteCascade-1850397670 None] Creating offline snapshot 646ccc68-8329-4d87-9861-7440ba597a6c of volume 3d92ebd2-f7f5-4495-af28-3a4d7922bd3e {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 17:51:13 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[257b7ac5-b315-44ed-801a-015abe1e8a58]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:51:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0e60d02a-9703-4c02-9dbd-7d95011cdc3a tempest-VolumesDeleteCascade-1850397670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:13 devstack sudo[96072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e Nov 06 17:51:13 devstack sudo[96072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:13 devstack sudo[96069]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a58f2169-6a74-4566-a684-b325d8d0a3a2 tempest-VolumeQuotasNegativeTestJSON-169985760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4635a96e-2b17-4137-9b9c-e2f2e299aafe" returned: 0 in 1.041s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a58f2169-6a74-4566-a684-b325d8d0a3a2 tempest-VolumeQuotasNegativeTestJSON-169985760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4635a96e-2b17-4137-9b9c-e2f2e299aafe {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:13 devstack sudo[96077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4635a96e-2b17-4137-9b9c-e2f2e299aafe Nov 06 17:51:14 devstack sudo[96077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:14 devstack sudo[96072]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0e60d02a-9703-4c02-9dbd-7d95011cdc3a tempest-VolumesDeleteCascade-1850397670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e" returned: 0 in 0.668s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0e60d02a-9703-4c02-9dbd-7d95011cdc3a tempest-VolumesDeleteCascade-1850397670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.646ccc68-8329-4d87-9861-7440ba597a6c 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:14 devstack sudo[96106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.646ccc68-8329-4d87-9861-7440ba597a6c 1G Nov 06 17:51:14 devstack sudo[96106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:14 devstack sudo[96077]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a58f2169-6a74-4566-a684-b325d8d0a3a2 tempest-VolumeQuotasNegativeTestJSON-169985760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4635a96e-2b17-4137-9b9c-e2f2e299aafe" returned: 0 in 0.550s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:14 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a58f2169-6a74-4566-a684-b325d8d0a3a2 tempest-VolumeQuotasNegativeTestJSON-169985760 None] Lock "cinder-quobyte-4635a96e-2b17-4137-9b9c-e2f2e299aafe" released by "delete_volume" :: held 1.719s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:51:14 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-a58f2169-6a74-4566-a684-b325d8d0a3a2 tempest-VolumeQuotasNegativeTestJSON-169985760 None] Created reservations ['a32fa169-0024-40f9-9cc7-01768ba859b9', 'af9840c1-d480-4c4f-82b5-9a9b2428d7d9', '0aeb430e-e304-49af-b743-82d8ac2f6fc8', '91f4ed6e-ff04-40f6-86f5-6d9a24a9b9b2'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:51:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a58f2169-6a74-4566-a684-b325d8d0a3a2 tempest-VolumeQuotasNegativeTestJSON-169985760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:51:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a58f2169-6a74-4566-a684-b325d8d0a3a2 tempest-VolumeQuotasNegativeTestJSON-169985760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:51:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a58f2169-6a74-4566-a684-b325d8d0a3a2 tempest-VolumeQuotasNegativeTestJSON-169985760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:51:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a58f2169-6a74-4566-a684-b325d8d0a3a2 tempest-VolumeQuotasNegativeTestJSON-169985760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:51:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a58f2169-6a74-4566-a684-b325d8d0a3a2 tempest-VolumeQuotasNegativeTestJSON-169985760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:51:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a58f2169-6a74-4566-a684-b325d8d0a3a2 tempest-VolumeQuotasNegativeTestJSON-169985760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:14 devstack sudo[96109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:51:14 devstack sudo[96109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:15 devstack sudo[96109]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a58f2169-6a74-4566-a684-b325d8d0a3a2 tempest-VolumeQuotasNegativeTestJSON-169985760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.393s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:15 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-a58f2169-6a74-4566-a684-b325d8d0a3a2 tempest-VolumeQuotasNegativeTestJSON-169985760 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:51:15 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-a58f2169-6a74-4566-a684-b325d8d0a3a2 tempest-VolumeQuotasNegativeTestJSON-169985760 None] Deleted volume successfully. Nov 06 17:51:15 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a58f2169-6a74-4566-a684-b325d8d0a3a2 tempest-VolumeQuotasNegativeTestJSON-169985760 None] Lock "cinder-4635a96e-2b17-4137-9b9c-e2f2e299aafe-delete_volume" released by "delete_volume" :: held 2.650s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:51:15 devstack sudo[96106]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0e60d02a-9703-4c02-9dbd-7d95011cdc3a tempest-VolumesDeleteCascade-1850397670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.646ccc68-8329-4d87-9861-7440ba597a6c 1G" returned: 0 in 1.201s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0e60d02a-9703-4c02-9dbd-7d95011cdc3a tempest-VolumesDeleteCascade-1850397670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.646ccc68-8329-4d87-9861-7440ba597a6c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:15 devstack sudo[96115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.646ccc68-8329-4d87-9861-7440ba597a6c Nov 06 17:51:15 devstack sudo[96115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:15 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9d96bed-8c34-4848-9945-1e4593376f69 tempest-ServerRescueNegativeTestJSON-1371069103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:51:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c9d96bed-8c34-4848-9945-1e4593376f69 tempest-ServerRescueNegativeTestJSON-1371069103 None] Flow 'volume_create_manager' (fc0b98cf-bce9-4b75-b703-8d89497ce11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:51:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c9d96bed-8c34-4848-9945-1e4593376f69 tempest-ServerRescueNegativeTestJSON-1371069103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07196392-715a-4aeb-b899-d53e466c5ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:51:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c9d96bed-8c34-4848-9945-1e4593376f69 tempest-ServerRescueNegativeTestJSON-1371069103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07196392-715a-4aeb-b899-d53e466c5ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:51:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-148817722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dda4eef-6df9-4bab-8c0c-c679c0a1f00e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f0d0d30256d4ad68900133bd00c91ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:51:16Z,use_quota=True,user_id='c567457037de43f3814c6703b4a60674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:51:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c9d96bed-8c34-4848-9945-1e4593376f69 tempest-ServerRescueNegativeTestJSON-1371069103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (988adceb-ea5c-4ed2-aa0a-f34e8d5ac3f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:51:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c9d96bed-8c34-4848-9945-1e4593376f69 tempest-ServerRescueNegativeTestJSON-1371069103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (988adceb-ea5c-4ed2-aa0a-f34e8d5ac3f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:51:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c9d96bed-8c34-4848-9945-1e4593376f69 tempest-ServerRescueNegativeTestJSON-1371069103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95b97cb5-882a-4607-9067-927b29172524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:51:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c9d96bed-8c34-4848-9945-1e4593376f69 tempest-ServerRescueNegativeTestJSON-1371069103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95b97cb5-882a-4607-9067-927b29172524) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7dda4eef-6df9-4bab-8c0c-c679c0a1f00e', 'volume_name': 'volume-7dda4eef-6df9-4bab-8c0c-c679c0a1f00e', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:51:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c9d96bed-8c34-4848-9945-1e4593376f69 tempest-ServerRescueNegativeTestJSON-1371069103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63cadd1c-8c07-4484-af8e-c303ea64b175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:51:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c9d96bed-8c34-4848-9945-1e4593376f69 tempest-ServerRescueNegativeTestJSON-1371069103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63cadd1c-8c07-4484-af8e-c303ea64b175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:51:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c9d96bed-8c34-4848-9945-1e4593376f69 tempest-ServerRescueNegativeTestJSON-1371069103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bb4e818-4b7d-49d6-9bd9-900f7fd19b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:51:15 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-c9d96bed-8c34-4848-9945-1e4593376f69 tempest-ServerRescueNegativeTestJSON-1371069103 None] Volume 7dda4eef-6df9-4bab-8c0c-c679c0a1f00e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7dda4eef-6df9-4bab-8c0c-c679c0a1f00e', 'volume_size': 1} Nov 06 17:51:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c9d96bed-8c34-4848-9945-1e4593376f69 tempest-ServerRescueNegativeTestJSON-1371069103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:51:15 devstack sudo[96115]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0e60d02a-9703-4c02-9dbd-7d95011cdc3a tempest-VolumesDeleteCascade-1850397670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.646ccc68-8329-4d87-9861-7440ba597a6c" returned: 0 in 0.528s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:15 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-0e60d02a-9703-4c02-9dbd-7d95011cdc3a tempest-VolumesDeleteCascade-1850397670 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.646ccc68-8329-4d87-9861-7440ba597a6c is being set with open permissions: ugo+rw Nov 06 17:51:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0e60d02a-9703-4c02-9dbd-7d95011cdc3a tempest-VolumesDeleteCascade-1850397670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.646ccc68-8329-4d87-9861-7440ba597a6c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:15 devstack sudo[96120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.646ccc68-8329-4d87-9861-7440ba597a6c Nov 06 17:51:15 devstack sudo[96120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:16 devstack sudo[96120]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0e60d02a-9703-4c02-9dbd-7d95011cdc3a tempest-VolumesDeleteCascade-1850397670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.646ccc68-8329-4d87-9861-7440ba597a6c" returned: 0 in 0.423s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0e60d02a-9703-4c02-9dbd-7d95011cdc3a tempest-VolumesDeleteCascade-1850397670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:16 devstack sudo[96123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.info Nov 06 17:51:16 devstack sudo[96123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:16 devstack sudo[96123]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0e60d02a-9703-4c02-9dbd-7d95011cdc3a tempest-VolumesDeleteCascade-1850397670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.info" returned: 0 in 0.384s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:16 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-0e60d02a-9703-4c02-9dbd-7d95011cdc3a tempest-VolumesDeleteCascade-1850397670 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.info is being set with open permissions: ugo+rw Nov 06 17:51:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0e60d02a-9703-4c02-9dbd-7d95011cdc3a tempest-VolumesDeleteCascade-1850397670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:16 devstack sudo[96126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.info Nov 06 17:51:16 devstack sudo[96126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:17 devstack sudo[96126]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0e60d02a-9703-4c02-9dbd-7d95011cdc3a tempest-VolumesDeleteCascade-1850397670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.info" returned: 0 in 0.307s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0e60d02a-9703-4c02-9dbd-7d95011cdc3a tempest-VolumesDeleteCascade-1850397670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.674s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:51:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c9d96bed-8c34-4848-9945-1e4593376f69 tempest-ServerRescueNegativeTestJSON-1371069103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.349s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:51:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c9d96bed-8c34-4848-9945-1e4593376f69 tempest-ServerRescueNegativeTestJSON-1371069103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:51:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-148817722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dda4eef-6df9-4bab-8c0c-c679c0a1f00e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f0d0d30256d4ad68900133bd00c91ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:51:16Z,use_quota=True,user_id='c567457037de43f3814c6703b4a60674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:51:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-c9d96bed-8c34-4848-9945-1e4593376f69 tempest-ServerRescueNegativeTestJSON-1371069103 None] Creating volume 7dda4eef-6df9-4bab-8c0c-c679c0a1f00e {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:51:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c9d96bed-8c34-4848-9945-1e4593376f69 tempest-ServerRescueNegativeTestJSON-1371069103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:51:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c9d96bed-8c34-4848-9945-1e4593376f69 tempest-ServerRescueNegativeTestJSON-1371069103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:51:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c9d96bed-8c34-4848-9945-1e4593376f69 tempest-ServerRescueNegativeTestJSON-1371069103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:51:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c9d96bed-8c34-4848-9945-1e4593376f69 tempest-ServerRescueNegativeTestJSON-1371069103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:51:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c9d96bed-8c34-4848-9945-1e4593376f69 tempest-ServerRescueNegativeTestJSON-1371069103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:51:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c9d96bed-8c34-4848-9945-1e4593376f69 tempest-ServerRescueNegativeTestJSON-1371069103 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:51:17 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-c9d96bed-8c34-4848-9945-1e4593376f69 tempest-ServerRescueNegativeTestJSON-1371069103 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:51:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c9d96bed-8c34-4848-9945-1e4593376f69 tempest-ServerRescueNegativeTestJSON-1371069103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7dda4eef-6df9-4bab-8c0c-c679c0a1f00e 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:17 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-0e60d02a-9703-4c02-9dbd-7d95011cdc3a tempest-VolumesDeleteCascade-1850397670 None] Create snapshot completed successfully Nov 06 17:51:17 devstack sudo[96129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7dda4eef-6df9-4bab-8c0c-c679c0a1f00e 1073741824 Nov 06 17:51:17 devstack sudo[96129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:17 devstack sudo[96129]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c9d96bed-8c34-4848-9945-1e4593376f69 tempest-ServerRescueNegativeTestJSON-1371069103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7dda4eef-6df9-4bab-8c0c-c679c0a1f00e 1073741824" returned: 0 in 0.828s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5821fef7-d613-4fcf-8337-356996c5c792 tempest-VolumesDeleteCascade-1850397670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:51:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c9d96bed-8c34-4848-9945-1e4593376f69 tempest-ServerRescueNegativeTestJSON-1371069103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7dda4eef-6df9-4bab-8c0c-c679c0a1f00e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:18 devstack sudo[96135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7dda4eef-6df9-4bab-8c0c-c679c0a1f00e Nov 06 17:51:18 devstack sudo[96135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:18 devstack sudo[96135]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c9d96bed-8c34-4848-9945-1e4593376f69 tempest-ServerRescueNegativeTestJSON-1371069103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7dda4eef-6df9-4bab-8c0c-c679c0a1f00e" returned: 0 in 0.317s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:18 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c9d96bed-8c34-4848-9945-1e4593376f69 tempest-ServerRescueNegativeTestJSON-1371069103 None] <== create_volume: return (1255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:51:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c9d96bed-8c34-4848-9945-1e4593376f69 tempest-ServerRescueNegativeTestJSON-1371069103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.263s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:51:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5821fef7-d613-4fcf-8337-356996c5c792 tempest-VolumesDeleteCascade-1850397670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.340s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:51:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c9d96bed-8c34-4848-9945-1e4593376f69 tempest-ServerRescueNegativeTestJSON-1371069103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bb4e818-4b7d-49d6-9bd9-900f7fd19b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dda4eef-6df9-4bab-8c0c-c679c0a1f00e', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:51:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c9d96bed-8c34-4848-9945-1e4593376f69 tempest-ServerRescueNegativeTestJSON-1371069103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87182857-5a5d-4232-ba41-9d7d51f5f0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:51:18 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-5821fef7-d613-4fcf-8337-356996c5c792 tempest-VolumesDeleteCascade-1850397670 None] Creating offline snapshot 6ae9886c-6480-4d91-ac76-1aa5bc0cf704 of volume 3d92ebd2-f7f5-4495-af28-3a4d7922bd3e {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 17:51:18 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-c9d96bed-8c34-4848-9945-1e4593376f69 tempest-ServerRescueNegativeTestJSON-1371069103 None] Volume volume-7dda4eef-6df9-4bab-8c0c-c679c0a1f00e (7dda4eef-6df9-4bab-8c0c-c679c0a1f00e): created successfully Nov 06 17:51:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c9d96bed-8c34-4848-9945-1e4593376f69 tempest-ServerRescueNegativeTestJSON-1371069103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87182857-5a5d-4232-ba41-9d7d51f5f0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:51:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c9d96bed-8c34-4848-9945-1e4593376f69 tempest-ServerRescueNegativeTestJSON-1371069103 None] Flow 'volume_create_manager' (fc0b98cf-bce9-4b75-b703-8d89497ce11f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:51:18 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a565c2-04f4-41fc-8d7b-af3786d74570]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:51:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5821fef7-d613-4fcf-8337-356996c5c792 tempest-VolumesDeleteCascade-1850397670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.646ccc68-8329-4d87-9861-7440ba597a6c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:18 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-c9d96bed-8c34-4848-9945-1e4593376f69 tempest-ServerRescueNegativeTestJSON-1371069103 None] Created volume successfully. Nov 06 17:51:18 devstack sudo[96138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.646ccc68-8329-4d87-9861-7440ba597a6c Nov 06 17:51:18 devstack sudo[96138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:19 devstack sudo[96138]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5821fef7-d613-4fcf-8337-356996c5c792 tempest-VolumesDeleteCascade-1850397670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.646ccc68-8329-4d87-9861-7440ba597a6c" returned: 0 in 0.683s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:19 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-5821fef7-d613-4fcf-8337-356996c5c792 tempest-VolumesDeleteCascade-1850397670 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 17:51:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5821fef7-d613-4fcf-8337-356996c5c792 tempest-VolumesDeleteCascade-1850397670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.646ccc68-8329-4d87-9861-7440ba597a6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.6ae9886c-6480-4d91-ac76-1aa5bc0cf704 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:19 devstack sudo[96143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.646ccc68-8329-4d87-9861-7440ba597a6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.6ae9886c-6480-4d91-ac76-1aa5bc0cf704 1G Nov 06 17:51:19 devstack sudo[96143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:20 devstack sudo[96143]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5821fef7-d613-4fcf-8337-356996c5c792 tempest-VolumesDeleteCascade-1850397670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.646ccc68-8329-4d87-9861-7440ba597a6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.6ae9886c-6480-4d91-ac76-1aa5bc0cf704 1G" returned: 0 in 0.876s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5821fef7-d613-4fcf-8337-356996c5c792 tempest-VolumesDeleteCascade-1850397670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.646ccc68-8329-4d87-9861-7440ba597a6c -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.6ae9886c-6480-4d91-ac76-1aa5bc0cf704 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:20 devstack sudo[96149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.646ccc68-8329-4d87-9861-7440ba597a6c -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.6ae9886c-6480-4d91-ac76-1aa5bc0cf704 Nov 06 17:51:20 devstack sudo[96149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:20 devstack sudo[96149]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5821fef7-d613-4fcf-8337-356996c5c792 tempest-VolumesDeleteCascade-1850397670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.646ccc68-8329-4d87-9861-7440ba597a6c -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.6ae9886c-6480-4d91-ac76-1aa5bc0cf704" returned: 0 in 0.537s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:20 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-5821fef7-d613-4fcf-8337-356996c5c792 tempest-VolumesDeleteCascade-1850397670 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.6ae9886c-6480-4d91-ac76-1aa5bc0cf704 is being set with open permissions: ugo+rw Nov 06 17:51:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5821fef7-d613-4fcf-8337-356996c5c792 tempest-VolumesDeleteCascade-1850397670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.6ae9886c-6480-4d91-ac76-1aa5bc0cf704 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:20 devstack sudo[96161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.6ae9886c-6480-4d91-ac76-1aa5bc0cf704 Nov 06 17:51:20 devstack sudo[96161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:21 devstack sudo[96161]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5821fef7-d613-4fcf-8337-356996c5c792 tempest-VolumesDeleteCascade-1850397670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.6ae9886c-6480-4d91-ac76-1aa5bc0cf704" returned: 0 in 0.457s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5821fef7-d613-4fcf-8337-356996c5c792 tempest-VolumesDeleteCascade-1850397670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.809s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:51:21 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-5821fef7-d613-4fcf-8337-356996c5c792 tempest-VolumesDeleteCascade-1850397670 None] Create snapshot completed successfully Nov 06 17:51:22 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] Acquiring lock "cinder-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:51:22 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] Lock "cinder-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:51:22 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] Performing cascade delete. {{(pid=87068) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 06 17:51:22 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] Acquiring lock "cinder-646ccc68-8329-4d87-9861-7440ba597a6c-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:51:22 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] Lock "cinder-646ccc68-8329-4d87-9861-7440ba597a6c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:51:22 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] Acquiring lock "cinder-quobyte-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:51:22 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] Lock "cinder-quobyte-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:51:22 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] Acquiring lock "cinder-quobyte-646ccc68-8329-4d87-9861-7440ba597a6c" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:51:22 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] Lock "cinder-quobyte-646ccc68-8329-4d87-9861-7440ba597a6c" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:51:22 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] Deleting offline snapshot 646ccc68-8329-4d87-9861-7440ba597a6c of volume 3d92ebd2-f7f5-4495-af28-3a4d7922bd3e {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 17:51:22 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] snapshot_file for this snap is: volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.646ccc68-8329-4d87-9861-7440ba597a6c {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 17:51:22 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49a74f0-017c-49ac-b80f-a5b561673ebf]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:51:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.646ccc68-8329-4d87-9861-7440ba597a6c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:23 devstack sudo[96193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.646ccc68-8329-4d87-9861-7440ba597a6c Nov 06 17:51:23 devstack sudo[96193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:23 devstack sudo[96193]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.646ccc68-8329-4d87-9861-7440ba597a6c" returned: 0 in 0.686s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:23 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 17:51:23 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf7a0db-e108-47e6-8ab6-6985a8f1afee]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:51:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:23 devstack sudo[96199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e Nov 06 17:51:23 devstack sudo[96199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:24 devstack sudo[96199]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e" returned: 0 in 1.089s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:24 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae0755d-d2f8-4c9f-9588-a8adc6fbec70]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:51:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.6ae9886c-6480-4d91-ac76-1aa5bc0cf704 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:25 devstack sudo[96205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.6ae9886c-6480-4d91-ac76-1aa5bc0cf704 Nov 06 17:51:25 devstack sudo[96205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:26 devstack sudo[96205]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.6ae9886c-6480-4d91-ac76-1aa5bc0cf704" returned: 0 in 1.184s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:26 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 17:51:26 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7a95d2-0705-4a34-96e6-5d8b53f17963]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:51:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.646ccc68-8329-4d87-9861-7440ba597a6c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:26 devstack sudo[96210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.646ccc68-8329-4d87-9861-7440ba597a6c Nov 06 17:51:26 devstack sudo[96210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:26 devstack sudo[96210]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.646ccc68-8329-4d87-9861-7440ba597a6c" returned: 0 in 0.770s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:26 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 17:51:27 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0467fe3e-8906-429a-86c2-db25e7d6a7bf]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:51:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:27 devstack sudo[96258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e Nov 06 17:51:27 devstack sudo[96258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:27 devstack sudo[96258]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e" returned: 0 in 0.578s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.646ccc68-8329-4d87-9861-7440ba597a6c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:27 devstack sudo[96283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.646ccc68-8329-4d87-9861-7440ba597a6c Nov 06 17:51:27 devstack sudo[96283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:28 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0eb344d-b33a-4a6c-9d6d-e803f2684cea tempest-VolumeRetypeWithoutMigrationTest-95110917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:51:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e0eb344d-b33a-4a6c-9d6d-e803f2684cea tempest-VolumeRetypeWithoutMigrationTest-95110917 None] Flow 'volume_create_manager' (e8fc2698-78d9-41b8-aa9b-0f893bc19ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:51:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e0eb344d-b33a-4a6c-9d6d-e803f2684cea tempest-VolumeRetypeWithoutMigrationTest-95110917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5a83ef8-9ecb-4bff-9aca-ca39cea5669d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:51:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e0eb344d-b33a-4a6c-9d6d-e803f2684cea tempest-VolumeRetypeWithoutMigrationTest-95110917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5a83ef8-9ecb-4bff-9aca-ca39cea5669d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-820163452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ad62a3e-ca99-4b91-ad1e-83b2746dc548,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d67183032c00466485f3b09e6293f4ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:51:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:51:28Z,use_quota=True,user_id='10a513725fc24a91b1d1fb1d46adb91a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84274f63-57e8-4dbf-bbe2-6bbf9ec73911),volume_type_id=84274f63-57e8-4dbf-bbe2-6bbf9ec73911)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:51:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e0eb344d-b33a-4a6c-9d6d-e803f2684cea tempest-VolumeRetypeWithoutMigrationTest-95110917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcc17506-fe5d-4d73-b3b5-3568d3eb4d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:51:28 devstack sudo[96283]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e0eb344d-b33a-4a6c-9d6d-e803f2684cea tempest-VolumeRetypeWithoutMigrationTest-95110917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcc17506-fe5d-4d73-b3b5-3568d3eb4d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:51:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e0eb344d-b33a-4a6c-9d6d-e803f2684cea tempest-VolumeRetypeWithoutMigrationTest-95110917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc5b1bca-b7b1-4bdd-87c2-5a320cb79034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:51:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e0eb344d-b33a-4a6c-9d6d-e803f2684cea tempest-VolumeRetypeWithoutMigrationTest-95110917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc5b1bca-b7b1-4bdd-87c2-5a320cb79034) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ad62a3e-ca99-4b91-ad1e-83b2746dc548', 'volume_name': 'volume-8ad62a3e-ca99-4b91-ad1e-83b2746dc548', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:51:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e0eb344d-b33a-4a6c-9d6d-e803f2684cea tempest-VolumeRetypeWithoutMigrationTest-95110917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87c59cf7-3266-4206-8c1b-d8c2d9f0bd8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:51:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e0eb344d-b33a-4a6c-9d6d-e803f2684cea tempest-VolumeRetypeWithoutMigrationTest-95110917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87c59cf7-3266-4206-8c1b-d8c2d9f0bd8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:51:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e0eb344d-b33a-4a6c-9d6d-e803f2684cea tempest-VolumeRetypeWithoutMigrationTest-95110917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c59a0386-dacc-4110-9123-ee8ddae38ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:51:28 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-e0eb344d-b33a-4a6c-9d6d-e803f2684cea tempest-VolumeRetypeWithoutMigrationTest-95110917 None] Volume 8ad62a3e-ca99-4b91-ad1e-83b2746dc548: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ad62a3e-ca99-4b91-ad1e-83b2746dc548', 'volume_size': 1} Nov 06 17:51:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e0eb344d-b33a-4a6c-9d6d-e803f2684cea tempest-VolumeRetypeWithoutMigrationTest-95110917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:51:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e0eb344d-b33a-4a6c-9d6d-e803f2684cea tempest-VolumeRetypeWithoutMigrationTest-95110917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:51:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e0eb344d-b33a-4a6c-9d6d-e803f2684cea tempest-VolumeRetypeWithoutMigrationTest-95110917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-820163452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ad62a3e-ca99-4b91-ad1e-83b2746dc548,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d67183032c00466485f3b09e6293f4ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:51:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:51:28Z,use_quota=True,user_id='10a513725fc24a91b1d1fb1d46adb91a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84274f63-57e8-4dbf-bbe2-6bbf9ec73911),volume_type_id=84274f63-57e8-4dbf-bbe2-6bbf9ec73911)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:51:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-e0eb344d-b33a-4a6c-9d6d-e803f2684cea tempest-VolumeRetypeWithoutMigrationTest-95110917 None] Creating volume 8ad62a3e-ca99-4b91-ad1e-83b2746dc548 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:51:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e0eb344d-b33a-4a6c-9d6d-e803f2684cea tempest-VolumeRetypeWithoutMigrationTest-95110917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:51:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e0eb344d-b33a-4a6c-9d6d-e803f2684cea tempest-VolumeRetypeWithoutMigrationTest-95110917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:51:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e0eb344d-b33a-4a6c-9d6d-e803f2684cea tempest-VolumeRetypeWithoutMigrationTest-95110917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:51:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e0eb344d-b33a-4a6c-9d6d-e803f2684cea tempest-VolumeRetypeWithoutMigrationTest-95110917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:51:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e0eb344d-b33a-4a6c-9d6d-e803f2684cea tempest-VolumeRetypeWithoutMigrationTest-95110917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:51:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e0eb344d-b33a-4a6c-9d6d-e803f2684cea tempest-VolumeRetypeWithoutMigrationTest-95110917 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:51:28 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-e0eb344d-b33a-4a6c-9d6d-e803f2684cea tempest-VolumeRetypeWithoutMigrationTest-95110917 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:51:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e0eb344d-b33a-4a6c-9d6d-e803f2684cea tempest-VolumeRetypeWithoutMigrationTest-95110917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8ad62a3e-ca99-4b91-ad1e-83b2746dc548 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.646ccc68-8329-4d87-9861-7440ba597a6c" returned: 0 in 0.588s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.646ccc68-8329-4d87-9861-7440ba597a6c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:28 devstack sudo[96288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8ad62a3e-ca99-4b91-ad1e-83b2746dc548 1073741824 Nov 06 17:51:28 devstack sudo[96288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:28 devstack sudo[96289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.646ccc68-8329-4d87-9861-7440ba597a6c Nov 06 17:51:28 devstack sudo[96289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:28 devstack sudo[96289]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.646ccc68-8329-4d87-9861-7440ba597a6c" returned: 0 in 0.489s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.6ae9886c-6480-4d91-ac76-1aa5bc0cf704 -F qcow2 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:28 devstack sudo[96297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.6ae9886c-6480-4d91-ac76-1aa5bc0cf704 -F qcow2 Nov 06 17:51:28 devstack sudo[96297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:28 devstack sudo[96288]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e0eb344d-b33a-4a6c-9d6d-e803f2684cea tempest-VolumeRetypeWithoutMigrationTest-95110917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8ad62a3e-ca99-4b91-ad1e-83b2746dc548 1073741824" returned: 0 in 0.709s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e0eb344d-b33a-4a6c-9d6d-e803f2684cea tempest-VolumeRetypeWithoutMigrationTest-95110917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8ad62a3e-ca99-4b91-ad1e-83b2746dc548 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:28 devstack sudo[96300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8ad62a3e-ca99-4b91-ad1e-83b2746dc548 Nov 06 17:51:28 devstack sudo[96300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:29 devstack sudo[96297]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.6ae9886c-6480-4d91-ac76-1aa5bc0cf704 -F qcow2" returned: 0 in 0.448s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:29 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] Lock "cinder-quobyte-646ccc68-8329-4d87-9861-7440ba597a6c" released by "_delete_snapshot" :: held 6.266s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:51:29 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] Lock "cinder-quobyte-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e" released by "delete_snapshot" :: held 6.305s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:51:29 devstack sudo[96300]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e0eb344d-b33a-4a6c-9d6d-e803f2684cea tempest-VolumeRetypeWithoutMigrationTest-95110917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8ad62a3e-ca99-4b91-ad1e-83b2746dc548" returned: 0 in 0.362s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:29 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e0eb344d-b33a-4a6c-9d6d-e803f2684cea tempest-VolumeRetypeWithoutMigrationTest-95110917 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:51:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e0eb344d-b33a-4a6c-9d6d-e803f2684cea tempest-VolumeRetypeWithoutMigrationTest-95110917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:51:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e0eb344d-b33a-4a6c-9d6d-e803f2684cea tempest-VolumeRetypeWithoutMigrationTest-95110917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c59a0386-dacc-4110-9123-ee8ddae38ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ad62a3e-ca99-4b91-ad1e-83b2746dc548', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:51:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e0eb344d-b33a-4a6c-9d6d-e803f2684cea tempest-VolumeRetypeWithoutMigrationTest-95110917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (071fff71-d27d-4ceb-8daf-806c6b365133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:51:29 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] Created reservations ['586ed09e-bb17-465e-8893-57c29c546cf7', '1dc36af2-5851-4d8d-9c1e-14a98be78361', '0fd0fe19-0956-431f-b2c8-1e97503a7475', '101ff4f4-4857-4767-a1ae-e9e463770477'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:51:29 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-e0eb344d-b33a-4a6c-9d6d-e803f2684cea tempest-VolumeRetypeWithoutMigrationTest-95110917 None] Volume volume-8ad62a3e-ca99-4b91-ad1e-83b2746dc548 (8ad62a3e-ca99-4b91-ad1e-83b2746dc548): created successfully Nov 06 17:51:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e0eb344d-b33a-4a6c-9d6d-e803f2684cea tempest-VolumeRetypeWithoutMigrationTest-95110917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (071fff71-d27d-4ceb-8daf-806c6b365133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:51:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e0eb344d-b33a-4a6c-9d6d-e803f2684cea tempest-VolumeRetypeWithoutMigrationTest-95110917 None] Flow 'volume_create_manager' (e8fc2698-78d9-41b8-aa9b-0f893bc19ca7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:51:29 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-e0eb344d-b33a-4a6c-9d6d-e803f2684cea tempest-VolumeRetypeWithoutMigrationTest-95110917 None] Created volume successfully. Nov 06 17:51:29 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] Delete snapshot completed successfully. Nov 06 17:51:29 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] Lock "cinder-646ccc68-8329-4d87-9861-7440ba597a6c-delete_snapshot" released by "delete_snapshot" :: held 6.569s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:51:29 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] Acquiring lock "cinder-6ae9886c-6480-4d91-ac76-1aa5bc0cf704-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:51:29 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] Lock "cinder-6ae9886c-6480-4d91-ac76-1aa5bc0cf704-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:51:29 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] Acquiring lock "cinder-quobyte-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:51:29 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] Lock "cinder-quobyte-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:51:29 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] Acquiring lock "cinder-quobyte-6ae9886c-6480-4d91-ac76-1aa5bc0cf704" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:51:29 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] Lock "cinder-quobyte-6ae9886c-6480-4d91-ac76-1aa5bc0cf704" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:51:29 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] Deleting offline snapshot 6ae9886c-6480-4d91-ac76-1aa5bc0cf704 of volume 3d92ebd2-f7f5-4495-af28-3a4d7922bd3e {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 17:51:29 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] snapshot_file for this snap is: volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.6ae9886c-6480-4d91-ac76-1aa5bc0cf704 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 17:51:29 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccfd1d4b-e0d2-44a3-a110-050303427bdf]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:51:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.6ae9886c-6480-4d91-ac76-1aa5bc0cf704 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:29 devstack sudo[96307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.6ae9886c-6480-4d91-ac76-1aa5bc0cf704 Nov 06 17:51:29 devstack sudo[96307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:30 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ba288672-0ac0-4270-b3bb-8668a65790b6 tempest-ServerRescueNegativeTestJSON-1371069103 None] Acquiring lock "cinder-7dda4eef-6df9-4bab-8c0c-c679c0a1f00e-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:51:30 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ba288672-0ac0-4270-b3bb-8668a65790b6 tempest-ServerRescueNegativeTestJSON-1371069103 None] Lock "cinder-7dda4eef-6df9-4bab-8c0c-c679c0a1f00e-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:51:30 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ba288672-0ac0-4270-b3bb-8668a65790b6 tempest-ServerRescueNegativeTestJSON-1371069103 None] Acquiring lock "cinder-quobyte-7dda4eef-6df9-4bab-8c0c-c679c0a1f00e" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:51:30 devstack sudo[96307]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.6ae9886c-6480-4d91-ac76-1aa5bc0cf704" returned: 0 in 0.637s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:30 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ba288672-0ac0-4270-b3bb-8668a65790b6 tempest-ServerRescueNegativeTestJSON-1371069103 None] Lock "cinder-quobyte-7dda4eef-6df9-4bab-8c0c-c679c0a1f00e" acquired by "delete_volume" :: waited 0.032s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:51:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 17:51:30 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[189446e8-38ce-4f4c-9908-fe6a624c857a]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:51:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ba288672-0ac0-4270-b3bb-8668a65790b6 tempest-ServerRescueNegativeTestJSON-1371069103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7dda4eef-6df9-4bab-8c0c-c679c0a1f00e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:30 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[98686c52-2e90-4646-954a-79cec59177d4]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:51:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:30 devstack sudo[96314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e Nov 06 17:51:30 devstack sudo[96314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:30 devstack sudo[96313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7dda4eef-6df9-4bab-8c0c-c679c0a1f00e Nov 06 17:51:30 devstack sudo[96313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-08e1edbe-5f56-4e29-82b7-2df3145a7a69 tempest-VolumeRetypeWithoutMigrationTest-95110917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:51:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-08e1edbe-5f56-4e29-82b7-2df3145a7a69 tempest-VolumeRetypeWithoutMigrationTest-95110917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:51:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-08e1edbe-5f56-4e29-82b7-2df3145a7a69 tempest-VolumeRetypeWithoutMigrationTest-95110917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:51:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-08e1edbe-5f56-4e29-82b7-2df3145a7a69 tempest-VolumeRetypeWithoutMigrationTest-95110917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:51:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-08e1edbe-5f56-4e29-82b7-2df3145a7a69 tempest-VolumeRetypeWithoutMigrationTest-95110917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:51:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-08e1edbe-5f56-4e29-82b7-2df3145a7a69 tempest-VolumeRetypeWithoutMigrationTest-95110917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:30 devstack sudo[96317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:51:30 devstack sudo[96317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:30 devstack sudo[96313]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ba288672-0ac0-4270-b3bb-8668a65790b6 tempest-ServerRescueNegativeTestJSON-1371069103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7dda4eef-6df9-4bab-8c0c-c679c0a1f00e" returned: 0 in 0.723s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ba288672-0ac0-4270-b3bb-8668a65790b6 tempest-ServerRescueNegativeTestJSON-1371069103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7dda4eef-6df9-4bab-8c0c-c679c0a1f00e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:31 devstack sudo[96314]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e" returned: 0 in 0.728s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.6ae9886c-6480-4d91-ac76-1aa5bc0cf704 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:31 devstack sudo[96327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7dda4eef-6df9-4bab-8c0c-c679c0a1f00e Nov 06 17:51:31 devstack sudo[96327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:31 devstack sudo[96328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.6ae9886c-6480-4d91-ac76-1aa5bc0cf704 Nov 06 17:51:31 devstack sudo[96328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:31 devstack sudo[96317]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-08e1edbe-5f56-4e29-82b7-2df3145a7a69 tempest-VolumeRetypeWithoutMigrationTest-95110917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.372s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:31 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-08e1edbe-5f56-4e29-82b7-2df3145a7a69 tempest-VolumeRetypeWithoutMigrationTest-95110917 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:51:31 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-08e1edbe-5f56-4e29-82b7-2df3145a7a69 tempest-VolumeRetypeWithoutMigrationTest-95110917 None] Retype volume completed successfully. Nov 06 17:51:31 devstack sudo[96327]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ba288672-0ac0-4270-b3bb-8668a65790b6 tempest-ServerRescueNegativeTestJSON-1371069103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7dda4eef-6df9-4bab-8c0c-c679c0a1f00e" returned: 0 in 0.440s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:31 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ba288672-0ac0-4270-b3bb-8668a65790b6 tempest-ServerRescueNegativeTestJSON-1371069103 None] Lock "cinder-quobyte-7dda4eef-6df9-4bab-8c0c-c679c0a1f00e" released by "delete_volume" :: held 1.259s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:51:31 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-ba288672-0ac0-4270-b3bb-8668a65790b6 tempest-ServerRescueNegativeTestJSON-1371069103 None] Created reservations ['cdf17598-f33e-4d07-b9ca-20aaf7297023', 'db925f62-f557-4463-8238-acaedfa34e52', 'cafb549b-6446-4e2d-b90d-bc0ae151ddfc', 'b8774fd9-e9b4-4d20-a0fb-355312709d43'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:51:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ba288672-0ac0-4270-b3bb-8668a65790b6 tempest-ServerRescueNegativeTestJSON-1371069103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:51:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ba288672-0ac0-4270-b3bb-8668a65790b6 tempest-ServerRescueNegativeTestJSON-1371069103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:51:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ba288672-0ac0-4270-b3bb-8668a65790b6 tempest-ServerRescueNegativeTestJSON-1371069103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:51:31 devstack sudo[96328]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ba288672-0ac0-4270-b3bb-8668a65790b6 tempest-ServerRescueNegativeTestJSON-1371069103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:51:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ba288672-0ac0-4270-b3bb-8668a65790b6 tempest-ServerRescueNegativeTestJSON-1371069103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:51:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ba288672-0ac0-4270-b3bb-8668a65790b6 tempest-ServerRescueNegativeTestJSON-1371069103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.6ae9886c-6480-4d91-ac76-1aa5bc0cf704" returned: 0 in 0.635s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.6ae9886c-6480-4d91-ac76-1aa5bc0cf704 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:31 devstack sudo[96342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.6ae9886c-6480-4d91-ac76-1aa5bc0cf704 Nov 06 17:51:31 devstack sudo[96341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:51:31 devstack sudo[96341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:31 devstack sudo[96342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:31 devstack sudo[96342]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e.6ae9886c-6480-4d91-ac76-1aa5bc0cf704" returned: 0 in 0.323s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:32 devstack sudo[96341]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ba288672-0ac0-4270-b3bb-8668a65790b6 tempest-ServerRescueNegativeTestJSON-1371069103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.389s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:32 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-ba288672-0ac0-4270-b3bb-8668a65790b6 tempest-ServerRescueNegativeTestJSON-1371069103 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:51:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] Lock "cinder-quobyte-6ae9886c-6480-4d91-ac76-1aa5bc0cf704" released by "_delete_snapshot" :: held 2.551s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:51:32 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-ba288672-0ac0-4270-b3bb-8668a65790b6 tempest-ServerRescueNegativeTestJSON-1371069103 None] Deleted volume successfully. Nov 06 17:51:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] Lock "cinder-quobyte-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e" released by "delete_snapshot" :: held 2.582s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:51:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ba288672-0ac0-4270-b3bb-8668a65790b6 tempest-ServerRescueNegativeTestJSON-1371069103 None] Lock "cinder-7dda4eef-6df9-4bab-8c0c-c679c0a1f00e-delete_volume" released by "delete_volume" :: held 2.026s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:51:32 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] Created reservations ['67443752-2ceb-47e6-a8ee-549bb9a282ca', '2a5f26a0-f0b3-40a4-9839-89e7ffe884d8', 'f8eb153e-f4b7-4a2f-b494-4201e6330808', '3579e5b1-35da-454b-b651-41247faaf2c2'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:51:32 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] Delete snapshot completed successfully. Nov 06 17:51:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] Lock "cinder-6ae9886c-6480-4d91-ac76-1aa5bc0cf704-delete_snapshot" released by "delete_snapshot" :: held 2.854s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:51:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] Snapshots deleted, issuing volume delete {{(pid=87068) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 06 17:51:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] Acquiring lock "cinder-quobyte-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:51:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] Lock "cinder-quobyte-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e" acquired by "delete_volume" :: waited 0.023s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:51:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6e532743-db90-4139-a9fb-1b841cc36046 tempest-VolumeRetypeWithoutMigrationTest-95110917 None] Acquiring lock "cinder-8ad62a3e-ca99-4b91-ad1e-83b2746dc548-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:51:32 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e8a7ba-83d0-4c62-8d7d-a5e732a54f93]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:51:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6e532743-db90-4139-a9fb-1b841cc36046 tempest-VolumeRetypeWithoutMigrationTest-95110917 None] Lock "cinder-8ad62a3e-ca99-4b91-ad1e-83b2746dc548-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:51:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6e532743-db90-4139-a9fb-1b841cc36046 tempest-VolumeRetypeWithoutMigrationTest-95110917 None] Acquiring lock "cinder-quobyte-8ad62a3e-ca99-4b91-ad1e-83b2746dc548" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:51:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6e532743-db90-4139-a9fb-1b841cc36046 tempest-VolumeRetypeWithoutMigrationTest-95110917 None] Lock "cinder-quobyte-8ad62a3e-ca99-4b91-ad1e-83b2746dc548" acquired by "delete_volume" :: waited 0.048s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:51:32 devstack sudo[96347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e Nov 06 17:51:32 devstack sudo[96347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:32 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e979f5e6-1d0a-41d0-ac4f-2cf0dac00660]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:51:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6e532743-db90-4139-a9fb-1b841cc36046 tempest-VolumeRetypeWithoutMigrationTest-95110917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8ad62a3e-ca99-4b91-ad1e-83b2746dc548 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:32 devstack sudo[96349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8ad62a3e-ca99-4b91-ad1e-83b2746dc548 Nov 06 17:51:32 devstack sudo[96349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:33 devstack sudo[96349]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6e532743-db90-4139-a9fb-1b841cc36046 tempest-VolumeRetypeWithoutMigrationTest-95110917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8ad62a3e-ca99-4b91-ad1e-83b2746dc548" returned: 0 in 0.648s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6e532743-db90-4139-a9fb-1b841cc36046 tempest-VolumeRetypeWithoutMigrationTest-95110917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8ad62a3e-ca99-4b91-ad1e-83b2746dc548 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:33 devstack sudo[96347]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e" returned: 0 in 0.960s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:33 devstack sudo[96375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8ad62a3e-ca99-4b91-ad1e-83b2746dc548 Nov 06 17:51:33 devstack sudo[96375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:33 devstack sudo[96379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e Nov 06 17:51:33 devstack sudo[96379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:34 devstack sudo[96375]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6e532743-db90-4139-a9fb-1b841cc36046 tempest-VolumeRetypeWithoutMigrationTest-95110917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8ad62a3e-ca99-4b91-ad1e-83b2746dc548" returned: 0 in 0.736s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6e532743-db90-4139-a9fb-1b841cc36046 tempest-VolumeRetypeWithoutMigrationTest-95110917 None] Lock "cinder-quobyte-8ad62a3e-ca99-4b91-ad1e-83b2746dc548" released by "delete_volume" :: held 1.493s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:51:34 devstack sudo[96379]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e" returned: 0 in 0.802s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] Lock "cinder-quobyte-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e" released by "delete_volume" :: held 1.968s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:51:34 devstack cinder-volume[87068]: WARNING cinder.quota [None req-6e532743-db90-4139-a9fb-1b841cc36046 tempest-VolumeRetypeWithoutMigrationTest-95110917 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 06 17:51:34 devstack cinder-volume[87068]: WARNING cinder.quota [None req-6e532743-db90-4139-a9fb-1b841cc36046 tempest-VolumeRetypeWithoutMigrationTest-95110917 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 06 17:51:34 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-6e532743-db90-4139-a9fb-1b841cc36046 tempest-VolumeRetypeWithoutMigrationTest-95110917 None] Created reservations ['5cfa1345-92fd-450e-82b4-b76e4550822f', '4f2fe95b-b2a2-4b63-9dd1-e5590e1de815', '0c73be2a-bca3-45fe-b84a-033e718adece', '3af3f24b-ad20-43f8-9f1a-72c989c25d0c'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:51:34 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] Created reservations ['570b3201-a19a-4754-9625-e115be11fff3', '4bc7e21c-4464-422c-8f60-8342dfaa5942', '0256f470-e3a9-4d01-9237-67c8f4bd0700', '1f544ff9-dddc-4ce9-9d62-86c921fa0fde'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:51:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6e532743-db90-4139-a9fb-1b841cc36046 tempest-VolumeRetypeWithoutMigrationTest-95110917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:51:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6e532743-db90-4139-a9fb-1b841cc36046 tempest-VolumeRetypeWithoutMigrationTest-95110917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:51:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-6e532743-db90-4139-a9fb-1b841cc36046 tempest-VolumeRetypeWithoutMigrationTest-95110917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:51:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-6e532743-db90-4139-a9fb-1b841cc36046 tempest-VolumeRetypeWithoutMigrationTest-95110917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:51:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6e532743-db90-4139-a9fb-1b841cc36046 tempest-VolumeRetypeWithoutMigrationTest-95110917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:51:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6e532743-db90-4139-a9fb-1b841cc36046 tempest-VolumeRetypeWithoutMigrationTest-95110917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:34 devstack sudo[96389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:51:34 devstack sudo[96389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:51:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:51:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:51:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:51:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:51:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:34 devstack sudo[96391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:51:34 devstack sudo[96391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:35 devstack sudo[96389]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6e532743-db90-4139-a9fb-1b841cc36046 tempest-VolumeRetypeWithoutMigrationTest-95110917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.482s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:35 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-6e532743-db90-4139-a9fb-1b841cc36046 tempest-VolumeRetypeWithoutMigrationTest-95110917 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:51:35 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-6e532743-db90-4139-a9fb-1b841cc36046 tempest-VolumeRetypeWithoutMigrationTest-95110917 None] Deleted volume successfully. Nov 06 17:51:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6e532743-db90-4139-a9fb-1b841cc36046 tempest-VolumeRetypeWithoutMigrationTest-95110917 None] Lock "cinder-8ad62a3e-ca99-4b91-ad1e-83b2746dc548-delete_volume" released by "delete_volume" :: held 2.600s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:51:35 devstack sudo[96391]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.446s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:35 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:51:35 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] Deleted volume successfully. Nov 06 17:51:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8949f4cd-f5f3-4e21-81d1-2f484f3b616a tempest-VolumesDeleteCascade-1850397670 None] Lock "cinder-3d92ebd2-f7f5-4495-af28-3a4d7922bd3e-delete_volume" released by "delete_volume" :: held 12.541s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:51:37 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-849861ba-3eab-4d2a-bdc0-513994478aca tempest-VolumesDeleteCascade-1850397670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:51:37 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-849861ba-3eab-4d2a-bdc0-513994478aca tempest-VolumesDeleteCascade-1850397670 None] Flow 'volume_create_manager' (f78d9598-cc1c-4d67-8cc8-16a0c10187bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:51:37 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-849861ba-3eab-4d2a-bdc0-513994478aca tempest-VolumesDeleteCascade-1850397670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29b4e820-319e-4cf5-bf0c-217d29472435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:51:37 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-849861ba-3eab-4d2a-bdc0-513994478aca tempest-VolumesDeleteCascade-1850397670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29b4e820-319e-4cf5-bf0c-217d29472435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:51:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1895572090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8280a704-cfe9-448f-b8c6-23b4d946c95e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881549d4ad124184a7aac736a8a61439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:51:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:51:37Z,use_quota=True,user_id='c69738ee987d43309b9f39757c5c11e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:51:37 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-849861ba-3eab-4d2a-bdc0-513994478aca tempest-VolumesDeleteCascade-1850397670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1984edb5-c7db-4c5a-aa9a-2361b7133141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:51:37 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-849861ba-3eab-4d2a-bdc0-513994478aca tempest-VolumesDeleteCascade-1850397670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1984edb5-c7db-4c5a-aa9a-2361b7133141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:51:37 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-849861ba-3eab-4d2a-bdc0-513994478aca tempest-VolumesDeleteCascade-1850397670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bafe9a6-dff7-4f3f-ba8d-c4c3880286a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:51:37 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-849861ba-3eab-4d2a-bdc0-513994478aca tempest-VolumesDeleteCascade-1850397670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bafe9a6-dff7-4f3f-ba8d-c4c3880286a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8280a704-cfe9-448f-b8c6-23b4d946c95e', 'volume_name': 'volume-8280a704-cfe9-448f-b8c6-23b4d946c95e', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:51:37 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-849861ba-3eab-4d2a-bdc0-513994478aca tempest-VolumesDeleteCascade-1850397670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3206b719-a90c-42d7-aee3-611c17528365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:51:37 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-849861ba-3eab-4d2a-bdc0-513994478aca tempest-VolumesDeleteCascade-1850397670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3206b719-a90c-42d7-aee3-611c17528365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:51:37 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-849861ba-3eab-4d2a-bdc0-513994478aca tempest-VolumesDeleteCascade-1850397670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78c60e4d-baa7-43d3-a705-2c6ac5e1410e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:51:37 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-849861ba-3eab-4d2a-bdc0-513994478aca tempest-VolumesDeleteCascade-1850397670 None] Volume 8280a704-cfe9-448f-b8c6-23b4d946c95e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8280a704-cfe9-448f-b8c6-23b4d946c95e', 'volume_size': 1} Nov 06 17:51:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-849861ba-3eab-4d2a-bdc0-513994478aca tempest-VolumesDeleteCascade-1850397670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:51:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-849861ba-3eab-4d2a-bdc0-513994478aca tempest-VolumesDeleteCascade-1850397670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:51:37 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-849861ba-3eab-4d2a-bdc0-513994478aca tempest-VolumesDeleteCascade-1850397670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:51:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1895572090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8280a704-cfe9-448f-b8c6-23b4d946c95e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881549d4ad124184a7aac736a8a61439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:51:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:51:37Z,use_quota=True,user_id='c69738ee987d43309b9f39757c5c11e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:51:37 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-849861ba-3eab-4d2a-bdc0-513994478aca tempest-VolumesDeleteCascade-1850397670 None] Creating volume 8280a704-cfe9-448f-b8c6-23b4d946c95e {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:51:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-849861ba-3eab-4d2a-bdc0-513994478aca tempest-VolumesDeleteCascade-1850397670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:51:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-849861ba-3eab-4d2a-bdc0-513994478aca tempest-VolumesDeleteCascade-1850397670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:51:37 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-849861ba-3eab-4d2a-bdc0-513994478aca tempest-VolumesDeleteCascade-1850397670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:51:37 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-849861ba-3eab-4d2a-bdc0-513994478aca tempest-VolumesDeleteCascade-1850397670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:51:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-849861ba-3eab-4d2a-bdc0-513994478aca tempest-VolumesDeleteCascade-1850397670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:51:37 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-849861ba-3eab-4d2a-bdc0-513994478aca tempest-VolumesDeleteCascade-1850397670 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:51:37 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-849861ba-3eab-4d2a-bdc0-513994478aca tempest-VolumesDeleteCascade-1850397670 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:51:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-849861ba-3eab-4d2a-bdc0-513994478aca tempest-VolumesDeleteCascade-1850397670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8280a704-cfe9-448f-b8c6-23b4d946c95e 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:37 devstack sudo[96397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8280a704-cfe9-448f-b8c6-23b4d946c95e 1073741824 Nov 06 17:51:37 devstack sudo[96397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:38 devstack sudo[96397]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-849861ba-3eab-4d2a-bdc0-513994478aca tempest-VolumesDeleteCascade-1850397670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8280a704-cfe9-448f-b8c6-23b4d946c95e 1073741824" returned: 0 in 0.907s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-849861ba-3eab-4d2a-bdc0-513994478aca tempest-VolumesDeleteCascade-1850397670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8280a704-cfe9-448f-b8c6-23b4d946c95e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:38 devstack sudo[96423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8280a704-cfe9-448f-b8c6-23b4d946c95e Nov 06 17:51:38 devstack sudo[96423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:38 devstack sudo[96423]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-849861ba-3eab-4d2a-bdc0-513994478aca tempest-VolumesDeleteCascade-1850397670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8280a704-cfe9-448f-b8c6-23b4d946c95e" returned: 0 in 0.292s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-849861ba-3eab-4d2a-bdc0-513994478aca tempest-VolumesDeleteCascade-1850397670 None] <== create_volume: return (1262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:51:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-849861ba-3eab-4d2a-bdc0-513994478aca tempest-VolumesDeleteCascade-1850397670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.269s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:51:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-849861ba-3eab-4d2a-bdc0-513994478aca tempest-VolumesDeleteCascade-1850397670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78c60e4d-baa7-43d3-a705-2c6ac5e1410e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8280a704-cfe9-448f-b8c6-23b4d946c95e', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:51:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-849861ba-3eab-4d2a-bdc0-513994478aca tempest-VolumesDeleteCascade-1850397670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6029f42f-b72a-4d1f-a460-01b94dcc4ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:51:38 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-849861ba-3eab-4d2a-bdc0-513994478aca tempest-VolumesDeleteCascade-1850397670 None] Volume volume-8280a704-cfe9-448f-b8c6-23b4d946c95e (8280a704-cfe9-448f-b8c6-23b4d946c95e): created successfully Nov 06 17:51:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-849861ba-3eab-4d2a-bdc0-513994478aca tempest-VolumesDeleteCascade-1850397670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6029f42f-b72a-4d1f-a460-01b94dcc4ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:51:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-849861ba-3eab-4d2a-bdc0-513994478aca tempest-VolumesDeleteCascade-1850397670 None] Flow 'volume_create_manager' (f78d9598-cc1c-4d67-8cc8-16a0c10187bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:51:38 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-849861ba-3eab-4d2a-bdc0-513994478aca tempest-VolumesDeleteCascade-1850397670 None] Created volume successfully. Nov 06 17:51:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b4a18c8c-cd1d-49b3-a76b-794e707b529e tempest-VolumesDeleteCascade-1850397670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:51:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b4a18c8c-cd1d-49b3-a76b-794e707b529e tempest-VolumesDeleteCascade-1850397670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:51:39 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-b4a18c8c-cd1d-49b3-a76b-794e707b529e tempest-VolumesDeleteCascade-1850397670 None] Creating offline snapshot 625ca2f5-4a98-4fd9-9dd4-500c08bf7e13 of volume 8280a704-cfe9-448f-b8c6-23b4d946c95e {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 17:51:39 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[92153930-e298-4cc0-b0e1-336f84ddb8ff]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:51:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b4a18c8c-cd1d-49b3-a76b-794e707b529e tempest-VolumesDeleteCascade-1850397670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8280a704-cfe9-448f-b8c6-23b4d946c95e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:39 devstack sudo[96428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8280a704-cfe9-448f-b8c6-23b4d946c95e Nov 06 17:51:39 devstack sudo[96428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:40 devstack sudo[96428]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b4a18c8c-cd1d-49b3-a76b-794e707b529e tempest-VolumesDeleteCascade-1850397670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8280a704-cfe9-448f-b8c6-23b4d946c95e" returned: 0 in 0.565s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b4a18c8c-cd1d-49b3-a76b-794e707b529e tempest-VolumesDeleteCascade-1850397670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8280a704-cfe9-448f-b8c6-23b4d946c95e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8280a704-cfe9-448f-b8c6-23b4d946c95e.625ca2f5-4a98-4fd9-9dd4-500c08bf7e13 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:40 devstack sudo[96434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8280a704-cfe9-448f-b8c6-23b4d946c95e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8280a704-cfe9-448f-b8c6-23b4d946c95e.625ca2f5-4a98-4fd9-9dd4-500c08bf7e13 1G Nov 06 17:51:40 devstack sudo[96434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:40 devstack sudo[96434]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b4a18c8c-cd1d-49b3-a76b-794e707b529e tempest-VolumesDeleteCascade-1850397670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8280a704-cfe9-448f-b8c6-23b4d946c95e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8280a704-cfe9-448f-b8c6-23b4d946c95e.625ca2f5-4a98-4fd9-9dd4-500c08bf7e13 1G" returned: 0 in 0.539s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b4a18c8c-cd1d-49b3-a76b-794e707b529e tempest-VolumesDeleteCascade-1850397670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8280a704-cfe9-448f-b8c6-23b4d946c95e -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8280a704-cfe9-448f-b8c6-23b4d946c95e.625ca2f5-4a98-4fd9-9dd4-500c08bf7e13 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:40 devstack sudo[96441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8280a704-cfe9-448f-b8c6-23b4d946c95e -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8280a704-cfe9-448f-b8c6-23b4d946c95e.625ca2f5-4a98-4fd9-9dd4-500c08bf7e13 Nov 06 17:51:40 devstack sudo[96441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:40 devstack sudo[96441]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b4a18c8c-cd1d-49b3-a76b-794e707b529e tempest-VolumesDeleteCascade-1850397670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8280a704-cfe9-448f-b8c6-23b4d946c95e -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8280a704-cfe9-448f-b8c6-23b4d946c95e.625ca2f5-4a98-4fd9-9dd4-500c08bf7e13" returned: 0 in 0.436s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:40 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-b4a18c8c-cd1d-49b3-a76b-794e707b529e tempest-VolumesDeleteCascade-1850397670 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8280a704-cfe9-448f-b8c6-23b4d946c95e.625ca2f5-4a98-4fd9-9dd4-500c08bf7e13 is being set with open permissions: ugo+rw Nov 06 17:51:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b4a18c8c-cd1d-49b3-a76b-794e707b529e tempest-VolumesDeleteCascade-1850397670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8280a704-cfe9-448f-b8c6-23b4d946c95e.625ca2f5-4a98-4fd9-9dd4-500c08bf7e13 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:41 devstack sudo[96447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8280a704-cfe9-448f-b8c6-23b4d946c95e.625ca2f5-4a98-4fd9-9dd4-500c08bf7e13 Nov 06 17:51:41 devstack sudo[96447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:41 devstack sudo[96447]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b4a18c8c-cd1d-49b3-a76b-794e707b529e tempest-VolumesDeleteCascade-1850397670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8280a704-cfe9-448f-b8c6-23b4d946c95e.625ca2f5-4a98-4fd9-9dd4-500c08bf7e13" returned: 0 in 0.285s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b4a18c8c-cd1d-49b3-a76b-794e707b529e tempest-VolumesDeleteCascade-1850397670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8280a704-cfe9-448f-b8c6-23b4d946c95e.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:41 devstack sudo[96450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8280a704-cfe9-448f-b8c6-23b4d946c95e.info Nov 06 17:51:41 devstack sudo[96450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:41 devstack sudo[96450]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b4a18c8c-cd1d-49b3-a76b-794e707b529e tempest-VolumesDeleteCascade-1850397670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8280a704-cfe9-448f-b8c6-23b4d946c95e.info" returned: 0 in 0.373s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:41 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-b4a18c8c-cd1d-49b3-a76b-794e707b529e tempest-VolumesDeleteCascade-1850397670 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8280a704-cfe9-448f-b8c6-23b4d946c95e.info is being set with open permissions: ugo+rw Nov 06 17:51:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b4a18c8c-cd1d-49b3-a76b-794e707b529e tempest-VolumesDeleteCascade-1850397670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8280a704-cfe9-448f-b8c6-23b4d946c95e.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:41 devstack sudo[96453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8280a704-cfe9-448f-b8c6-23b4d946c95e.info Nov 06 17:51:41 devstack sudo[96453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:42 devstack sudo[96453]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b4a18c8c-cd1d-49b3-a76b-794e707b529e tempest-VolumesDeleteCascade-1850397670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8280a704-cfe9-448f-b8c6-23b4d946c95e.info" returned: 0 in 0.337s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b4a18c8c-cd1d-49b3-a76b-794e707b529e tempest-VolumesDeleteCascade-1850397670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.697s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:51:42 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-b4a18c8c-cd1d-49b3-a76b-794e707b529e tempest-VolumesDeleteCascade-1850397670 None] Create snapshot completed successfully Nov 06 17:51:43 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-a78a9628-f65e-4c14-b8e5-8e09899d2cfc tempest-VolumesDeleteCascade-1850397670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:51:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a78a9628-f65e-4c14-b8e5-8e09899d2cfc tempest-VolumesDeleteCascade-1850397670 None] Flow 'volume_create_manager' (a30d1b45-a6e1-4be7-9be1-1203eff2b323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:51:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a78a9628-f65e-4c14-b8e5-8e09899d2cfc tempest-VolumesDeleteCascade-1850397670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa079b00-c88d-4512-8c27-d537527ed82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:51:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a78a9628-f65e-4c14-b8e5-8e09899d2cfc tempest-VolumesDeleteCascade-1850397670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa079b00-c88d-4512-8c27-d537527ed82d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:51:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2104241220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51fefaca-c1e0-4b6f-a320-23c5f573d589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881549d4ad124184a7aac736a8a61439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:51:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=625ca2f5-4a98-4fd9-9dd4-500c08bf7e13,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:51:43Z,use_quota=True,user_id='c69738ee987d43309b9f39757c5c11e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:51:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a78a9628-f65e-4c14-b8e5-8e09899d2cfc tempest-VolumesDeleteCascade-1850397670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4acf19ad-5d6f-4c66-a6fe-fcca5f0a7e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:51:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a78a9628-f65e-4c14-b8e5-8e09899d2cfc tempest-VolumesDeleteCascade-1850397670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4acf19ad-5d6f-4c66-a6fe-fcca5f0a7e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:51:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a78a9628-f65e-4c14-b8e5-8e09899d2cfc tempest-VolumesDeleteCascade-1850397670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8edc3a1-ed49-421c-9c59-bfc84ab0b45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:51:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a78a9628-f65e-4c14-b8e5-8e09899d2cfc tempest-VolumesDeleteCascade-1850397670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8edc3a1-ed49-421c-9c59-bfc84ab0b45e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '51fefaca-c1e0-4b6f-a320-23c5f573d589', 'volume_name': 'volume-51fefaca-c1e0-4b6f-a320-23c5f573d589', 'volume_size': 1, 'snapshot_id': '625ca2f5-4a98-4fd9-9dd4-500c08bf7e13'}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:51:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a78a9628-f65e-4c14-b8e5-8e09899d2cfc tempest-VolumesDeleteCascade-1850397670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50536da4-31c2-42c9-9e5c-6a1f6e556173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:51:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a78a9628-f65e-4c14-b8e5-8e09899d2cfc tempest-VolumesDeleteCascade-1850397670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50536da4-31c2-42c9-9e5c-6a1f6e556173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:51:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a78a9628-f65e-4c14-b8e5-8e09899d2cfc tempest-VolumesDeleteCascade-1850397670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c38ff06-3473-4795-bae2-4467d06fd969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:51:43 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-a78a9628-f65e-4c14-b8e5-8e09899d2cfc tempest-VolumesDeleteCascade-1850397670 None] Volume 51fefaca-c1e0-4b6f-a320-23c5f573d589: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-51fefaca-c1e0-4b6f-a320-23c5f573d589', 'volume_size': 1, 'snapshot_id': '625ca2f5-4a98-4fd9-9dd4-500c08bf7e13'} Nov 06 17:51:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a78a9628-f65e-4c14-b8e5-8e09899d2cfc tempest-VolumesDeleteCascade-1850397670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:51:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a78a9628-f65e-4c14-b8e5-8e09899d2cfc tempest-VolumesDeleteCascade-1850397670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:51:43 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a78a9628-f65e-4c14-b8e5-8e09899d2cfc tempest-VolumesDeleteCascade-1850397670 None] Acquiring lock "cinder-quobyte-625ca2f5-4a98-4fd9-9dd4-500c08bf7e13-51fefaca-c1e0-4b6f-a320-23c5f573d589" by "_create_volume_from_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:51:43 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a78a9628-f65e-4c14-b8e5-8e09899d2cfc tempest-VolumesDeleteCascade-1850397670 None] Lock "cinder-quobyte-625ca2f5-4a98-4fd9-9dd4-500c08bf7e13-51fefaca-c1e0-4b6f-a320-23c5f573d589" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:51:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a78a9628-f65e-4c14-b8e5-8e09899d2cfc tempest-VolumesDeleteCascade-1850397670 None] Creating volume 51fefaca-c1e0-4b6f-a320-23c5f573d589 from snapshot 625ca2f5-4a98-4fd9-9dd4-500c08bf7e13 {{(pid=87068) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 17:51:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a78a9628-f65e-4c14-b8e5-8e09899d2cfc tempest-VolumesDeleteCascade-1850397670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:51:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a78a9628-f65e-4c14-b8e5-8e09899d2cfc tempest-VolumesDeleteCascade-1850397670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:51:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a78a9628-f65e-4c14-b8e5-8e09899d2cfc tempest-VolumesDeleteCascade-1850397670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:51:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a78a9628-f65e-4c14-b8e5-8e09899d2cfc tempest-VolumesDeleteCascade-1850397670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:51:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a78a9628-f65e-4c14-b8e5-8e09899d2cfc tempest-VolumesDeleteCascade-1850397670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:51:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a78a9628-f65e-4c14-b8e5-8e09899d2cfc tempest-VolumesDeleteCascade-1850397670 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:51:43 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a78a9628-f65e-4c14-b8e5-8e09899d2cfc tempest-VolumesDeleteCascade-1850397670 None] Acquiring lock "cinder-quobyte-51fefaca-c1e0-4b6f-a320-23c5f573d589" by "_copy_volume_from_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:51:43 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a78a9628-f65e-4c14-b8e5-8e09899d2cfc tempest-VolumesDeleteCascade-1850397670 None] Lock "cinder-quobyte-51fefaca-c1e0-4b6f-a320-23c5f573d589" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:51:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a78a9628-f65e-4c14-b8e5-8e09899d2cfc tempest-VolumesDeleteCascade-1850397670 None] snapshot: 625ca2f5-4a98-4fd9-9dd4-500c08bf7e13, volume: 51fefaca-c1e0-4b6f-a320-23c5f573d589, {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 17:51:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a78a9628-f65e-4c14-b8e5-8e09899d2cfc tempest-VolumesDeleteCascade-1850397670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:51:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a78a9628-f65e-4c14-b8e5-8e09899d2cfc tempest-VolumesDeleteCascade-1850397670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:51:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a78a9628-f65e-4c14-b8e5-8e09899d2cfc tempest-VolumesDeleteCascade-1850397670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:51:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a78a9628-f65e-4c14-b8e5-8e09899d2cfc tempest-VolumesDeleteCascade-1850397670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:51:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a78a9628-f65e-4c14-b8e5-8e09899d2cfc tempest-VolumesDeleteCascade-1850397670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:51:43 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c390e7-bf6f-4707-a105-e0a1ab0753f6]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:51:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a78a9628-f65e-4c14-b8e5-8e09899d2cfc tempest-VolumesDeleteCascade-1850397670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8280a704-cfe9-448f-b8c6-23b4d946c95e.625ca2f5-4a98-4fd9-9dd4-500c08bf7e13 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:43 devstack sudo[96457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8280a704-cfe9-448f-b8c6-23b4d946c95e.625ca2f5-4a98-4fd9-9dd4-500c08bf7e13 Nov 06 17:51:43 devstack sudo[96457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:44 devstack sudo[96457]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a78a9628-f65e-4c14-b8e5-8e09899d2cfc tempest-VolumesDeleteCascade-1850397670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8280a704-cfe9-448f-b8c6-23b4d946c95e.625ca2f5-4a98-4fd9-9dd4-500c08bf7e13" returned: 0 in 0.484s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:44 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-a78a9628-f65e-4c14-b8e5-8e09899d2cfc tempest-VolumesDeleteCascade-1850397670 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8280a704-cfe9-448f-b8c6-23b4d946c95e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 17:51:44 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29885c3-1a13-4676-b0a0-0e397bc1358d]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:51:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a78a9628-f65e-4c14-b8e5-8e09899d2cfc tempest-VolumesDeleteCascade-1850397670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8280a704-cfe9-448f-b8c6-23b4d946c95e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:44 devstack sudo[96462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8280a704-cfe9-448f-b8c6-23b4d946c95e Nov 06 17:51:44 devstack sudo[96462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:44 devstack sudo[96462]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a78a9628-f65e-4c14-b8e5-8e09899d2cfc tempest-VolumesDeleteCascade-1850397670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8280a704-cfe9-448f-b8c6-23b4d946c95e" returned: 0 in 0.390s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:44 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a78a9628-f65e-4c14-b8e5-8e09899d2cfc tempest-VolumesDeleteCascade-1850397670 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8280a704-cfe9-448f-b8c6-23b4d946c95e {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 17:51:44 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a78a9628-f65e-4c14-b8e5-8e09899d2cfc tempest-VolumesDeleteCascade-1850397670 None] Creating direct copy from snapshot {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 17:51:44 devstack cinder-volume[87068]: DEBUG cinder.utils [None req-a78a9628-f65e-4c14-b8e5-8e09899d2cfc tempest-VolumesDeleteCascade-1850397670 None] Path /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-51fefaca-c1e0-4b6f-a320-23c5f573d589 not found in is_blk_device check {{(pid=87068) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 17:51:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a78a9628-f65e-4c14-b8e5-8e09899d2cfc tempest-VolumesDeleteCascade-1850397670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8280a704-cfe9-448f-b8c6-23b4d946c95e /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-51fefaca-c1e0-4b6f-a320-23c5f573d589 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:44 devstack sudo[96467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8280a704-cfe9-448f-b8c6-23b4d946c95e /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-51fefaca-c1e0-4b6f-a320-23c5f573d589 Nov 06 17:51:44 devstack sudo[96467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a78a9628-f65e-4c14-b8e5-8e09899d2cfc tempest-VolumesDeleteCascade-1850397670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8280a704-cfe9-448f-b8c6-23b4d946c95e /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-51fefaca-c1e0-4b6f-a320-23c5f573d589" returned: 0 in 9.299s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:53 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-a78a9628-f65e-4c14-b8e5-8e09899d2cfc tempest-VolumesDeleteCascade-1850397670 None] Image conversion details: src /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8280a704-cfe9-448f-b8c6-23b4d946c95e, size 1024.00 MB, duration 9.30 sec, destination /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-51fefaca-c1e0-4b6f-a320-23c5f573d589 {{(pid=87068) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 17:51:53 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-a78a9628-f65e-4c14-b8e5-8e09899d2cfc tempest-VolumesDeleteCascade-1850397670 None] Converted 1024.00 MB image at 110.07 MB/s Nov 06 17:51:53 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-a78a9628-f65e-4c14-b8e5-8e09899d2cfc tempest-VolumesDeleteCascade-1850397670 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-51fefaca-c1e0-4b6f-a320-23c5f573d589 is being set with open permissions: ugo+rw Nov 06 17:51:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a78a9628-f65e-4c14-b8e5-8e09899d2cfc tempest-VolumesDeleteCascade-1850397670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-51fefaca-c1e0-4b6f-a320-23c5f573d589 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:53 devstack sudo[96527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-51fefaca-c1e0-4b6f-a320-23c5f573d589 Nov 06 17:51:53 devstack sudo[96527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:54 devstack sudo[96527]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a78a9628-f65e-4c14-b8e5-8e09899d2cfc tempest-VolumesDeleteCascade-1850397670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-51fefaca-c1e0-4b6f-a320-23c5f573d589" returned: 0 in 0.473s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:54 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a78a9628-f65e-4c14-b8e5-8e09899d2cfc tempest-VolumesDeleteCascade-1850397670 None] Lock "cinder-quobyte-51fefaca-c1e0-4b6f-a320-23c5f573d589" released by "_copy_volume_from_snapshot" :: held 10.781s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:51:54 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a78a9628-f65e-4c14-b8e5-8e09899d2cfc tempest-VolumesDeleteCascade-1850397670 None] Lock "cinder-quobyte-625ca2f5-4a98-4fd9-9dd4-500c08bf7e13-51fefaca-c1e0-4b6f-a320-23c5f573d589" released by "_create_volume_from_snapshot" :: held 10.877s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:51:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a78a9628-f65e-4c14-b8e5-8e09899d2cfc tempest-VolumesDeleteCascade-1850397670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.897s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:51:54 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 17:51:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:51:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:51:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:51:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:51:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:51:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a78a9628-f65e-4c14-b8e5-8e09899d2cfc tempest-VolumesDeleteCascade-1850397670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c38ff06-3473-4795-bae2-4467d06fd969) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51fefaca-c1e0-4b6f-a320-23c5f573d589', 'volume_size': 1, 'snapshot_id': '625ca2f5-4a98-4fd9-9dd4-500c08bf7e13'}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:51:54 devstack sudo[96530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:51:54 devstack sudo[96530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a78a9628-f65e-4c14-b8e5-8e09899d2cfc tempest-VolumesDeleteCascade-1850397670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f83471f1-6be1-4c2f-9cbf-29112b855095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:51:54 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-a78a9628-f65e-4c14-b8e5-8e09899d2cfc tempest-VolumesDeleteCascade-1850397670 None] Volume volume-51fefaca-c1e0-4b6f-a320-23c5f573d589 (51fefaca-c1e0-4b6f-a320-23c5f573d589): created successfully Nov 06 17:51:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a78a9628-f65e-4c14-b8e5-8e09899d2cfc tempest-VolumesDeleteCascade-1850397670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f83471f1-6be1-4c2f-9cbf-29112b855095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:51:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a78a9628-f65e-4c14-b8e5-8e09899d2cfc tempest-VolumesDeleteCascade-1850397670 None] Flow 'volume_create_manager' (a30d1b45-a6e1-4be7-9be1-1203eff2b323) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:51:54 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-a78a9628-f65e-4c14-b8e5-8e09899d2cfc tempest-VolumesDeleteCascade-1850397670 None] Created volume successfully. Nov 06 17:51:54 devstack sudo[96530]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.393s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:54 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:51:54 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running periodic task VolumeManager._thread_info {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 17:51:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] thread count: 28 {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 17:51:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] thread info: [<_MainThread(MainThread, started 133940619505792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 17:51:55 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8661ad3-246f-4373-933e-45638e553ab8 tempest-VolumesTransfersV355Test-1687217266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:51:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b8661ad3-246f-4373-933e-45638e553ab8 tempest-VolumesTransfersV355Test-1687217266 None] Flow 'volume_create_manager' (5d60146f-a190-4640-b798-da3fe6484a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:51:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b8661ad3-246f-4373-933e-45638e553ab8 tempest-VolumesTransfersV355Test-1687217266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (939a471f-64df-40cf-a3a9-ce6ee9b8b77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:51:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b8661ad3-246f-4373-933e-45638e553ab8 tempest-VolumesTransfersV355Test-1687217266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (939a471f-64df-40cf-a3a9-ce6ee9b8b77e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:51:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1835623986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29a7af3c-f9eb-4723-9d9e-12a6b5b0216b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c89fb88979f94a7bbff89c31540e6d74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:51:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:51:56Z,use_quota=True,user_id='bad3cc147a014e078f8e0d9eac579087',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:51:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b8661ad3-246f-4373-933e-45638e553ab8 tempest-VolumesTransfersV355Test-1687217266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f4a5e0c-f3dc-48c9-8fe0-e80cfd851175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:51:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b8661ad3-246f-4373-933e-45638e553ab8 tempest-VolumesTransfersV355Test-1687217266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f4a5e0c-f3dc-48c9-8fe0-e80cfd851175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:51:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b8661ad3-246f-4373-933e-45638e553ab8 tempest-VolumesTransfersV355Test-1687217266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (588ee2b9-9170-4819-b82b-260024dbfb06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:51:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b8661ad3-246f-4373-933e-45638e553ab8 tempest-VolumesTransfersV355Test-1687217266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (588ee2b9-9170-4819-b82b-260024dbfb06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29a7af3c-f9eb-4723-9d9e-12a6b5b0216b', 'volume_name': 'volume-29a7af3c-f9eb-4723-9d9e-12a6b5b0216b', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:51:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b8661ad3-246f-4373-933e-45638e553ab8 tempest-VolumesTransfersV355Test-1687217266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daba3d14-7bda-4cbc-8c57-1adceaa22b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:51:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b8661ad3-246f-4373-933e-45638e553ab8 tempest-VolumesTransfersV355Test-1687217266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daba3d14-7bda-4cbc-8c57-1adceaa22b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:51:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b8661ad3-246f-4373-933e-45638e553ab8 tempest-VolumesTransfersV355Test-1687217266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d24ce5a-d3c2-4e3e-a492-3546eea26722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:51:55 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-b8661ad3-246f-4373-933e-45638e553ab8 tempest-VolumesTransfersV355Test-1687217266 None] Volume 29a7af3c-f9eb-4723-9d9e-12a6b5b0216b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29a7af3c-f9eb-4723-9d9e-12a6b5b0216b', 'volume_size': 1} Nov 06 17:51:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b8661ad3-246f-4373-933e-45638e553ab8 tempest-VolumesTransfersV355Test-1687217266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:51:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b8661ad3-246f-4373-933e-45638e553ab8 tempest-VolumesTransfersV355Test-1687217266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:51:55 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b8661ad3-246f-4373-933e-45638e553ab8 tempest-VolumesTransfersV355Test-1687217266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:51:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1835623986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29a7af3c-f9eb-4723-9d9e-12a6b5b0216b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c89fb88979f94a7bbff89c31540e6d74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:51:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:51:56Z,use_quota=True,user_id='bad3cc147a014e078f8e0d9eac579087',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:51:55 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-b8661ad3-246f-4373-933e-45638e553ab8 tempest-VolumesTransfersV355Test-1687217266 None] Creating volume 29a7af3c-f9eb-4723-9d9e-12a6b5b0216b {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:51:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b8661ad3-246f-4373-933e-45638e553ab8 tempest-VolumesTransfersV355Test-1687217266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:51:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b8661ad3-246f-4373-933e-45638e553ab8 tempest-VolumesTransfersV355Test-1687217266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:51:55 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b8661ad3-246f-4373-933e-45638e553ab8 tempest-VolumesTransfersV355Test-1687217266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:51:55 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b8661ad3-246f-4373-933e-45638e553ab8 tempest-VolumesTransfersV355Test-1687217266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:51:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b8661ad3-246f-4373-933e-45638e553ab8 tempest-VolumesTransfersV355Test-1687217266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:51:55 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b8661ad3-246f-4373-933e-45638e553ab8 tempest-VolumesTransfersV355Test-1687217266 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:51:55 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-b8661ad3-246f-4373-933e-45638e553ab8 tempest-VolumesTransfersV355Test-1687217266 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:51:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b8661ad3-246f-4373-933e-45638e553ab8 tempest-VolumesTransfersV355Test-1687217266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-29a7af3c-f9eb-4723-9d9e-12a6b5b0216b 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:55 devstack sudo[96533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-29a7af3c-f9eb-4723-9d9e-12a6b5b0216b 1073741824 Nov 06 17:51:55 devstack sudo[96533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b184afa0-ec88-4e75-944f-295e44493bcc tempest-VolumesDeleteCascade-1850397670 None] Acquiring lock "cinder-8280a704-cfe9-448f-b8c6-23b4d946c95e-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:51:56 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b184afa0-ec88-4e75-944f-295e44493bcc tempest-VolumesDeleteCascade-1850397670 None] Lock "cinder-8280a704-cfe9-448f-b8c6-23b4d946c95e-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:51:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b184afa0-ec88-4e75-944f-295e44493bcc tempest-VolumesDeleteCascade-1850397670 None] Performing cascade delete. {{(pid=87068) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 06 17:51:56 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b184afa0-ec88-4e75-944f-295e44493bcc tempest-VolumesDeleteCascade-1850397670 None] Acquiring lock "cinder-625ca2f5-4a98-4fd9-9dd4-500c08bf7e13-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:51:56 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b184afa0-ec88-4e75-944f-295e44493bcc tempest-VolumesDeleteCascade-1850397670 None] Lock "cinder-625ca2f5-4a98-4fd9-9dd4-500c08bf7e13-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:51:56 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b184afa0-ec88-4e75-944f-295e44493bcc tempest-VolumesDeleteCascade-1850397670 None] Acquiring lock "cinder-quobyte-8280a704-cfe9-448f-b8c6-23b4d946c95e" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:51:56 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b184afa0-ec88-4e75-944f-295e44493bcc tempest-VolumesDeleteCascade-1850397670 None] Lock "cinder-quobyte-8280a704-cfe9-448f-b8c6-23b4d946c95e" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:51:56 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b184afa0-ec88-4e75-944f-295e44493bcc tempest-VolumesDeleteCascade-1850397670 None] Acquiring lock "cinder-quobyte-625ca2f5-4a98-4fd9-9dd4-500c08bf7e13" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:51:56 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b184afa0-ec88-4e75-944f-295e44493bcc tempest-VolumesDeleteCascade-1850397670 None] Lock "cinder-quobyte-625ca2f5-4a98-4fd9-9dd4-500c08bf7e13" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:51:56 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-b184afa0-ec88-4e75-944f-295e44493bcc tempest-VolumesDeleteCascade-1850397670 None] Deleting offline snapshot 625ca2f5-4a98-4fd9-9dd4-500c08bf7e13 of volume 8280a704-cfe9-448f-b8c6-23b4d946c95e {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 17:51:56 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-b184afa0-ec88-4e75-944f-295e44493bcc tempest-VolumesDeleteCascade-1850397670 None] snapshot_file for this snap is: volume-8280a704-cfe9-448f-b8c6-23b4d946c95e.625ca2f5-4a98-4fd9-9dd4-500c08bf7e13 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 17:51:56 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ab7f98-a28d-41aa-a4f4-34a8da6c73c1]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:51:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b184afa0-ec88-4e75-944f-295e44493bcc tempest-VolumesDeleteCascade-1850397670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8280a704-cfe9-448f-b8c6-23b4d946c95e.625ca2f5-4a98-4fd9-9dd4-500c08bf7e13 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:56 devstack sudo[96540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8280a704-cfe9-448f-b8c6-23b4d946c95e.625ca2f5-4a98-4fd9-9dd4-500c08bf7e13 Nov 06 17:51:56 devstack sudo[96540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:56 devstack sudo[96533]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b8661ad3-246f-4373-933e-45638e553ab8 tempest-VolumesTransfersV355Test-1687217266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-29a7af3c-f9eb-4723-9d9e-12a6b5b0216b 1073741824" returned: 0 in 0.851s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b8661ad3-246f-4373-933e-45638e553ab8 tempest-VolumesTransfersV355Test-1687217266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-29a7af3c-f9eb-4723-9d9e-12a6b5b0216b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:56 devstack sudo[96545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-29a7af3c-f9eb-4723-9d9e-12a6b5b0216b Nov 06 17:51:56 devstack sudo[96545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:56 devstack sudo[96540]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b184afa0-ec88-4e75-944f-295e44493bcc tempest-VolumesDeleteCascade-1850397670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8280a704-cfe9-448f-b8c6-23b4d946c95e.625ca2f5-4a98-4fd9-9dd4-500c08bf7e13" returned: 0 in 0.604s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:56 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-b184afa0-ec88-4e75-944f-295e44493bcc tempest-VolumesDeleteCascade-1850397670 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8280a704-cfe9-448f-b8c6-23b4d946c95e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 17:51:56 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b982472-2f6d-4064-9da7-9203404471b3]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:51:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b184afa0-ec88-4e75-944f-295e44493bcc tempest-VolumesDeleteCascade-1850397670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8280a704-cfe9-448f-b8c6-23b4d946c95e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:57 devstack sudo[96545]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b8661ad3-246f-4373-933e-45638e553ab8 tempest-VolumesTransfersV355Test-1687217266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-29a7af3c-f9eb-4723-9d9e-12a6b5b0216b" returned: 0 in 0.413s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:57 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b8661ad3-246f-4373-933e-45638e553ab8 tempest-VolumesTransfersV355Test-1687217266 None] <== create_volume: return (1345ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:51:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b8661ad3-246f-4373-933e-45638e553ab8 tempest-VolumesTransfersV355Test-1687217266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.349s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:51:57 devstack sudo[96549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8280a704-cfe9-448f-b8c6-23b4d946c95e Nov 06 17:51:57 devstack sudo[96549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:57 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b8661ad3-246f-4373-933e-45638e553ab8 tempest-VolumesTransfersV355Test-1687217266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d24ce5a-d3c2-4e3e-a492-3546eea26722) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29a7af3c-f9eb-4723-9d9e-12a6b5b0216b', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:51:57 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b8661ad3-246f-4373-933e-45638e553ab8 tempest-VolumesTransfersV355Test-1687217266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be956f5b-5b2c-4295-9496-086d7957606e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:51:57 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-b8661ad3-246f-4373-933e-45638e553ab8 tempest-VolumesTransfersV355Test-1687217266 None] Volume volume-29a7af3c-f9eb-4723-9d9e-12a6b5b0216b (29a7af3c-f9eb-4723-9d9e-12a6b5b0216b): created successfully Nov 06 17:51:57 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b8661ad3-246f-4373-933e-45638e553ab8 tempest-VolumesTransfersV355Test-1687217266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be956f5b-5b2c-4295-9496-086d7957606e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:51:57 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b8661ad3-246f-4373-933e-45638e553ab8 tempest-VolumesTransfersV355Test-1687217266 None] Flow 'volume_create_manager' (5d60146f-a190-4640-b798-da3fe6484a71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:51:57 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-b8661ad3-246f-4373-933e-45638e553ab8 tempest-VolumesTransfersV355Test-1687217266 None] Created volume successfully. Nov 06 17:51:57 devstack sudo[96549]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b184afa0-ec88-4e75-944f-295e44493bcc tempest-VolumesDeleteCascade-1850397670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8280a704-cfe9-448f-b8c6-23b4d946c95e" returned: 0 in 0.707s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b184afa0-ec88-4e75-944f-295e44493bcc tempest-VolumesDeleteCascade-1850397670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8280a704-cfe9-448f-b8c6-23b4d946c95e.625ca2f5-4a98-4fd9-9dd4-500c08bf7e13 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:57 devstack sudo[96555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8280a704-cfe9-448f-b8c6-23b4d946c95e.625ca2f5-4a98-4fd9-9dd4-500c08bf7e13 Nov 06 17:51:57 devstack sudo[96555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:58 devstack sudo[96555]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b184afa0-ec88-4e75-944f-295e44493bcc tempest-VolumesDeleteCascade-1850397670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8280a704-cfe9-448f-b8c6-23b4d946c95e.625ca2f5-4a98-4fd9-9dd4-500c08bf7e13" returned: 0 in 0.508s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b184afa0-ec88-4e75-944f-295e44493bcc tempest-VolumesDeleteCascade-1850397670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8280a704-cfe9-448f-b8c6-23b4d946c95e.625ca2f5-4a98-4fd9-9dd4-500c08bf7e13 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:58 devstack sudo[96563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8280a704-cfe9-448f-b8c6-23b4d946c95e.625ca2f5-4a98-4fd9-9dd4-500c08bf7e13 Nov 06 17:51:58 devstack sudo[96563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:58 devstack sudo[96563]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b184afa0-ec88-4e75-944f-295e44493bcc tempest-VolumesDeleteCascade-1850397670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8280a704-cfe9-448f-b8c6-23b4d946c95e.625ca2f5-4a98-4fd9-9dd4-500c08bf7e13" returned: 0 in 0.431s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:58 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b184afa0-ec88-4e75-944f-295e44493bcc tempest-VolumesDeleteCascade-1850397670 None] Lock "cinder-quobyte-625ca2f5-4a98-4fd9-9dd4-500c08bf7e13" released by "_delete_snapshot" :: held 2.423s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:51:58 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b184afa0-ec88-4e75-944f-295e44493bcc tempest-VolumesDeleteCascade-1850397670 None] Lock "cinder-quobyte-8280a704-cfe9-448f-b8c6-23b4d946c95e" released by "delete_snapshot" :: held 2.460s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:51:58 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-b184afa0-ec88-4e75-944f-295e44493bcc tempest-VolumesDeleteCascade-1850397670 None] Created reservations ['659cc856-89d2-4979-8f5b-9a4ba36c36ea', 'a4632079-f004-4907-bec9-cad5a0e80277', 'e3aba58b-1dc4-41c0-91b3-7a30e832b94f', 'd83ca744-4cf5-4482-8484-52c960ce9446'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:51:58 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-b184afa0-ec88-4e75-944f-295e44493bcc tempest-VolumesDeleteCascade-1850397670 None] Delete snapshot completed successfully. Nov 06 17:51:58 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b184afa0-ec88-4e75-944f-295e44493bcc tempest-VolumesDeleteCascade-1850397670 None] Lock "cinder-625ca2f5-4a98-4fd9-9dd4-500c08bf7e13-delete_snapshot" released by "delete_snapshot" :: held 2.763s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:51:58 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b184afa0-ec88-4e75-944f-295e44493bcc tempest-VolumesDeleteCascade-1850397670 None] Snapshots deleted, issuing volume delete {{(pid=87068) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 06 17:51:58 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b184afa0-ec88-4e75-944f-295e44493bcc tempest-VolumesDeleteCascade-1850397670 None] Acquiring lock "cinder-quobyte-8280a704-cfe9-448f-b8c6-23b4d946c95e" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:51:58 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b184afa0-ec88-4e75-944f-295e44493bcc tempest-VolumesDeleteCascade-1850397670 None] Lock "cinder-quobyte-8280a704-cfe9-448f-b8c6-23b4d946c95e" acquired by "delete_volume" :: waited 0.024s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:51:59 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5e5543-2ea8-4325-a697-24a75ed192e1]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:51:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b184afa0-ec88-4e75-944f-295e44493bcc tempest-VolumesDeleteCascade-1850397670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8280a704-cfe9-448f-b8c6-23b4d946c95e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:59 devstack sudo[96566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8280a704-cfe9-448f-b8c6-23b4d946c95e Nov 06 17:51:59 devstack sudo[96566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:59 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-29606589-d961-4880-acc9-eaa9f0c31c8b tempest-VolumesTransfersV355Test-1413809115 None] Transfer volume completed successfully. Nov 06 17:51:59 devstack sudo[96566]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b184afa0-ec88-4e75-944f-295e44493bcc tempest-VolumesDeleteCascade-1850397670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8280a704-cfe9-448f-b8c6-23b4d946c95e" returned: 0 in 0.607s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:51:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b184afa0-ec88-4e75-944f-295e44493bcc tempest-VolumesDeleteCascade-1850397670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8280a704-cfe9-448f-b8c6-23b4d946c95e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:51:59 devstack sudo[96572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8280a704-cfe9-448f-b8c6-23b4d946c95e Nov 06 17:51:59 devstack sudo[96572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:51:59 devstack sudo[96572]: pam_unix(sudo:session): session closed for user root Nov 06 17:51:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b184afa0-ec88-4e75-944f-295e44493bcc tempest-VolumesDeleteCascade-1850397670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8280a704-cfe9-448f-b8c6-23b4d946c95e" returned: 0 in 0.361s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:52:00 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b184afa0-ec88-4e75-944f-295e44493bcc tempest-VolumesDeleteCascade-1850397670 None] Lock "cinder-quobyte-8280a704-cfe9-448f-b8c6-23b4d946c95e" released by "delete_volume" :: held 1.083s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:52:00 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-b184afa0-ec88-4e75-944f-295e44493bcc tempest-VolumesDeleteCascade-1850397670 None] Created reservations ['92142d80-0fdd-4bea-a5a1-ec79ea56a223', 'ec6fdc2f-6f2a-4395-8448-27ed1336e76a', 'c3c864d2-7200-4475-b10b-29c56b28fca2', '87ee0007-0144-4732-babd-230e83614b97'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:52:00 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-0d82d496-70bf-4863-ab99-14fa2b17df64 tempest-VolumesTransfersV355Test-1538193765 None] Acquiring lock "cinder-29a7af3c-f9eb-4723-9d9e-12a6b5b0216b-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:52:00 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-0d82d496-70bf-4863-ab99-14fa2b17df64 tempest-VolumesTransfersV355Test-1538193765 None] Lock "cinder-29a7af3c-f9eb-4723-9d9e-12a6b5b0216b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:52:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b184afa0-ec88-4e75-944f-295e44493bcc tempest-VolumesDeleteCascade-1850397670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:52:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b184afa0-ec88-4e75-944f-295e44493bcc tempest-VolumesDeleteCascade-1850397670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:52:00 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b184afa0-ec88-4e75-944f-295e44493bcc tempest-VolumesDeleteCascade-1850397670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:52:00 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b184afa0-ec88-4e75-944f-295e44493bcc tempest-VolumesDeleteCascade-1850397670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:52:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b184afa0-ec88-4e75-944f-295e44493bcc tempest-VolumesDeleteCascade-1850397670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:52:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b184afa0-ec88-4e75-944f-295e44493bcc tempest-VolumesDeleteCascade-1850397670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:52:00 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-0d82d496-70bf-4863-ab99-14fa2b17df64 tempest-VolumesTransfersV355Test-1538193765 None] Acquiring lock "cinder-quobyte-29a7af3c-f9eb-4723-9d9e-12a6b5b0216b" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:52:00 devstack sudo[96575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:52:00 devstack sudo[96575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:52:00 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-0d82d496-70bf-4863-ab99-14fa2b17df64 tempest-VolumesTransfersV355Test-1538193765 None] Lock "cinder-quobyte-29a7af3c-f9eb-4723-9d9e-12a6b5b0216b" acquired by "delete_volume" :: waited 0.030s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:52:00 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e136e754-a043-482d-950b-5e0e3a628f63]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:52:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0d82d496-70bf-4863-ab99-14fa2b17df64 tempest-VolumesTransfersV355Test-1538193765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-29a7af3c-f9eb-4723-9d9e-12a6b5b0216b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:52:00 devstack sudo[96578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-29a7af3c-f9eb-4723-9d9e-12a6b5b0216b Nov 06 17:52:00 devstack sudo[96578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:52:00 devstack sudo[96575]: pam_unix(sudo:session): session closed for user root Nov 06 17:52:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b184afa0-ec88-4e75-944f-295e44493bcc tempest-VolumesDeleteCascade-1850397670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.336s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:52:00 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-b184afa0-ec88-4e75-944f-295e44493bcc tempest-VolumesDeleteCascade-1850397670 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:52:00 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-b184afa0-ec88-4e75-944f-295e44493bcc tempest-VolumesDeleteCascade-1850397670 None] Deleted volume successfully. Nov 06 17:52:00 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b184afa0-ec88-4e75-944f-295e44493bcc tempest-VolumesDeleteCascade-1850397670 None] Lock "cinder-8280a704-cfe9-448f-b8c6-23b4d946c95e-delete_volume" released by "delete_volume" :: held 4.623s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:52:00 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e85066b7-3c82-4032-865c-bf056a62d7d9 tempest-VolumesDeleteCascade-1850397670 None] Acquiring lock "cinder-51fefaca-c1e0-4b6f-a320-23c5f573d589-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:52:00 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e85066b7-3c82-4032-865c-bf056a62d7d9 tempest-VolumesDeleteCascade-1850397670 None] Lock "cinder-51fefaca-c1e0-4b6f-a320-23c5f573d589-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:52:00 devstack sudo[96578]: pam_unix(sudo:session): session closed for user root Nov 06 17:52:00 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e85066b7-3c82-4032-865c-bf056a62d7d9 tempest-VolumesDeleteCascade-1850397670 None] Acquiring lock "cinder-quobyte-51fefaca-c1e0-4b6f-a320-23c5f573d589" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:52:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0d82d496-70bf-4863-ab99-14fa2b17df64 tempest-VolumesTransfersV355Test-1538193765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-29a7af3c-f9eb-4723-9d9e-12a6b5b0216b" returned: 0 in 0.575s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:52:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0d82d496-70bf-4863-ab99-14fa2b17df64 tempest-VolumesTransfersV355Test-1538193765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-29a7af3c-f9eb-4723-9d9e-12a6b5b0216b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:52:00 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e85066b7-3c82-4032-865c-bf056a62d7d9 tempest-VolumesDeleteCascade-1850397670 None] Lock "cinder-quobyte-51fefaca-c1e0-4b6f-a320-23c5f573d589" acquired by "delete_volume" :: waited 0.030s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:52:00 devstack sudo[96584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-29a7af3c-f9eb-4723-9d9e-12a6b5b0216b Nov 06 17:52:00 devstack sudo[96584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:52:00 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e0c21f-6603-4286-828f-254f610f6313]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:52:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e85066b7-3c82-4032-865c-bf056a62d7d9 tempest-VolumesDeleteCascade-1850397670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-51fefaca-c1e0-4b6f-a320-23c5f573d589 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:52:01 devstack sudo[96586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-51fefaca-c1e0-4b6f-a320-23c5f573d589 Nov 06 17:52:01 devstack sudo[96586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:52:01 devstack sudo[96584]: pam_unix(sudo:session): session closed for user root Nov 06 17:52:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0d82d496-70bf-4863-ab99-14fa2b17df64 tempest-VolumesTransfersV355Test-1538193765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-29a7af3c-f9eb-4723-9d9e-12a6b5b0216b" returned: 0 in 0.304s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:52:01 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-0d82d496-70bf-4863-ab99-14fa2b17df64 tempest-VolumesTransfersV355Test-1538193765 None] Lock "cinder-quobyte-29a7af3c-f9eb-4723-9d9e-12a6b5b0216b" released by "delete_volume" :: held 0.958s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:52:01 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-0d82d496-70bf-4863-ab99-14fa2b17df64 tempest-VolumesTransfersV355Test-1538193765 None] Created reservations ['fa0e4195-bdfc-4389-a8d9-214542cca73f', '3f5f3ce1-5bfa-4af7-b348-2701053b7e87', '3011e061-519e-4630-8148-4adbe05e02ee', 'bed4553d-5ba9-4533-8b76-df64a31fcd02'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:52:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0d82d496-70bf-4863-ab99-14fa2b17df64 tempest-VolumesTransfersV355Test-1538193765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:52:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0d82d496-70bf-4863-ab99-14fa2b17df64 tempest-VolumesTransfersV355Test-1538193765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:52:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0d82d496-70bf-4863-ab99-14fa2b17df64 tempest-VolumesTransfersV355Test-1538193765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:52:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0d82d496-70bf-4863-ab99-14fa2b17df64 tempest-VolumesTransfersV355Test-1538193765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:52:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0d82d496-70bf-4863-ab99-14fa2b17df64 tempest-VolumesTransfersV355Test-1538193765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:52:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0d82d496-70bf-4863-ab99-14fa2b17df64 tempest-VolumesTransfersV355Test-1538193765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:52:01 devstack sudo[96586]: pam_unix(sudo:session): session closed for user root Nov 06 17:52:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e85066b7-3c82-4032-865c-bf056a62d7d9 tempest-VolumesDeleteCascade-1850397670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-51fefaca-c1e0-4b6f-a320-23c5f573d589" returned: 0 in 0.445s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:52:01 devstack sudo[96592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:52:01 devstack sudo[96592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:52:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e85066b7-3c82-4032-865c-bf056a62d7d9 tempest-VolumesDeleteCascade-1850397670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-51fefaca-c1e0-4b6f-a320-23c5f573d589 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:52:01 devstack sudo[96594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-51fefaca-c1e0-4b6f-a320-23c5f573d589 Nov 06 17:52:01 devstack sudo[96594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:52:01 devstack sudo[96592]: pam_unix(sudo:session): session closed for user root Nov 06 17:52:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0d82d496-70bf-4863-ab99-14fa2b17df64 tempest-VolumesTransfersV355Test-1538193765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.359s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:52:01 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-0d82d496-70bf-4863-ab99-14fa2b17df64 tempest-VolumesTransfersV355Test-1538193765 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:52:01 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-0d82d496-70bf-4863-ab99-14fa2b17df64 tempest-VolumesTransfersV355Test-1538193765 None] Deleted volume successfully. Nov 06 17:52:01 devstack sudo[96594]: pam_unix(sudo:session): session closed for user root Nov 06 17:52:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e85066b7-3c82-4032-865c-bf056a62d7d9 tempest-VolumesDeleteCascade-1850397670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-51fefaca-c1e0-4b6f-a320-23c5f573d589" returned: 0 in 0.357s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:52:01 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e85066b7-3c82-4032-865c-bf056a62d7d9 tempest-VolumesDeleteCascade-1850397670 None] Lock "cinder-quobyte-51fefaca-c1e0-4b6f-a320-23c5f573d589" released by "delete_volume" :: held 0.858s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:52:01 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-0d82d496-70bf-4863-ab99-14fa2b17df64 tempest-VolumesTransfersV355Test-1538193765 None] Lock "cinder-29a7af3c-f9eb-4723-9d9e-12a6b5b0216b-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:52:01 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-e85066b7-3c82-4032-865c-bf056a62d7d9 tempest-VolumesDeleteCascade-1850397670 None] Created reservations ['49dbfc3d-c153-4d6f-a754-783e8826024f', '6e557225-fa69-4088-bf57-4b71caedd762', 'e4cf2ff9-b6e9-4bf6-88d9-fa4f9cc6520f', '15f8d652-25fa-45d9-9a0d-bd213af1749e'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:52:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e85066b7-3c82-4032-865c-bf056a62d7d9 tempest-VolumesDeleteCascade-1850397670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:52:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e85066b7-3c82-4032-865c-bf056a62d7d9 tempest-VolumesDeleteCascade-1850397670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:52:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e85066b7-3c82-4032-865c-bf056a62d7d9 tempest-VolumesDeleteCascade-1850397670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:52:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e85066b7-3c82-4032-865c-bf056a62d7d9 tempest-VolumesDeleteCascade-1850397670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:52:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e85066b7-3c82-4032-865c-bf056a62d7d9 tempest-VolumesDeleteCascade-1850397670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:52:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e85066b7-3c82-4032-865c-bf056a62d7d9 tempest-VolumesDeleteCascade-1850397670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:52:01 devstack sudo[96598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:52:01 devstack sudo[96598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:52:02 devstack sudo[96598]: pam_unix(sudo:session): session closed for user root Nov 06 17:52:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e85066b7-3c82-4032-865c-bf056a62d7d9 tempest-VolumesDeleteCascade-1850397670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.392s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:52:02 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-e85066b7-3c82-4032-865c-bf056a62d7d9 tempest-VolumesDeleteCascade-1850397670 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:52:02 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-e85066b7-3c82-4032-865c-bf056a62d7d9 tempest-VolumesDeleteCascade-1850397670 None] Deleted volume successfully. Nov 06 17:52:02 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e85066b7-3c82-4032-865c-bf056a62d7d9 tempest-VolumesDeleteCascade-1850397670 None] Lock "cinder-51fefaca-c1e0-4b6f-a320-23c5f573d589-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:52:03 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-68e30be0-abe5-45a0-a6fc-84da8f332a52 tempest-VolumesTransfersV355Test-1687217266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:52:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-68e30be0-abe5-45a0-a6fc-84da8f332a52 tempest-VolumesTransfersV355Test-1687217266 None] Flow 'volume_create_manager' (ca7e07b3-4ae4-408e-b7b2-269d52cc67cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:52:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-68e30be0-abe5-45a0-a6fc-84da8f332a52 tempest-VolumesTransfersV355Test-1687217266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (625fb5c3-425c-4202-b03c-8fec29c3b713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:52:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-68e30be0-abe5-45a0-a6fc-84da8f332a52 tempest-VolumesTransfersV355Test-1687217266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (625fb5c3-425c-4202-b03c-8fec29c3b713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:52:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1898785898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5821a1e5-9580-493c-bf54-e35498089f7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c89fb88979f94a7bbff89c31540e6d74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:52:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:52:03Z,use_quota=True,user_id='bad3cc147a014e078f8e0d9eac579087',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:52:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-68e30be0-abe5-45a0-a6fc-84da8f332a52 tempest-VolumesTransfersV355Test-1687217266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7af528d-ad30-4e1e-bedc-8c08910c598e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:52:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-68e30be0-abe5-45a0-a6fc-84da8f332a52 tempest-VolumesTransfersV355Test-1687217266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7af528d-ad30-4e1e-bedc-8c08910c598e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:52:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-68e30be0-abe5-45a0-a6fc-84da8f332a52 tempest-VolumesTransfersV355Test-1687217266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa0da808-28e0-40b4-99ad-a6bd0d3a0eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:52:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-68e30be0-abe5-45a0-a6fc-84da8f332a52 tempest-VolumesTransfersV355Test-1687217266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa0da808-28e0-40b4-99ad-a6bd0d3a0eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5821a1e5-9580-493c-bf54-e35498089f7c', 'volume_name': 'volume-5821a1e5-9580-493c-bf54-e35498089f7c', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:52:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-68e30be0-abe5-45a0-a6fc-84da8f332a52 tempest-VolumesTransfersV355Test-1687217266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55dc507b-a9a1-4ca9-971b-ba9e57864b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:52:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-68e30be0-abe5-45a0-a6fc-84da8f332a52 tempest-VolumesTransfersV355Test-1687217266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55dc507b-a9a1-4ca9-971b-ba9e57864b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:52:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-68e30be0-abe5-45a0-a6fc-84da8f332a52 tempest-VolumesTransfersV355Test-1687217266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f296f103-327b-4da5-b5fb-6e15c9742836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:52:03 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-68e30be0-abe5-45a0-a6fc-84da8f332a52 tempest-VolumesTransfersV355Test-1687217266 None] Volume 5821a1e5-9580-493c-bf54-e35498089f7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5821a1e5-9580-493c-bf54-e35498089f7c', 'volume_size': 1} Nov 06 17:52:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-68e30be0-abe5-45a0-a6fc-84da8f332a52 tempest-VolumesTransfersV355Test-1687217266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:52:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-68e30be0-abe5-45a0-a6fc-84da8f332a52 tempest-VolumesTransfersV355Test-1687217266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:52:03 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-68e30be0-abe5-45a0-a6fc-84da8f332a52 tempest-VolumesTransfersV355Test-1687217266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:52:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1898785898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5821a1e5-9580-493c-bf54-e35498089f7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c89fb88979f94a7bbff89c31540e6d74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:52:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:52:03Z,use_quota=True,user_id='bad3cc147a014e078f8e0d9eac579087',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:52:03 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-68e30be0-abe5-45a0-a6fc-84da8f332a52 tempest-VolumesTransfersV355Test-1687217266 None] Creating volume 5821a1e5-9580-493c-bf54-e35498089f7c {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:52:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-68e30be0-abe5-45a0-a6fc-84da8f332a52 tempest-VolumesTransfersV355Test-1687217266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:52:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-68e30be0-abe5-45a0-a6fc-84da8f332a52 tempest-VolumesTransfersV355Test-1687217266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:52:03 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-68e30be0-abe5-45a0-a6fc-84da8f332a52 tempest-VolumesTransfersV355Test-1687217266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:52:03 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-68e30be0-abe5-45a0-a6fc-84da8f332a52 tempest-VolumesTransfersV355Test-1687217266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:52:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-68e30be0-abe5-45a0-a6fc-84da8f332a52 tempest-VolumesTransfersV355Test-1687217266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:52:03 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-68e30be0-abe5-45a0-a6fc-84da8f332a52 tempest-VolumesTransfersV355Test-1687217266 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:52:03 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-68e30be0-abe5-45a0-a6fc-84da8f332a52 tempest-VolumesTransfersV355Test-1687217266 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:52:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-68e30be0-abe5-45a0-a6fc-84da8f332a52 tempest-VolumesTransfersV355Test-1687217266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5821a1e5-9580-493c-bf54-e35498089f7c 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:52:03 devstack sudo[96601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5821a1e5-9580-493c-bf54-e35498089f7c 1073741824 Nov 06 17:52:03 devstack sudo[96601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:52:03 devstack sudo[96601]: pam_unix(sudo:session): session closed for user root Nov 06 17:52:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-68e30be0-abe5-45a0-a6fc-84da8f332a52 tempest-VolumesTransfersV355Test-1687217266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5821a1e5-9580-493c-bf54-e35498089f7c 1073741824" returned: 0 in 0.498s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:52:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-68e30be0-abe5-45a0-a6fc-84da8f332a52 tempest-VolumesTransfersV355Test-1687217266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5821a1e5-9580-493c-bf54-e35498089f7c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:52:03 devstack sudo[96608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5821a1e5-9580-493c-bf54-e35498089f7c Nov 06 17:52:03 devstack sudo[96608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:52:04 devstack sudo[96608]: pam_unix(sudo:session): session closed for user root Nov 06 17:52:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-68e30be0-abe5-45a0-a6fc-84da8f332a52 tempest-VolumesTransfersV355Test-1687217266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5821a1e5-9580-493c-bf54-e35498089f7c" returned: 0 in 0.386s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:52:04 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-68e30be0-abe5-45a0-a6fc-84da8f332a52 tempest-VolumesTransfersV355Test-1687217266 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:52:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-68e30be0-abe5-45a0-a6fc-84da8f332a52 tempest-VolumesTransfersV355Test-1687217266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:52:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-68e30be0-abe5-45a0-a6fc-84da8f332a52 tempest-VolumesTransfersV355Test-1687217266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f296f103-327b-4da5-b5fb-6e15c9742836) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5821a1e5-9580-493c-bf54-e35498089f7c', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:52:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-68e30be0-abe5-45a0-a6fc-84da8f332a52 tempest-VolumesTransfersV355Test-1687217266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0fc7325-ab4c-467e-810c-0096822f2848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:52:04 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-68e30be0-abe5-45a0-a6fc-84da8f332a52 tempest-VolumesTransfersV355Test-1687217266 None] Volume volume-5821a1e5-9580-493c-bf54-e35498089f7c (5821a1e5-9580-493c-bf54-e35498089f7c): created successfully Nov 06 17:52:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-68e30be0-abe5-45a0-a6fc-84da8f332a52 tempest-VolumesTransfersV355Test-1687217266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0fc7325-ab4c-467e-810c-0096822f2848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:52:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-68e30be0-abe5-45a0-a6fc-84da8f332a52 tempest-VolumesTransfersV355Test-1687217266 None] Flow 'volume_create_manager' (ca7e07b3-4ae4-408e-b7b2-269d52cc67cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:52:04 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-68e30be0-abe5-45a0-a6fc-84da8f332a52 tempest-VolumesTransfersV355Test-1687217266 None] Created volume successfully. Nov 06 17:52:05 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5292a53d-8c71-483b-9428-0cec77ba3aff tempest-VolumesTransfersV355Test-1538193765 None] Acquiring lock "cinder-5821a1e5-9580-493c-bf54-e35498089f7c-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:52:05 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5292a53d-8c71-483b-9428-0cec77ba3aff tempest-VolumesTransfersV355Test-1538193765 None] Lock "cinder-5821a1e5-9580-493c-bf54-e35498089f7c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:52:05 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5292a53d-8c71-483b-9428-0cec77ba3aff tempest-VolumesTransfersV355Test-1538193765 None] Acquiring lock "cinder-quobyte-5821a1e5-9580-493c-bf54-e35498089f7c" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:52:05 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5292a53d-8c71-483b-9428-0cec77ba3aff tempest-VolumesTransfersV355Test-1538193765 None] Lock "cinder-quobyte-5821a1e5-9580-493c-bf54-e35498089f7c" acquired by "delete_volume" :: waited 0.021s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:52:06 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[62856498-3198-4abb-94ca-bafc15234a48]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:52:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5292a53d-8c71-483b-9428-0cec77ba3aff tempest-VolumesTransfersV355Test-1538193765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5821a1e5-9580-493c-bf54-e35498089f7c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:52:06 devstack sudo[96611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5821a1e5-9580-493c-bf54-e35498089f7c Nov 06 17:52:06 devstack sudo[96611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:52:06 devstack sudo[96611]: pam_unix(sudo:session): session closed for user root Nov 06 17:52:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5292a53d-8c71-483b-9428-0cec77ba3aff tempest-VolumesTransfersV355Test-1538193765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5821a1e5-9580-493c-bf54-e35498089f7c" returned: 0 in 0.434s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:52:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5292a53d-8c71-483b-9428-0cec77ba3aff tempest-VolumesTransfersV355Test-1538193765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5821a1e5-9580-493c-bf54-e35498089f7c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:52:06 devstack sudo[96617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5821a1e5-9580-493c-bf54-e35498089f7c Nov 06 17:52:06 devstack sudo[96617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:52:06 devstack sudo[96617]: pam_unix(sudo:session): session closed for user root Nov 06 17:52:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5292a53d-8c71-483b-9428-0cec77ba3aff tempest-VolumesTransfersV355Test-1538193765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5821a1e5-9580-493c-bf54-e35498089f7c" returned: 0 in 0.305s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:52:06 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5292a53d-8c71-483b-9428-0cec77ba3aff tempest-VolumesTransfersV355Test-1538193765 None] Lock "cinder-quobyte-5821a1e5-9580-493c-bf54-e35498089f7c" released by "delete_volume" :: held 0.805s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:52:06 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-5292a53d-8c71-483b-9428-0cec77ba3aff tempest-VolumesTransfersV355Test-1538193765 None] Created reservations ['41a84daa-650d-40c1-8b83-4f2d296cbf07', '4d5035e2-24ae-4e06-b0db-381a1f251ae7', '7dd51e32-62d8-4273-8257-192f0734aa1e', 'd70b03f8-7da4-4d64-bd3c-f339b96c39f8'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:52:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5292a53d-8c71-483b-9428-0cec77ba3aff tempest-VolumesTransfersV355Test-1538193765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:52:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5292a53d-8c71-483b-9428-0cec77ba3aff tempest-VolumesTransfersV355Test-1538193765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:52:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5292a53d-8c71-483b-9428-0cec77ba3aff tempest-VolumesTransfersV355Test-1538193765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:52:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5292a53d-8c71-483b-9428-0cec77ba3aff tempest-VolumesTransfersV355Test-1538193765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:52:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5292a53d-8c71-483b-9428-0cec77ba3aff tempest-VolumesTransfersV355Test-1538193765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:52:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5292a53d-8c71-483b-9428-0cec77ba3aff tempest-VolumesTransfersV355Test-1538193765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:52:06 devstack sudo[96620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:52:06 devstack sudo[96620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:52:07 devstack sudo[96620]: pam_unix(sudo:session): session closed for user root Nov 06 17:52:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5292a53d-8c71-483b-9428-0cec77ba3aff tempest-VolumesTransfersV355Test-1538193765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.380s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:52:07 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-5292a53d-8c71-483b-9428-0cec77ba3aff tempest-VolumesTransfersV355Test-1538193765 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:52:07 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-5292a53d-8c71-483b-9428-0cec77ba3aff tempest-VolumesTransfersV355Test-1538193765 None] Deleted volume successfully. Nov 06 17:52:07 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5292a53d-8c71-483b-9428-0cec77ba3aff tempest-VolumesTransfersV355Test-1538193765 None] Lock "cinder-5821a1e5-9580-493c-bf54-e35498089f7c-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:52:16 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:UPDATE=108,cinder:DELETE=13,cinder:SELECT=87,cinder:INSERT=29 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 17:52:17 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=91,cinder:UPDATE=114,cinder:INSERT=24,cinder:DELETE=6 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 17:52:20 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:52:20 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] Flow 'volume_create_manager' (069ab25e-536d-4934-948c-dd96f231cd68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:52:20 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e533b72-1cd9-477f-b632-0874789846e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:52:20 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e533b72-1cd9-477f-b632-0874789846e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-322943872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=390379d9-d0f3-4b42-a1de-39cf32b84618,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d3919f3a3b34037a4dc9aaeda626f7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:52:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:52:21Z,use_quota=True,user_id='201da2ce52ff407b979f6f0c1277ea88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:52:20 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34f50797-38fe-4584-a064-8e78630cc679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:52:20 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34f50797-38fe-4584-a064-8e78630cc679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:52:20 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (270351a8-b8ee-4607-8e2d-bd7fcda8b14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:52:20 devstack cinder-volume[87068]: DEBUG cinder.image.glance [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] Creating Keystone auth plugin from conf {{(pid=87068) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 17:52:21 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (270351a8-b8ee-4607-8e2d-bd7fcda8b14f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '390379d9-d0f3-4b42-a1de-39cf32b84618', 'volume_name': 'volume-390379d9-d0f3-4b42-a1de-39cf32b84618', 'volume_size': 1, 'image_id': '514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '344c8ba807084eedb5afd931913d7a80', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'created_at': datetime.datetime(2026, 11, 6, 16, 39, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 16, 39, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/514846ea-e0c6-4037-8ba4-bcd35ce3fba9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:52:21 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (824d06a2-f823-4517-83af-0be9908eb1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:52:21 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (824d06a2-f823-4517-83af-0be9908eb1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:52:21 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8901a6a-ac74-475d-adfe-f8cbe290f11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:52:21 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] Volume 390379d9-d0f3-4b42-a1de-39cf32b84618: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-390379d9-d0f3-4b42-a1de-39cf32b84618', 'volume_size': 1, 'image_id': '514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '344c8ba807084eedb5afd931913d7a80', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'created_at': datetime.datetime(2026, 11, 6, 16, 39, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 16, 39, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/514846ea-e0c6-4037-8ba4-bcd35ce3fba9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 17:52:21 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] Trying to clone 390379d9-d0f3-4b42-a1de-39cf32b84618 from image 514846ea-e0c6-4037-8ba4-bcd35ce3fba9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'metadata': {}}]). {{(pid=87068) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 17:52:21 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_2qbbbunvdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87068) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 06 17:52:21 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] Image download 20.69 MB at 20.69 MB/s Nov 06 17:52:21 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c93c5e-b4f1-4425-8a73-7c9da0ae4ff6]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:52:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_2qbbbunvdevstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:52:21 devstack sudo[96664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_2qbbbunvdevstack@QuobyteHD Nov 06 17:52:21 devstack sudo[96664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:52:22 devstack sudo[96664]: pam_unix(sudo:session): session closed for user root Nov 06 17:52:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_2qbbbunvdevstack@QuobyteHD" returned: 0 in 0.467s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:52:22 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] Temporary image 514846ea-e0c6-4037-8ba4-bcd35ce3fba9 is fetched for user 201da2ce52ff407b979f6f0c1277ea88. {{(pid=87068) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 06 17:52:22 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4743173-fb44-4c46-bd3e-328940db17c7]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:52:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_2qbbbunvdevstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:52:22 devstack sudo[96669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_2qbbbunvdevstack@QuobyteHD Nov 06 17:52:22 devstack sudo[96669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:52:22 devstack sudo[96669]: pam_unix(sudo:session): session closed for user root Nov 06 17:52:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_2qbbbunvdevstack@QuobyteHD" returned: 0 in 0.443s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:52:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:52:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:52:22 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-322943872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=390379d9-d0f3-4b42-a1de-39cf32b84618,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d3919f3a3b34037a4dc9aaeda626f7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:52:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:52:21Z,use_quota=True,user_id='201da2ce52ff407b979f6f0c1277ea88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:52:22 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] Creating volume 390379d9-d0f3-4b42-a1de-39cf32b84618 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:52:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:52:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:52:22 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:52:22 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:52:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:52:22 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:52:22 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:52:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-390379d9-d0f3-4b42-a1de-39cf32b84618 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:52:22 devstack sudo[96674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-390379d9-d0f3-4b42-a1de-39cf32b84618 1073741824 Nov 06 17:52:22 devstack sudo[96674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:52:23 devstack sudo[96674]: pam_unix(sudo:session): session closed for user root Nov 06 17:52:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-390379d9-d0f3-4b42-a1de-39cf32b84618 1073741824" returned: 0 in 0.597s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:52:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-390379d9-d0f3-4b42-a1de-39cf32b84618 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:52:23 devstack sudo[96680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-390379d9-d0f3-4b42-a1de-39cf32b84618 Nov 06 17:52:23 devstack sudo[96680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:52:23 devstack sudo[96680]: pam_unix(sudo:session): session closed for user root Nov 06 17:52:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-390379d9-d0f3-4b42-a1de-39cf32b84618" returned: 0 in 0.286s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:52:23 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:52:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:52:23 devstack cinder-volume[87068]: DEBUG cinder.volume.volume_utils [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] Attempting download of 514846ea-e0c6-4037-8ba4-bcd35ce3fba9 ((None, [{'url': 'file:///opt/stack/data/glance/images/514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'metadata': {}}])) to volume 390379d9-d0f3-4b42-a1de-39cf32b84618. {{(pid=87068) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 17:52:23 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31e8d52-77ad-49ef-aa89-f5d422958bd1]: (4, 'raw') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:52:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_jttf2z33 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:52:23 devstack sudo[96684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_jttf2z33 Nov 06 17:52:23 devstack sudo[96684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:52:24 devstack sudo[96684]: pam_unix(sudo:session): session closed for user root Nov 06 17:52:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_jttf2z33" returned: 0 in 0.409s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:52:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_jttf2z33 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:52:24 devstack sudo[96688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_jttf2z33 Nov 06 17:52:24 devstack sudo[96688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:52:24 devstack sudo[96688]: pam_unix(sudo:session): session closed for user root Nov 06 17:52:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_jttf2z33" returned: 1 in 0.366s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:52:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_jttf2z33' failed. Not Retrying. {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 17:52:24 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1279b6b-5d43-4826-91d4-c70b16b62fc8]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:52:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_2qbbbunvdevstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:52:24 devstack sudo[96692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_2qbbbunvdevstack@QuobyteHD Nov 06 17:52:24 devstack sudo[96692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:52:24 devstack sudo[96692]: pam_unix(sudo:session): session closed for user root Nov 06 17:52:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_2qbbbunvdevstack@QuobyteHD" returned: 0 in 0.359s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:52:24 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] 514846ea-e0c6-4037-8ba4-bcd35ce3fba9 was qcow2, converting to qcow2 {{(pid=87068) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 06 17:52:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_2qbbbunvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-390379d9-d0f3-4b42-a1de-39cf32b84618 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:52:24 devstack sudo[96698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_2qbbbunvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-390379d9-d0f3-4b42-a1de-39cf32b84618 Nov 06 17:52:24 devstack sudo[96698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:52:28 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5acaec4-24e4-4172-bed5-d3a6be200834 tempest-VolumesActionsTest-404676404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:52:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b5acaec4-24e4-4172-bed5-d3a6be200834 tempest-VolumesActionsTest-404676404 None] Flow 'volume_create_manager' (9d17fb21-dde9-40f4-90d9-a254a5e662bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:52:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b5acaec4-24e4-4172-bed5-d3a6be200834 tempest-VolumesActionsTest-404676404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1781ead-5ca9-4a55-8fb2-938ae26752cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:52:28 devstack sudo[96698]: pam_unix(sudo:session): session closed for user root Nov 06 17:52:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b5acaec4-24e4-4172-bed5-d3a6be200834 tempest-VolumesActionsTest-404676404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1781ead-5ca9-4a55-8fb2-938ae26752cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:52:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1773207644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5f35b33-fa78-4485-8e77-db85147e5172,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57d89921fd224bb5abaa227827aa46de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:52:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:52:28Z,use_quota=True,user_id='d3901312a0614abf9b2cfc410934065c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:52:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b5acaec4-24e4-4172-bed5-d3a6be200834 tempest-VolumesActionsTest-404676404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31934176-ea8a-41fa-9cd8-21f029ae54ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:52:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b5acaec4-24e4-4172-bed5-d3a6be200834 tempest-VolumesActionsTest-404676404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31934176-ea8a-41fa-9cd8-21f029ae54ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:52:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b5acaec4-24e4-4172-bed5-d3a6be200834 tempest-VolumesActionsTest-404676404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1198d58e-c7a0-4061-be7b-b4052560e5d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:52:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b5acaec4-24e4-4172-bed5-d3a6be200834 tempest-VolumesActionsTest-404676404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1198d58e-c7a0-4061-be7b-b4052560e5d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5f35b33-fa78-4485-8e77-db85147e5172', 'volume_name': 'volume-d5f35b33-fa78-4485-8e77-db85147e5172', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:52:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b5acaec4-24e4-4172-bed5-d3a6be200834 tempest-VolumesActionsTest-404676404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ec2498b-5a56-47aa-9dc8-0c126b924e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:52:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b5acaec4-24e4-4172-bed5-d3a6be200834 tempest-VolumesActionsTest-404676404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ec2498b-5a56-47aa-9dc8-0c126b924e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:52:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b5acaec4-24e4-4172-bed5-d3a6be200834 tempest-VolumesActionsTest-404676404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f037920-af3a-4eeb-bdfc-855b72aa57b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:52:28 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-b5acaec4-24e4-4172-bed5-d3a6be200834 tempest-VolumesActionsTest-404676404 None] Volume d5f35b33-fa78-4485-8e77-db85147e5172: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5f35b33-fa78-4485-8e77-db85147e5172', 'volume_size': 1} Nov 06 17:52:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b5acaec4-24e4-4172-bed5-d3a6be200834 tempest-VolumesActionsTest-404676404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:52:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b5acaec4-24e4-4172-bed5-d3a6be200834 tempest-VolumesActionsTest-404676404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:52:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b5acaec4-24e4-4172-bed5-d3a6be200834 tempest-VolumesActionsTest-404676404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:52:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1773207644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5f35b33-fa78-4485-8e77-db85147e5172,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57d89921fd224bb5abaa227827aa46de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:52:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:52:28Z,use_quota=True,user_id='d3901312a0614abf9b2cfc410934065c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:52:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-b5acaec4-24e4-4172-bed5-d3a6be200834 tempest-VolumesActionsTest-404676404 None] Creating volume d5f35b33-fa78-4485-8e77-db85147e5172 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:52:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b5acaec4-24e4-4172-bed5-d3a6be200834 tempest-VolumesActionsTest-404676404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:52:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b5acaec4-24e4-4172-bed5-d3a6be200834 tempest-VolumesActionsTest-404676404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:52:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b5acaec4-24e4-4172-bed5-d3a6be200834 tempest-VolumesActionsTest-404676404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:52:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b5acaec4-24e4-4172-bed5-d3a6be200834 tempest-VolumesActionsTest-404676404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:52:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b5acaec4-24e4-4172-bed5-d3a6be200834 tempest-VolumesActionsTest-404676404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:52:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b5acaec4-24e4-4172-bed5-d3a6be200834 tempest-VolumesActionsTest-404676404 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:52:28 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-b5acaec4-24e4-4172-bed5-d3a6be200834 tempest-VolumesActionsTest-404676404 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:52:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b5acaec4-24e4-4172-bed5-d3a6be200834 tempest-VolumesActionsTest-404676404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d5f35b33-fa78-4485-8e77-db85147e5172 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:52:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_2qbbbunvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-390379d9-d0f3-4b42-a1de-39cf32b84618" returned: 0 in 3.830s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:52:28 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_2qbbbunvdevstack@QuobyteHD, size 112.00 MB, duration 3.84 sec, destination /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-390379d9-d0f3-4b42-a1de-39cf32b84618 {{(pid=87068) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 17:52:28 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] Converted 112.00 MB image at 29.15 MB/s Nov 06 17:52:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-390379d9-d0f3-4b42-a1de-39cf32b84618 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:52:28 devstack sudo[96776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d5f35b33-fa78-4485-8e77-db85147e5172 1073741824 Nov 06 17:52:28 devstack sudo[96776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:52:28 devstack sudo[96778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-390379d9-d0f3-4b42-a1de-39cf32b84618 1G Nov 06 17:52:28 devstack sudo[96778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:52:29 devstack sudo[96778]: pam_unix(sudo:session): session closed for user root Nov 06 17:52:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-390379d9-d0f3-4b42-a1de-39cf32b84618 1G" returned: 0 in 0.794s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:52:29 devstack cinder-volume[87068]: DEBUG cinder.volume.volume_utils [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] Downloaded image 514846ea-e0c6-4037-8ba4-bcd35ce3fba9 ((None, [{'url': 'file:///opt/stack/data/glance/images/514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'metadata': {}}])) to volume 390379d9-d0f3-4b42-a1de-39cf32b84618 successfully. {{(pid=87068) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 17:52:29 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] Temporary image 514846ea-e0c6-4037-8ba4-bcd35ce3fba9 for user 201da2ce52ff407b979f6f0c1277ea88 is deleted. {{(pid=87068) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 06 17:52:29 devstack cinder-volume[87068]: DEBUG cinder.volume.volume_utils [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] Marking volume 390379d9-d0f3-4b42-a1de-39cf32b84618 as bootable. {{(pid=87068) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 17:52:29 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] Copying metadata from image 514846ea-e0c6-4037-8ba4-bcd35ce3fba9 to 390379d9-d0f3-4b42-a1de-39cf32b84618. {{(pid=87068) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 17:52:29 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] Creating volume glance metadata for volume 390379d9-d0f3-4b42-a1de-39cf32b84618 backed by image 514846ea-e0c6-4037-8ba4-bcd35ce3fba9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87068) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 17:52:30 devstack sudo[96776]: pam_unix(sudo:session): session closed for user root Nov 06 17:52:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b5acaec4-24e4-4172-bed5-d3a6be200834 tempest-VolumesActionsTest-404676404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d5f35b33-fa78-4485-8e77-db85147e5172 1073741824" returned: 0 in 1.376s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:52:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8901a6a-ac74-475d-adfe-f8cbe290f11d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-390379d9-d0f3-4b42-a1de-39cf32b84618', 'volume_size': 1, 'image_id': '514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '344c8ba807084eedb5afd931913d7a80', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'created_at': datetime.datetime(2026, 11, 6, 16, 39, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 16, 39, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/514846ea-e0c6-4037-8ba4-bcd35ce3fba9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:52:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (371fb4bf-675e-442b-80ed-911e9cfaaca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:52:30 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] Volume volume-390379d9-d0f3-4b42-a1de-39cf32b84618 (390379d9-d0f3-4b42-a1de-39cf32b84618): created successfully Nov 06 17:52:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (371fb4bf-675e-442b-80ed-911e9cfaaca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:52:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] Flow 'volume_create_manager' (069ab25e-536d-4934-948c-dd96f231cd68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:52:30 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-ffb047cb-083d-46ed-aa60-e7bf2e2f9975 tempest-VolumesExtendTest-1981556661 None] Created volume successfully. Nov 06 17:52:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b5acaec4-24e4-4172-bed5-d3a6be200834 tempest-VolumesActionsTest-404676404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d5f35b33-fa78-4485-8e77-db85147e5172 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:52:30 devstack sudo[96820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d5f35b33-fa78-4485-8e77-db85147e5172 Nov 06 17:52:30 devstack sudo[96820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:52:30 devstack sudo[96820]: pam_unix(sudo:session): session closed for user root Nov 06 17:52:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b5acaec4-24e4-4172-bed5-d3a6be200834 tempest-VolumesActionsTest-404676404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d5f35b33-fa78-4485-8e77-db85147e5172" returned: 0 in 0.598s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:52:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b5acaec4-24e4-4172-bed5-d3a6be200834 tempest-VolumesActionsTest-404676404 None] <== create_volume: return (2122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:52:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b5acaec4-24e4-4172-bed5-d3a6be200834 tempest-VolumesActionsTest-404676404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.130s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:52:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b5acaec4-24e4-4172-bed5-d3a6be200834 tempest-VolumesActionsTest-404676404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f037920-af3a-4eeb-bdfc-855b72aa57b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5f35b33-fa78-4485-8e77-db85147e5172', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:52:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b5acaec4-24e4-4172-bed5-d3a6be200834 tempest-VolumesActionsTest-404676404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8865eb47-f007-4503-8e0a-c43f750dfdca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:52:30 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-b5acaec4-24e4-4172-bed5-d3a6be200834 tempest-VolumesActionsTest-404676404 None] Volume volume-d5f35b33-fa78-4485-8e77-db85147e5172 (d5f35b33-fa78-4485-8e77-db85147e5172): created successfully Nov 06 17:52:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b5acaec4-24e4-4172-bed5-d3a6be200834 tempest-VolumesActionsTest-404676404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8865eb47-f007-4503-8e0a-c43f750dfdca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:52:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b5acaec4-24e4-4172-bed5-d3a6be200834 tempest-VolumesActionsTest-404676404 None] Flow 'volume_create_manager' (9d17fb21-dde9-40f4-90d9-a254a5e662bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:52:31 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-b5acaec4-24e4-4172-bed5-d3a6be200834 tempest-VolumesActionsTest-404676404 None] Created volume successfully. Nov 06 17:52:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-33847fb2-d78b-4924-8da4-9b999a19ad25 tempest-VolumesExtendTest-1981556661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:52:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-33847fb2-d78b-4924-8da4-9b999a19ad25 tempest-VolumesExtendTest-1981556661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.004s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:52:31 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[741ba4f4-f1b0-4562-ba7d-13c4298de106]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:52:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-33847fb2-d78b-4924-8da4-9b999a19ad25 tempest-VolumesExtendTest-1981556661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-390379d9-d0f3-4b42-a1de-39cf32b84618 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:52:31 devstack sudo[96851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-390379d9-d0f3-4b42-a1de-39cf32b84618 Nov 06 17:52:31 devstack sudo[96851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:52:32 devstack sudo[96851]: pam_unix(sudo:session): session closed for user root Nov 06 17:52:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-33847fb2-d78b-4924-8da4-9b999a19ad25 tempest-VolumesExtendTest-1981556661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-390379d9-d0f3-4b42-a1de-39cf32b84618" returned: 0 in 0.599s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:52:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-33847fb2-d78b-4924-8da4-9b999a19ad25 tempest-VolumesExtendTest-1981556661 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-390379d9-d0f3-4b42-a1de-39cf32b84618 2G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:52:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-33847fb2-d78b-4924-8da4-9b999a19ad25 tempest-VolumesExtendTest-1981556661 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-390379d9-d0f3-4b42-a1de-39cf32b84618 2G" returned: 0 in 0.283s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:52:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-33847fb2-d78b-4924-8da4-9b999a19ad25 tempest-VolumesExtendTest-1981556661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.943s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:52:32 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-efa88458-c733-4496-9399-28588e1af9ce tempest-VolumesActionsTest-1603869063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:52:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-efa88458-c733-4496-9399-28588e1af9ce tempest-VolumesActionsTest-1603869063 None] Flow 'volume_create_manager' (840ce1aa-4aaa-4de3-a1cc-2427543eea34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:52:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-efa88458-c733-4496-9399-28588e1af9ce tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b0d723d-51cf-4fdd-90d8-f0c5dba4746b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:52:32 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-33847fb2-d78b-4924-8da4-9b999a19ad25 tempest-VolumesExtendTest-1981556661 None] Extend volume completed successfully. Nov 06 17:52:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-efa88458-c733-4496-9399-28588e1af9ce tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b0d723d-51cf-4fdd-90d8-f0c5dba4746b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:52:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-614065487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f19fc366-a554-4be2-b416-e08d3ad855b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61a32a6744ec449280a9b0af8e2adc4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:52:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:52:32Z,use_quota=True,user_id='6a1654f7f8c04863834119a414f584e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:52:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-efa88458-c733-4496-9399-28588e1af9ce tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eca94b50-3025-440a-9191-455ad4b4c4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:52:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-efa88458-c733-4496-9399-28588e1af9ce tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eca94b50-3025-440a-9191-455ad4b4c4ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:52:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-efa88458-c733-4496-9399-28588e1af9ce tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99d9a673-0f99-4deb-86aa-ba569c989590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:52:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-efa88458-c733-4496-9399-28588e1af9ce tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99d9a673-0f99-4deb-86aa-ba569c989590) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f19fc366-a554-4be2-b416-e08d3ad855b3', 'volume_name': 'volume-f19fc366-a554-4be2-b416-e08d3ad855b3', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:52:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-efa88458-c733-4496-9399-28588e1af9ce tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caf900d7-14d0-4098-bf5f-edff7387ebb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:52:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-efa88458-c733-4496-9399-28588e1af9ce tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caf900d7-14d0-4098-bf5f-edff7387ebb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:52:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-efa88458-c733-4496-9399-28588e1af9ce tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d15b08be-26f3-4dff-99ca-689ea8d26834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:52:32 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-efa88458-c733-4496-9399-28588e1af9ce tempest-VolumesActionsTest-1603869063 None] Volume f19fc366-a554-4be2-b416-e08d3ad855b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f19fc366-a554-4be2-b416-e08d3ad855b3', 'volume_size': 1} Nov 06 17:52:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-efa88458-c733-4496-9399-28588e1af9ce tempest-VolumesActionsTest-1603869063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:52:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-efa88458-c733-4496-9399-28588e1af9ce tempest-VolumesActionsTest-1603869063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:52:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-efa88458-c733-4496-9399-28588e1af9ce tempest-VolumesActionsTest-1603869063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:52:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-614065487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f19fc366-a554-4be2-b416-e08d3ad855b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61a32a6744ec449280a9b0af8e2adc4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:52:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:52:32Z,use_quota=True,user_id='6a1654f7f8c04863834119a414f584e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:52:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-efa88458-c733-4496-9399-28588e1af9ce tempest-VolumesActionsTest-1603869063 None] Creating volume f19fc366-a554-4be2-b416-e08d3ad855b3 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:52:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-efa88458-c733-4496-9399-28588e1af9ce tempest-VolumesActionsTest-1603869063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:52:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-efa88458-c733-4496-9399-28588e1af9ce tempest-VolumesActionsTest-1603869063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:52:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-efa88458-c733-4496-9399-28588e1af9ce tempest-VolumesActionsTest-1603869063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:52:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-efa88458-c733-4496-9399-28588e1af9ce tempest-VolumesActionsTest-1603869063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:52:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-efa88458-c733-4496-9399-28588e1af9ce tempest-VolumesActionsTest-1603869063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:52:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-efa88458-c733-4496-9399-28588e1af9ce tempest-VolumesActionsTest-1603869063 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:52:32 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-efa88458-c733-4496-9399-28588e1af9ce tempest-VolumesActionsTest-1603869063 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:52:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-efa88458-c733-4496-9399-28588e1af9ce tempest-VolumesActionsTest-1603869063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f19fc366-a554-4be2-b416-e08d3ad855b3 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:52:32 devstack sudo[96865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f19fc366-a554-4be2-b416-e08d3ad855b3 1073741824 Nov 06 17:52:32 devstack sudo[96865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:52:33 devstack sudo[96865]: pam_unix(sudo:session): session closed for user root Nov 06 17:52:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-efa88458-c733-4496-9399-28588e1af9ce tempest-VolumesActionsTest-1603869063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f19fc366-a554-4be2-b416-e08d3ad855b3 1073741824" returned: 0 in 0.842s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:52:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-efa88458-c733-4496-9399-28588e1af9ce tempest-VolumesActionsTest-1603869063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f19fc366-a554-4be2-b416-e08d3ad855b3 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:52:33 devstack sudo[96875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f19fc366-a554-4be2-b416-e08d3ad855b3 Nov 06 17:52:33 devstack sudo[96875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:52:34 devstack sudo[96875]: pam_unix(sudo:session): session closed for user root Nov 06 17:52:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-efa88458-c733-4496-9399-28588e1af9ce tempest-VolumesActionsTest-1603869063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f19fc366-a554-4be2-b416-e08d3ad855b3" returned: 0 in 0.628s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:52:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-efa88458-c733-4496-9399-28588e1af9ce tempest-VolumesActionsTest-1603869063 None] <== create_volume: return (1634ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:52:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-efa88458-c733-4496-9399-28588e1af9ce tempest-VolumesActionsTest-1603869063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.637s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:52:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-efa88458-c733-4496-9399-28588e1af9ce tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d15b08be-26f3-4dff-99ca-689ea8d26834) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f19fc366-a554-4be2-b416-e08d3ad855b3', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:52:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-efa88458-c733-4496-9399-28588e1af9ce tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44aa5004-65c2-4042-b3f5-83c3b5a8399b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:52:34 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-efa88458-c733-4496-9399-28588e1af9ce tempest-VolumesActionsTest-1603869063 None] Volume volume-f19fc366-a554-4be2-b416-e08d3ad855b3 (f19fc366-a554-4be2-b416-e08d3ad855b3): created successfully Nov 06 17:52:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-efa88458-c733-4496-9399-28588e1af9ce tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44aa5004-65c2-4042-b3f5-83c3b5a8399b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:52:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-efa88458-c733-4496-9399-28588e1af9ce tempest-VolumesActionsTest-1603869063 None] Flow 'volume_create_manager' (840ce1aa-4aaa-4de3-a1cc-2427543eea34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:52:34 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-efa88458-c733-4496-9399-28588e1af9ce tempest-VolumesActionsTest-1603869063 None] Created volume successfully. Nov 06 17:52:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1af3b841-3476-4e74-a6cb-c706b036cf28 tempest-VolumesExtendTest-1981556661 None] Acquiring lock "cinder-390379d9-d0f3-4b42-a1de-39cf32b84618-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:52:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1af3b841-3476-4e74-a6cb-c706b036cf28 tempest-VolumesExtendTest-1981556661 None] Lock "cinder-390379d9-d0f3-4b42-a1de-39cf32b84618-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:52:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d99f1cdf-a396-4c1e-8bd6-806161283bb5 tempest-VolumesActionsTest-1603869063 None] Acquiring lock "cinder-f19fc366-a554-4be2-b416-e08d3ad855b3" by "attach_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:52:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d99f1cdf-a396-4c1e-8bd6-806161283bb5 tempest-VolumesActionsTest-1603869063 None] Lock "cinder-f19fc366-a554-4be2-b416-e08d3ad855b3" acquired by "attach_volume" :: waited 0.048s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:52:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1af3b841-3476-4e74-a6cb-c706b036cf28 tempest-VolumesExtendTest-1981556661 None] Acquiring lock "cinder-quobyte-390379d9-d0f3-4b42-a1de-39cf32b84618" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:52:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1af3b841-3476-4e74-a6cb-c706b036cf28 tempest-VolumesExtendTest-1981556661 None] Lock "cinder-quobyte-390379d9-d0f3-4b42-a1de-39cf32b84618" acquired by "delete_volume" :: waited 0.052s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:52:35 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-d99f1cdf-a396-4c1e-8bd6-806161283bb5 tempest-VolumesActionsTest-1603869063 None] Attaching volume f19fc366-a554-4be2-b416-e08d3ad855b3 to instance 95a90b9c-5c9f-4443-b323-e088f531c453 at mountpoint /dev/vdb on host None. Nov 06 17:52:35 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1a7e83-fdfb-493f-91b0-4ffc1717a08f]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:52:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1af3b841-3476-4e74-a6cb-c706b036cf28 tempest-VolumesExtendTest-1981556661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-390379d9-d0f3-4b42-a1de-39cf32b84618 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:52:35 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-d99f1cdf-a396-4c1e-8bd6-806161283bb5 tempest-VolumesActionsTest-1603869063 None] Attach volume completed successfully. Nov 06 17:52:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d99f1cdf-a396-4c1e-8bd6-806161283bb5 tempest-VolumesActionsTest-1603869063 None] Lock "cinder-f19fc366-a554-4be2-b416-e08d3ad855b3" released by "attach_volume" :: held 0.271s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:52:35 devstack sudo[96878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-390379d9-d0f3-4b42-a1de-39cf32b84618 Nov 06 17:52:35 devstack sudo[96878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:52:35 devstack sudo[96878]: pam_unix(sudo:session): session closed for user root Nov 06 17:52:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1af3b841-3476-4e74-a6cb-c706b036cf28 tempest-VolumesExtendTest-1981556661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-390379d9-d0f3-4b42-a1de-39cf32b84618" returned: 0 in 0.861s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:52:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1af3b841-3476-4e74-a6cb-c706b036cf28 tempest-VolumesExtendTest-1981556661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-390379d9-d0f3-4b42-a1de-39cf32b84618 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:52:36 devstack sudo[96886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-390379d9-d0f3-4b42-a1de-39cf32b84618 Nov 06 17:52:36 devstack sudo[96886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:52:36 devstack sudo[96886]: pam_unix(sudo:session): session closed for user root Nov 06 17:52:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1af3b841-3476-4e74-a6cb-c706b036cf28 tempest-VolumesExtendTest-1981556661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-390379d9-d0f3-4b42-a1de-39cf32b84618" returned: 0 in 1.024s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:52:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1af3b841-3476-4e74-a6cb-c706b036cf28 tempest-VolumesExtendTest-1981556661 None] Lock "cinder-quobyte-390379d9-d0f3-4b42-a1de-39cf32b84618" released by "delete_volume" :: held 2.003s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:52:37 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-e38a79a6-a015-4a1f-8037-06590a94cd37 tempest-VolumesActionsTest-1451753164 None] Terminate volume connection completed successfully. Nov 06 17:52:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e38a79a6-a015-4a1f-8037-06590a94cd37 tempest-VolumesActionsTest-1451753164 None] Acquiring lock "cinder-f19fc366-a554-4be2-b416-e08d3ad855b3-detach_volume" by "detach_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:52:37 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-1af3b841-3476-4e74-a6cb-c706b036cf28 tempest-VolumesExtendTest-1981556661 None] Created reservations ['eb3e0d70-b46b-45f1-8a20-7ebf6502081d', 'c464d8cd-e5ff-4265-9a95-01c67a49be82', 'fe8081ee-e1f7-4200-a98d-cd6b0904da7c', '51a3ab41-f6cc-488c-9190-9b899f102e2f'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:52:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e38a79a6-a015-4a1f-8037-06590a94cd37 tempest-VolumesActionsTest-1451753164 None] Lock "cinder-f19fc366-a554-4be2-b416-e08d3ad855b3-detach_volume" acquired by "detach_volume" :: waited 0.103s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:52:37 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-e38a79a6-a015-4a1f-8037-06590a94cd37 tempest-VolumesActionsTest-1451753164 None] Detaching volume f19fc366-a554-4be2-b416-e08d3ad855b3 from instance 95a90b9c-5c9f-4443-b323-e088f531c453. Nov 06 17:52:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1af3b841-3476-4e74-a6cb-c706b036cf28 tempest-VolumesExtendTest-1981556661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:52:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1af3b841-3476-4e74-a6cb-c706b036cf28 tempest-VolumesExtendTest-1981556661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:52:37 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1af3b841-3476-4e74-a6cb-c706b036cf28 tempest-VolumesExtendTest-1981556661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:52:37 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1af3b841-3476-4e74-a6cb-c706b036cf28 tempest-VolumesExtendTest-1981556661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:52:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1af3b841-3476-4e74-a6cb-c706b036cf28 tempest-VolumesExtendTest-1981556661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:52:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1af3b841-3476-4e74-a6cb-c706b036cf28 tempest-VolumesExtendTest-1981556661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:52:37 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-e38a79a6-a015-4a1f-8037-06590a94cd37 tempest-VolumesActionsTest-1451753164 None] Detach volume completed successfully. Nov 06 17:52:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e38a79a6-a015-4a1f-8037-06590a94cd37 tempest-VolumesActionsTest-1451753164 None] Lock "cinder-f19fc366-a554-4be2-b416-e08d3ad855b3-detach_volume" released by "detach_volume" :: held 0.331s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:52:37 devstack sudo[96893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:52:37 devstack sudo[96893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:52:38 devstack sudo[96893]: pam_unix(sudo:session): session closed for user root Nov 06 17:52:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1af3b841-3476-4e74-a6cb-c706b036cf28 tempest-VolumesExtendTest-1981556661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.543s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:52:38 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-1af3b841-3476-4e74-a6cb-c706b036cf28 tempest-VolumesExtendTest-1981556661 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:52:38 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-1af3b841-3476-4e74-a6cb-c706b036cf28 tempest-VolumesExtendTest-1981556661 None] Deleted volume successfully. Nov 06 17:52:38 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1af3b841-3476-4e74-a6cb-c706b036cf28 tempest-VolumesExtendTest-1981556661 None] Lock "cinder-390379d9-d0f3-4b42-a1de-39cf32b84618-delete_volume" released by "delete_volume" :: held 3.523s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:52:38 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-87ad96d8-eaf0-4d7c-836d-ab5642c88646 tempest-VolumesActionsTest-1603869063 None] Acquiring lock "cinder-f19fc366-a554-4be2-b416-e08d3ad855b3-detach_volume" by "detach_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:52:38 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-87ad96d8-eaf0-4d7c-836d-ab5642c88646 tempest-VolumesActionsTest-1603869063 None] Lock "cinder-f19fc366-a554-4be2-b416-e08d3ad855b3-detach_volume" acquired by "detach_volume" :: waited 0.037s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:52:38 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-87ad96d8-eaf0-4d7c-836d-ab5642c88646 tempest-VolumesActionsTest-1603869063 None] Volume detach called, but volume not attached. Nov 06 17:52:38 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-87ad96d8-eaf0-4d7c-836d-ab5642c88646 tempest-VolumesActionsTest-1603869063 None] Lock "cinder-f19fc366-a554-4be2-b416-e08d3ad855b3-detach_volume" released by "detach_volume" :: held 0.056s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:52:39 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e618774a-37a6-44a6-8d9d-7d7fa8902957 tempest-VolumesActionsTest-1603869063 None] Acquiring lock "cinder-f19fc366-a554-4be2-b416-e08d3ad855b3-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:52:39 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e618774a-37a6-44a6-8d9d-7d7fa8902957 tempest-VolumesActionsTest-1603869063 None] Lock "cinder-f19fc366-a554-4be2-b416-e08d3ad855b3-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:52:39 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e618774a-37a6-44a6-8d9d-7d7fa8902957 tempest-VolumesActionsTest-1603869063 None] Acquiring lock "cinder-quobyte-f19fc366-a554-4be2-b416-e08d3ad855b3" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:52:39 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e618774a-37a6-44a6-8d9d-7d7fa8902957 tempest-VolumesActionsTest-1603869063 None] Lock "cinder-quobyte-f19fc366-a554-4be2-b416-e08d3ad855b3" acquired by "delete_volume" :: waited 0.039s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:52:39 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[608494ff-d521-47a3-b2c2-9b040566d2a6]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:52:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e618774a-37a6-44a6-8d9d-7d7fa8902957 tempest-VolumesActionsTest-1603869063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f19fc366-a554-4be2-b416-e08d3ad855b3 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:52:39 devstack sudo[96908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f19fc366-a554-4be2-b416-e08d3ad855b3 Nov 06 17:52:39 devstack sudo[96908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:52:40 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-08a15663-3ff4-4d79-a541-18e172d4f419 tempest-VolumesExtendTest-1981556661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:52:40 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-08a15663-3ff4-4d79-a541-18e172d4f419 tempest-VolumesExtendTest-1981556661 None] Flow 'volume_create_manager' (a423050e-afeb-43f7-85bf-fbeab62ce513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:52:40 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-08a15663-3ff4-4d79-a541-18e172d4f419 tempest-VolumesExtendTest-1981556661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50db4147-95c6-42a7-916b-0b569322b242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:52:40 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-08a15663-3ff4-4d79-a541-18e172d4f419 tempest-VolumesExtendTest-1981556661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50db4147-95c6-42a7-916b-0b569322b242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:52:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1948796509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ded71664-2c42-46b4-92e7-7aa9e1438f6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d3919f3a3b34037a4dc9aaeda626f7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:52:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:52:40Z,use_quota=True,user_id='201da2ce52ff407b979f6f0c1277ea88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:52:40 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-08a15663-3ff4-4d79-a541-18e172d4f419 tempest-VolumesExtendTest-1981556661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb9ebfd9-7335-46e6-ae8d-3ba0663fbe39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:52:40 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-08a15663-3ff4-4d79-a541-18e172d4f419 tempest-VolumesExtendTest-1981556661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb9ebfd9-7335-46e6-ae8d-3ba0663fbe39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:52:40 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-08a15663-3ff4-4d79-a541-18e172d4f419 tempest-VolumesExtendTest-1981556661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c85d891-a249-46a1-b3c7-675237aa714f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:52:40 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-08a15663-3ff4-4d79-a541-18e172d4f419 tempest-VolumesExtendTest-1981556661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c85d891-a249-46a1-b3c7-675237aa714f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ded71664-2c42-46b4-92e7-7aa9e1438f6a', 'volume_name': 'volume-ded71664-2c42-46b4-92e7-7aa9e1438f6a', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:52:40 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-08a15663-3ff4-4d79-a541-18e172d4f419 tempest-VolumesExtendTest-1981556661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66b2baaa-a24d-49c2-9a33-085cb71bcada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:52:40 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-08a15663-3ff4-4d79-a541-18e172d4f419 tempest-VolumesExtendTest-1981556661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66b2baaa-a24d-49c2-9a33-085cb71bcada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:52:40 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-08a15663-3ff4-4d79-a541-18e172d4f419 tempest-VolumesExtendTest-1981556661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bcebfe9-e880-4976-ba26-a5bcf0f39151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:52:40 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-08a15663-3ff4-4d79-a541-18e172d4f419 tempest-VolumesExtendTest-1981556661 None] Volume ded71664-2c42-46b4-92e7-7aa9e1438f6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ded71664-2c42-46b4-92e7-7aa9e1438f6a', 'volume_size': 1} Nov 06 17:52:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-08a15663-3ff4-4d79-a541-18e172d4f419 tempest-VolumesExtendTest-1981556661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:52:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-08a15663-3ff4-4d79-a541-18e172d4f419 tempest-VolumesExtendTest-1981556661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:52:40 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-08a15663-3ff4-4d79-a541-18e172d4f419 tempest-VolumesExtendTest-1981556661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:52:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1948796509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ded71664-2c42-46b4-92e7-7aa9e1438f6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d3919f3a3b34037a4dc9aaeda626f7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:52:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:52:40Z,use_quota=True,user_id='201da2ce52ff407b979f6f0c1277ea88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:52:40 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-08a15663-3ff4-4d79-a541-18e172d4f419 tempest-VolumesExtendTest-1981556661 None] Creating volume ded71664-2c42-46b4-92e7-7aa9e1438f6a {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:52:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-08a15663-3ff4-4d79-a541-18e172d4f419 tempest-VolumesExtendTest-1981556661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:52:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-08a15663-3ff4-4d79-a541-18e172d4f419 tempest-VolumesExtendTest-1981556661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:52:40 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-08a15663-3ff4-4d79-a541-18e172d4f419 tempest-VolumesExtendTest-1981556661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:52:40 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-08a15663-3ff4-4d79-a541-18e172d4f419 tempest-VolumesExtendTest-1981556661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:52:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-08a15663-3ff4-4d79-a541-18e172d4f419 tempest-VolumesExtendTest-1981556661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:52:40 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-08a15663-3ff4-4d79-a541-18e172d4f419 tempest-VolumesExtendTest-1981556661 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:52:40 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-08a15663-3ff4-4d79-a541-18e172d4f419 tempest-VolumesExtendTest-1981556661 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:52:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-08a15663-3ff4-4d79-a541-18e172d4f419 tempest-VolumesExtendTest-1981556661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ded71664-2c42-46b4-92e7-7aa9e1438f6a 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:52:40 devstack sudo[96914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ded71664-2c42-46b4-92e7-7aa9e1438f6a 1073741824 Nov 06 17:52:40 devstack sudo[96914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:52:40 devstack sudo[96908]: pam_unix(sudo:session): session closed for user root Nov 06 17:52:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e618774a-37a6-44a6-8d9d-7d7fa8902957 tempest-VolumesActionsTest-1603869063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f19fc366-a554-4be2-b416-e08d3ad855b3" returned: 0 in 1.455s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:52:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e618774a-37a6-44a6-8d9d-7d7fa8902957 tempest-VolumesActionsTest-1603869063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f19fc366-a554-4be2-b416-e08d3ad855b3 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:52:40 devstack sudo[96919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f19fc366-a554-4be2-b416-e08d3ad855b3 Nov 06 17:52:40 devstack sudo[96919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:52:41 devstack sudo[96919]: pam_unix(sudo:session): session closed for user root Nov 06 17:52:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e618774a-37a6-44a6-8d9d-7d7fa8902957 tempest-VolumesActionsTest-1603869063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f19fc366-a554-4be2-b416-e08d3ad855b3" returned: 0 in 0.672s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:52:41 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e618774a-37a6-44a6-8d9d-7d7fa8902957 tempest-VolumesActionsTest-1603869063 None] Lock "cinder-quobyte-f19fc366-a554-4be2-b416-e08d3ad855b3" released by "delete_volume" :: held 2.384s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:52:41 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-e618774a-37a6-44a6-8d9d-7d7fa8902957 tempest-VolumesActionsTest-1603869063 None] Created reservations ['a4c0ecfb-7f61-4c2c-be1b-1348d31a3cac', '745b83ab-bf17-4699-9367-3f31eb99a2ba', 'fe557f17-e7cb-4f43-8ffe-46b83e4be599', 'bf84a0ea-6a3f-4ef6-b8d8-df4caac31ca0'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:52:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e618774a-37a6-44a6-8d9d-7d7fa8902957 tempest-VolumesActionsTest-1603869063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:52:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e618774a-37a6-44a6-8d9d-7d7fa8902957 tempest-VolumesActionsTest-1603869063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:52:42 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e618774a-37a6-44a6-8d9d-7d7fa8902957 tempest-VolumesActionsTest-1603869063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:52:42 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e618774a-37a6-44a6-8d9d-7d7fa8902957 tempest-VolumesActionsTest-1603869063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:52:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e618774a-37a6-44a6-8d9d-7d7fa8902957 tempest-VolumesActionsTest-1603869063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:52:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e618774a-37a6-44a6-8d9d-7d7fa8902957 tempest-VolumesActionsTest-1603869063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:52:42 devstack sudo[96937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:52:42 devstack sudo[96937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:52:42 devstack sudo[96914]: pam_unix(sudo:session): session closed for user root Nov 06 17:52:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-08a15663-3ff4-4d79-a541-18e172d4f419 tempest-VolumesExtendTest-1981556661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ded71664-2c42-46b4-92e7-7aa9e1438f6a 1073741824" returned: 0 in 1.784s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:52:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-08a15663-3ff4-4d79-a541-18e172d4f419 tempest-VolumesExtendTest-1981556661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ded71664-2c42-46b4-92e7-7aa9e1438f6a {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:52:42 devstack sudo[96937]: pam_unix(sudo:session): session closed for user root Nov 06 17:52:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e618774a-37a6-44a6-8d9d-7d7fa8902957 tempest-VolumesActionsTest-1603869063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.395s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:52:42 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-e618774a-37a6-44a6-8d9d-7d7fa8902957 tempest-VolumesActionsTest-1603869063 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:52:42 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-e618774a-37a6-44a6-8d9d-7d7fa8902957 tempest-VolumesActionsTest-1603869063 None] Deleted volume successfully. Nov 06 17:52:42 devstack sudo[96942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ded71664-2c42-46b4-92e7-7aa9e1438f6a Nov 06 17:52:42 devstack sudo[96942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:52:42 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e618774a-37a6-44a6-8d9d-7d7fa8902957 tempest-VolumesActionsTest-1603869063 None] Lock "cinder-f19fc366-a554-4be2-b416-e08d3ad855b3-delete_volume" released by "delete_volume" :: held 3.535s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:52:43 devstack sudo[96942]: pam_unix(sudo:session): session closed for user root Nov 06 17:52:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-08a15663-3ff4-4d79-a541-18e172d4f419 tempest-VolumesExtendTest-1981556661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ded71664-2c42-46b4-92e7-7aa9e1438f6a" returned: 0 in 0.522s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:52:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-08a15663-3ff4-4d79-a541-18e172d4f419 tempest-VolumesExtendTest-1981556661 None] <== create_volume: return (2453ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:52:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-08a15663-3ff4-4d79-a541-18e172d4f419 tempest-VolumesExtendTest-1981556661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.465s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:52:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-08a15663-3ff4-4d79-a541-18e172d4f419 tempest-VolumesExtendTest-1981556661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bcebfe9-e880-4976-ba26-a5bcf0f39151) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ded71664-2c42-46b4-92e7-7aa9e1438f6a', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:52:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-08a15663-3ff4-4d79-a541-18e172d4f419 tempest-VolumesExtendTest-1981556661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e90946ca-cfb0-4e26-b64d-d3af39edaaff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:52:43 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-08a15663-3ff4-4d79-a541-18e172d4f419 tempest-VolumesExtendTest-1981556661 None] Volume volume-ded71664-2c42-46b4-92e7-7aa9e1438f6a (ded71664-2c42-46b4-92e7-7aa9e1438f6a): created successfully Nov 06 17:52:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-08a15663-3ff4-4d79-a541-18e172d4f419 tempest-VolumesExtendTest-1981556661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e90946ca-cfb0-4e26-b64d-d3af39edaaff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:52:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-08a15663-3ff4-4d79-a541-18e172d4f419 tempest-VolumesExtendTest-1981556661 None] Flow 'volume_create_manager' (a423050e-afeb-43f7-85bf-fbeab62ce513) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:52:43 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-08a15663-3ff4-4d79-a541-18e172d4f419 tempest-VolumesExtendTest-1981556661 None] Created volume successfully. Nov 06 17:52:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-090e30f5-04f4-4b51-9a34-689a0b784736 tempest-VolumesExtendTest-1981556661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:52:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-090e30f5-04f4-4b51-9a34-689a0b784736 tempest-VolumesExtendTest-1981556661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:52:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-090e30f5-04f4-4b51-9a34-689a0b784736 tempest-VolumesExtendTest-1981556661 None] Creating offline snapshot 60ec712e-c362-4ed6-8f15-4956201bba19 of volume ded71664-2c42-46b4-92e7-7aa9e1438f6a {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 17:52:44 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a27bfa6-ed0a-4dd4-a757-4f9344474ee8]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:52:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-090e30f5-04f4-4b51-9a34-689a0b784736 tempest-VolumesExtendTest-1981556661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ded71664-2c42-46b4-92e7-7aa9e1438f6a {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:52:44 devstack sudo[96966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ded71664-2c42-46b4-92e7-7aa9e1438f6a Nov 06 17:52:44 devstack sudo[96966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:52:44 devstack sudo[96966]: pam_unix(sudo:session): session closed for user root Nov 06 17:52:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-090e30f5-04f4-4b51-9a34-689a0b784736 tempest-VolumesExtendTest-1981556661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ded71664-2c42-46b4-92e7-7aa9e1438f6a" returned: 0 in 0.679s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:52:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-090e30f5-04f4-4b51-9a34-689a0b784736 tempest-VolumesExtendTest-1981556661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ded71664-2c42-46b4-92e7-7aa9e1438f6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ded71664-2c42-46b4-92e7-7aa9e1438f6a.60ec712e-c362-4ed6-8f15-4956201bba19 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:52:44 devstack sudo[96981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ded71664-2c42-46b4-92e7-7aa9e1438f6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ded71664-2c42-46b4-92e7-7aa9e1438f6a.60ec712e-c362-4ed6-8f15-4956201bba19 1G Nov 06 17:52:44 devstack sudo[96981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:52:45 devstack sudo[96981]: pam_unix(sudo:session): session closed for user root Nov 06 17:52:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-090e30f5-04f4-4b51-9a34-689a0b784736 tempest-VolumesExtendTest-1981556661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ded71664-2c42-46b4-92e7-7aa9e1438f6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ded71664-2c42-46b4-92e7-7aa9e1438f6a.60ec712e-c362-4ed6-8f15-4956201bba19 1G" returned: 0 in 0.709s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:52:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-090e30f5-04f4-4b51-9a34-689a0b784736 tempest-VolumesExtendTest-1981556661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ded71664-2c42-46b4-92e7-7aa9e1438f6a -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ded71664-2c42-46b4-92e7-7aa9e1438f6a.60ec712e-c362-4ed6-8f15-4956201bba19 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:52:45 devstack sudo[96998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ded71664-2c42-46b4-92e7-7aa9e1438f6a -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ded71664-2c42-46b4-92e7-7aa9e1438f6a.60ec712e-c362-4ed6-8f15-4956201bba19 Nov 06 17:52:45 devstack sudo[96998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:52:46 devstack sudo[96998]: pam_unix(sudo:session): session closed for user root Nov 06 17:52:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-090e30f5-04f4-4b51-9a34-689a0b784736 tempest-VolumesExtendTest-1981556661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ded71664-2c42-46b4-92e7-7aa9e1438f6a -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ded71664-2c42-46b4-92e7-7aa9e1438f6a.60ec712e-c362-4ed6-8f15-4956201bba19" returned: 0 in 0.723s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:52:46 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-090e30f5-04f4-4b51-9a34-689a0b784736 tempest-VolumesExtendTest-1981556661 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ded71664-2c42-46b4-92e7-7aa9e1438f6a.60ec712e-c362-4ed6-8f15-4956201bba19 is being set with open permissions: ugo+rw Nov 06 17:52:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-090e30f5-04f4-4b51-9a34-689a0b784736 tempest-VolumesExtendTest-1981556661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ded71664-2c42-46b4-92e7-7aa9e1438f6a.60ec712e-c362-4ed6-8f15-4956201bba19 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:52:46 devstack sudo[97038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ded71664-2c42-46b4-92e7-7aa9e1438f6a.60ec712e-c362-4ed6-8f15-4956201bba19 Nov 06 17:52:46 devstack sudo[97038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:52:47 devstack sudo[97038]: pam_unix(sudo:session): session closed for user root Nov 06 17:52:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-090e30f5-04f4-4b51-9a34-689a0b784736 tempest-VolumesExtendTest-1981556661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ded71664-2c42-46b4-92e7-7aa9e1438f6a.60ec712e-c362-4ed6-8f15-4956201bba19" returned: 0 in 0.892s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:52:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-090e30f5-04f4-4b51-9a34-689a0b784736 tempest-VolumesExtendTest-1981556661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ded71664-2c42-46b4-92e7-7aa9e1438f6a.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:52:47 devstack sudo[97092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ded71664-2c42-46b4-92e7-7aa9e1438f6a.info Nov 06 17:52:47 devstack sudo[97092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:52:47 devstack sudo[97092]: pam_unix(sudo:session): session closed for user root Nov 06 17:52:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-090e30f5-04f4-4b51-9a34-689a0b784736 tempest-VolumesExtendTest-1981556661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ded71664-2c42-46b4-92e7-7aa9e1438f6a.info" returned: 0 in 0.672s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:52:47 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-090e30f5-04f4-4b51-9a34-689a0b784736 tempest-VolumesExtendTest-1981556661 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ded71664-2c42-46b4-92e7-7aa9e1438f6a.info is being set with open permissions: ugo+rw Nov 06 17:52:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-090e30f5-04f4-4b51-9a34-689a0b784736 tempest-VolumesExtendTest-1981556661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ded71664-2c42-46b4-92e7-7aa9e1438f6a.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:52:47 devstack sudo[97122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ded71664-2c42-46b4-92e7-7aa9e1438f6a.info Nov 06 17:52:47 devstack sudo[97122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:52:48 devstack sudo[97122]: pam_unix(sudo:session): session closed for user root Nov 06 17:52:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-090e30f5-04f4-4b51-9a34-689a0b784736 tempest-VolumesExtendTest-1981556661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ded71664-2c42-46b4-92e7-7aa9e1438f6a.info" returned: 0 in 0.656s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:52:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-090e30f5-04f4-4b51-9a34-689a0b784736 tempest-VolumesExtendTest-1981556661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.559s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:52:48 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-090e30f5-04f4-4b51-9a34-689a0b784736 tempest-VolumesExtendTest-1981556661 None] Create snapshot completed successfully Nov 06 17:52:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ddc618e5-4b20-436d-bd6b-45c2962caf07 tempest-VolumesExtendTest-1981556661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:52:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ddc618e5-4b20-436d-bd6b-45c2962caf07 tempest-VolumesExtendTest-1981556661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.004s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:52:50 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ba045e-af1b-48f4-8529-b8ceaedeff22]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:52:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ddc618e5-4b20-436d-bd6b-45c2962caf07 tempest-VolumesExtendTest-1981556661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ded71664-2c42-46b4-92e7-7aa9e1438f6a {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:52:50 devstack sudo[97165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ded71664-2c42-46b4-92e7-7aa9e1438f6a Nov 06 17:52:50 devstack sudo[97165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:52:50 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-c241d77d-8787-4a0b-8efe-36144aa6b732 tempest-VolumesActionsTest-1603869063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:52:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c241d77d-8787-4a0b-8efe-36144aa6b732 tempest-VolumesActionsTest-1603869063 None] Flow 'volume_create_manager' (93e355e1-9b0a-43a2-b357-4f7f960d8b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:52:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c241d77d-8787-4a0b-8efe-36144aa6b732 tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eab68cb1-7569-4993-924c-394b8ec747f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:52:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c241d77d-8787-4a0b-8efe-36144aa6b732 tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eab68cb1-7569-4993-924c-394b8ec747f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-49883431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3539713-4d1e-4b82-b369-64bf969a0d42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61a32a6744ec449280a9b0af8e2adc4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:52:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:52:51Z,use_quota=True,user_id='6a1654f7f8c04863834119a414f584e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:52:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c241d77d-8787-4a0b-8efe-36144aa6b732 tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49c89f16-5060-44b6-88b4-eba8625e3c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:52:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c241d77d-8787-4a0b-8efe-36144aa6b732 tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49c89f16-5060-44b6-88b4-eba8625e3c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:52:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c241d77d-8787-4a0b-8efe-36144aa6b732 tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ae71e51-7552-4139-a9ed-07eaadf8b401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:52:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c241d77d-8787-4a0b-8efe-36144aa6b732 tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ae71e51-7552-4139-a9ed-07eaadf8b401) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3539713-4d1e-4b82-b369-64bf969a0d42', 'volume_name': 'volume-b3539713-4d1e-4b82-b369-64bf969a0d42', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:52:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c241d77d-8787-4a0b-8efe-36144aa6b732 tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (404f09b0-586a-478b-bd60-726e83b32f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:52:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c241d77d-8787-4a0b-8efe-36144aa6b732 tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (404f09b0-586a-478b-bd60-726e83b32f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:52:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c241d77d-8787-4a0b-8efe-36144aa6b732 tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e602da85-7568-48b9-bcf3-50dfb9b6aeab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:52:50 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-c241d77d-8787-4a0b-8efe-36144aa6b732 tempest-VolumesActionsTest-1603869063 None] Volume b3539713-4d1e-4b82-b369-64bf969a0d42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3539713-4d1e-4b82-b369-64bf969a0d42', 'volume_size': 1} Nov 06 17:52:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c241d77d-8787-4a0b-8efe-36144aa6b732 tempest-VolumesActionsTest-1603869063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:52:51 devstack sudo[97165]: pam_unix(sudo:session): session closed for user root Nov 06 17:52:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ddc618e5-4b20-436d-bd6b-45c2962caf07 tempest-VolumesExtendTest-1981556661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ded71664-2c42-46b4-92e7-7aa9e1438f6a" returned: 0 in 0.938s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:52:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ddc618e5-4b20-436d-bd6b-45c2962caf07 tempest-VolumesExtendTest-1981556661 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ded71664-2c42-46b4-92e7-7aa9e1438f6a.60ec712e-c362-4ed6-8f15-4956201bba19 2G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:52:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ddc618e5-4b20-436d-bd6b-45c2962caf07 tempest-VolumesExtendTest-1981556661 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ded71664-2c42-46b4-92e7-7aa9e1438f6a.60ec712e-c362-4ed6-8f15-4956201bba19 2G" returned: 0 in 0.253s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:52:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ddc618e5-4b20-436d-bd6b-45c2962caf07 tempest-VolumesExtendTest-1981556661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.323s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:52:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c241d77d-8787-4a0b-8efe-36144aa6b732 tempest-VolumesActionsTest-1603869063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.379s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:52:51 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c241d77d-8787-4a0b-8efe-36144aa6b732 tempest-VolumesActionsTest-1603869063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-49883431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3539713-4d1e-4b82-b369-64bf969a0d42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61a32a6744ec449280a9b0af8e2adc4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:52:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:52:51Z,use_quota=True,user_id='6a1654f7f8c04863834119a414f584e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:52:51 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-c241d77d-8787-4a0b-8efe-36144aa6b732 tempest-VolumesActionsTest-1603869063 None] Creating volume b3539713-4d1e-4b82-b369-64bf969a0d42 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:52:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c241d77d-8787-4a0b-8efe-36144aa6b732 tempest-VolumesActionsTest-1603869063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:52:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c241d77d-8787-4a0b-8efe-36144aa6b732 tempest-VolumesActionsTest-1603869063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:52:51 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c241d77d-8787-4a0b-8efe-36144aa6b732 tempest-VolumesActionsTest-1603869063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:52:51 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c241d77d-8787-4a0b-8efe-36144aa6b732 tempest-VolumesActionsTest-1603869063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:52:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c241d77d-8787-4a0b-8efe-36144aa6b732 tempest-VolumesActionsTest-1603869063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:52:51 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c241d77d-8787-4a0b-8efe-36144aa6b732 tempest-VolumesActionsTest-1603869063 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:52:51 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-c241d77d-8787-4a0b-8efe-36144aa6b732 tempest-VolumesActionsTest-1603869063 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:52:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c241d77d-8787-4a0b-8efe-36144aa6b732 tempest-VolumesActionsTest-1603869063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b3539713-4d1e-4b82-b369-64bf969a0d42 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:52:51 devstack sudo[97190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b3539713-4d1e-4b82-b369-64bf969a0d42 1073741824 Nov 06 17:52:51 devstack sudo[97190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:52:51 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-ddc618e5-4b20-436d-bd6b-45c2962caf07 tempest-VolumesExtendTest-1981556661 None] Extend volume completed successfully. Nov 06 17:52:52 devstack sudo[97190]: pam_unix(sudo:session): session closed for user root Nov 06 17:52:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c241d77d-8787-4a0b-8efe-36144aa6b732 tempest-VolumesActionsTest-1603869063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b3539713-4d1e-4b82-b369-64bf969a0d42 1073741824" returned: 0 in 0.701s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:52:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c241d77d-8787-4a0b-8efe-36144aa6b732 tempest-VolumesActionsTest-1603869063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b3539713-4d1e-4b82-b369-64bf969a0d42 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:52:52 devstack sudo[97204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b3539713-4d1e-4b82-b369-64bf969a0d42 Nov 06 17:52:52 devstack sudo[97204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:52:52 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-524a09c1-46bc-4214-84b2-3a5d2b9f1105 tempest-VolumesExtendTest-1981556661 None] Acquiring lock "cinder-60ec712e-c362-4ed6-8f15-4956201bba19-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:52:52 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-524a09c1-46bc-4214-84b2-3a5d2b9f1105 tempest-VolumesExtendTest-1981556661 None] Lock "cinder-60ec712e-c362-4ed6-8f15-4956201bba19-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:52:52 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-524a09c1-46bc-4214-84b2-3a5d2b9f1105 tempest-VolumesExtendTest-1981556661 None] Acquiring lock "cinder-quobyte-ded71664-2c42-46b4-92e7-7aa9e1438f6a" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:52:52 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-524a09c1-46bc-4214-84b2-3a5d2b9f1105 tempest-VolumesExtendTest-1981556661 None] Lock "cinder-quobyte-ded71664-2c42-46b4-92e7-7aa9e1438f6a" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:52:52 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-524a09c1-46bc-4214-84b2-3a5d2b9f1105 tempest-VolumesExtendTest-1981556661 None] Acquiring lock "cinder-quobyte-60ec712e-c362-4ed6-8f15-4956201bba19" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:52:52 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-524a09c1-46bc-4214-84b2-3a5d2b9f1105 tempest-VolumesExtendTest-1981556661 None] Lock "cinder-quobyte-60ec712e-c362-4ed6-8f15-4956201bba19" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:52:52 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-524a09c1-46bc-4214-84b2-3a5d2b9f1105 tempest-VolumesExtendTest-1981556661 None] Deleting offline snapshot 60ec712e-c362-4ed6-8f15-4956201bba19 of volume ded71664-2c42-46b4-92e7-7aa9e1438f6a {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 17:52:52 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-524a09c1-46bc-4214-84b2-3a5d2b9f1105 tempest-VolumesExtendTest-1981556661 None] snapshot_file for this snap is: volume-ded71664-2c42-46b4-92e7-7aa9e1438f6a.60ec712e-c362-4ed6-8f15-4956201bba19 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 17:52:52 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92c384c-31ea-4afa-8f2a-00d32ecbb406]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:52:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-524a09c1-46bc-4214-84b2-3a5d2b9f1105 tempest-VolumesExtendTest-1981556661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ded71664-2c42-46b4-92e7-7aa9e1438f6a.60ec712e-c362-4ed6-8f15-4956201bba19 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:52:52 devstack sudo[97204]: pam_unix(sudo:session): session closed for user root Nov 06 17:52:52 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6deed15a-9d7c-4b6c-940a-020953e8cea1 tempest-VolumesActionsTest-404676404 None] Acquiring lock "cinder-d5f35b33-fa78-4485-8e77-db85147e5172" by "attach_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:52:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c241d77d-8787-4a0b-8efe-36144aa6b732 tempest-VolumesActionsTest-1603869063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b3539713-4d1e-4b82-b369-64bf969a0d42" returned: 0 in 0.679s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:52:52 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c241d77d-8787-4a0b-8efe-36144aa6b732 tempest-VolumesActionsTest-1603869063 None] <== create_volume: return (1458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:52:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c241d77d-8787-4a0b-8efe-36144aa6b732 tempest-VolumesActionsTest-1603869063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:52:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c241d77d-8787-4a0b-8efe-36144aa6b732 tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e602da85-7568-48b9-bcf3-50dfb9b6aeab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3539713-4d1e-4b82-b369-64bf969a0d42', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:52:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c241d77d-8787-4a0b-8efe-36144aa6b732 tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5afb3edd-4e8c-4b18-baf2-90807f4c67f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:52:52 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6deed15a-9d7c-4b6c-940a-020953e8cea1 tempest-VolumesActionsTest-404676404 None] Lock "cinder-d5f35b33-fa78-4485-8e77-db85147e5172" acquired by "attach_volume" :: waited 0.064s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:52:52 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-c241d77d-8787-4a0b-8efe-36144aa6b732 tempest-VolumesActionsTest-1603869063 None] Volume volume-b3539713-4d1e-4b82-b369-64bf969a0d42 (b3539713-4d1e-4b82-b369-64bf969a0d42): created successfully Nov 06 17:52:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c241d77d-8787-4a0b-8efe-36144aa6b732 tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5afb3edd-4e8c-4b18-baf2-90807f4c67f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:52:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c241d77d-8787-4a0b-8efe-36144aa6b732 tempest-VolumesActionsTest-1603869063 None] Flow 'volume_create_manager' (93e355e1-9b0a-43a2-b357-4f7f960d8b15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:52:52 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-c241d77d-8787-4a0b-8efe-36144aa6b732 tempest-VolumesActionsTest-1603869063 None] Created volume successfully. Nov 06 17:52:52 devstack sudo[97207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ded71664-2c42-46b4-92e7-7aa9e1438f6a.60ec712e-c362-4ed6-8f15-4956201bba19 Nov 06 17:52:52 devstack sudo[97207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:52:52 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-6deed15a-9d7c-4b6c-940a-020953e8cea1 tempest-VolumesActionsTest-404676404 None] Attaching volume d5f35b33-fa78-4485-8e77-db85147e5172 to instance ce801fe0-eaf3-47cb-b12c-d800f2a9e9b1 at mountpoint /dev/vdb on host None. Nov 06 17:52:52 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-6deed15a-9d7c-4b6c-940a-020953e8cea1 tempest-VolumesActionsTest-404676404 None] Attach volume completed successfully. Nov 06 17:52:52 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6deed15a-9d7c-4b6c-940a-020953e8cea1 tempest-VolumesActionsTest-404676404 None] Lock "cinder-d5f35b33-fa78-4485-8e77-db85147e5172" released by "attach_volume" :: held 0.153s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:52:53 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f6cdf9ee-afb1-4509-bdfc-0989ca106031 tempest-VolumesActionsTest-404676404 None] Acquiring lock "cinder-d5f35b33-fa78-4485-8e77-db85147e5172-detach_volume" by "detach_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:52:53 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f6cdf9ee-afb1-4509-bdfc-0989ca106031 tempest-VolumesActionsTest-404676404 None] Lock "cinder-d5f35b33-fa78-4485-8e77-db85147e5172-detach_volume" acquired by "detach_volume" :: waited 0.034s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:52:53 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-f6cdf9ee-afb1-4509-bdfc-0989ca106031 tempest-VolumesActionsTest-404676404 None] Detaching volume d5f35b33-fa78-4485-8e77-db85147e5172 from instance ce801fe0-eaf3-47cb-b12c-d800f2a9e9b1. Nov 06 17:52:53 devstack sudo[97207]: pam_unix(sudo:session): session closed for user root Nov 06 17:52:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-524a09c1-46bc-4214-84b2-3a5d2b9f1105 tempest-VolumesExtendTest-1981556661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ded71664-2c42-46b4-92e7-7aa9e1438f6a.60ec712e-c362-4ed6-8f15-4956201bba19" returned: 0 in 0.490s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:52:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-524a09c1-46bc-4214-84b2-3a5d2b9f1105 tempest-VolumesExtendTest-1981556661 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ded71664-2c42-46b4-92e7-7aa9e1438f6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 17:52:53 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb5163f-1e09-4584-b1fb-3b06214642ec]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:52:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-524a09c1-46bc-4214-84b2-3a5d2b9f1105 tempest-VolumesExtendTest-1981556661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ded71664-2c42-46b4-92e7-7aa9e1438f6a {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:52:53 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-f6cdf9ee-afb1-4509-bdfc-0989ca106031 tempest-VolumesActionsTest-404676404 None] Detach volume completed successfully. Nov 06 17:52:53 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f6cdf9ee-afb1-4509-bdfc-0989ca106031 tempest-VolumesActionsTest-404676404 None] Lock "cinder-d5f35b33-fa78-4485-8e77-db85147e5172-detach_volume" released by "detach_volume" :: held 0.124s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:52:53 devstack sudo[97212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ded71664-2c42-46b4-92e7-7aa9e1438f6a Nov 06 17:52:53 devstack sudo[97212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:52:53 devstack sudo[97212]: pam_unix(sudo:session): session closed for user root Nov 06 17:52:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-524a09c1-46bc-4214-84b2-3a5d2b9f1105 tempest-VolumesExtendTest-1981556661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ded71664-2c42-46b4-92e7-7aa9e1438f6a" returned: 0 in 0.687s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:52:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-524a09c1-46bc-4214-84b2-3a5d2b9f1105 tempest-VolumesExtendTest-1981556661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ded71664-2c42-46b4-92e7-7aa9e1438f6a.60ec712e-c362-4ed6-8f15-4956201bba19 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:52:53 devstack sudo[97220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ded71664-2c42-46b4-92e7-7aa9e1438f6a.60ec712e-c362-4ed6-8f15-4956201bba19 Nov 06 17:52:53 devstack sudo[97220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:52:54 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 17:52:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:52:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:52:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:52:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:52:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:52:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:52:54 devstack sudo[97239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:52:54 devstack sudo[97239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:52:54 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9586d901-44b5-4b78-8770-4cac5c708645 tempest-VolumesActionsTest-1451753164 None] Acquiring lock "cinder-b3539713-4d1e-4b82-b369-64bf969a0d42-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:52:54 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9586d901-44b5-4b78-8770-4cac5c708645 tempest-VolumesActionsTest-1451753164 None] Lock "cinder-b3539713-4d1e-4b82-b369-64bf969a0d42-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:52:54 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9586d901-44b5-4b78-8770-4cac5c708645 tempest-VolumesActionsTest-1451753164 None] Acquiring lock "cinder-quobyte-b3539713-4d1e-4b82-b369-64bf969a0d42" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:52:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9586d901-44b5-4b78-8770-4cac5c708645 tempest-VolumesActionsTest-1451753164 None] Lock "cinder-quobyte-b3539713-4d1e-4b82-b369-64bf969a0d42" acquired by "delete_volume" :: waited 0.070s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:52:55 devstack sudo[97239]: pam_unix(sudo:session): session closed for user root Nov 06 17:52:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.586s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:52:55 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:52:55 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running periodic task VolumeManager._thread_info {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 17:52:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] thread count: 28 {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 17:52:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] thread info: [<_MainThread(MainThread, started 133940619505792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 17:52:55 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2fbef0-1266-4432-88de-b72f566dab22]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:52:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9586d901-44b5-4b78-8770-4cac5c708645 tempest-VolumesActionsTest-1451753164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b3539713-4d1e-4b82-b369-64bf969a0d42 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:52:55 devstack sudo[97220]: pam_unix(sudo:session): session closed for user root Nov 06 17:52:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-524a09c1-46bc-4214-84b2-3a5d2b9f1105 tempest-VolumesExtendTest-1981556661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ded71664-2c42-46b4-92e7-7aa9e1438f6a.60ec712e-c362-4ed6-8f15-4956201bba19" returned: 0 in 1.205s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:52:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-524a09c1-46bc-4214-84b2-3a5d2b9f1105 tempest-VolumesExtendTest-1981556661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ded71664-2c42-46b4-92e7-7aa9e1438f6a.60ec712e-c362-4ed6-8f15-4956201bba19 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:52:55 devstack sudo[97265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ded71664-2c42-46b4-92e7-7aa9e1438f6a.60ec712e-c362-4ed6-8f15-4956201bba19 Nov 06 17:52:55 devstack sudo[97265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:52:55 devstack sudo[97263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b3539713-4d1e-4b82-b369-64bf969a0d42 Nov 06 17:52:55 devstack sudo[97263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:52:55 devstack sudo[97265]: pam_unix(sudo:session): session closed for user root Nov 06 17:52:55 devstack sudo[97263]: pam_unix(sudo:session): session closed for user root Nov 06 17:52:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-524a09c1-46bc-4214-84b2-3a5d2b9f1105 tempest-VolumesExtendTest-1981556661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ded71664-2c42-46b4-92e7-7aa9e1438f6a.60ec712e-c362-4ed6-8f15-4956201bba19" returned: 0 in 0.464s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:52:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9586d901-44b5-4b78-8770-4cac5c708645 tempest-VolumesActionsTest-1451753164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b3539713-4d1e-4b82-b369-64bf969a0d42" returned: 0 in 0.508s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:52:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9586d901-44b5-4b78-8770-4cac5c708645 tempest-VolumesActionsTest-1451753164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b3539713-4d1e-4b82-b369-64bf969a0d42 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:52:55 devstack sudo[97279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b3539713-4d1e-4b82-b369-64bf969a0d42 Nov 06 17:52:55 devstack sudo[97279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:52:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-524a09c1-46bc-4214-84b2-3a5d2b9f1105 tempest-VolumesExtendTest-1981556661 None] Lock "cinder-quobyte-60ec712e-c362-4ed6-8f15-4956201bba19" released by "_delete_snapshot" :: held 3.032s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:52:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-524a09c1-46bc-4214-84b2-3a5d2b9f1105 tempest-VolumesExtendTest-1981556661 None] Lock "cinder-quobyte-ded71664-2c42-46b4-92e7-7aa9e1438f6a" released by "delete_snapshot" :: held 3.078s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:52:55 devstack sudo[97279]: pam_unix(sudo:session): session closed for user root Nov 06 17:52:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9586d901-44b5-4b78-8770-4cac5c708645 tempest-VolumesActionsTest-1451753164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b3539713-4d1e-4b82-b369-64bf969a0d42" returned: 0 in 0.363s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:52:56 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9586d901-44b5-4b78-8770-4cac5c708645 tempest-VolumesActionsTest-1451753164 None] Lock "cinder-quobyte-b3539713-4d1e-4b82-b369-64bf969a0d42" released by "delete_volume" :: held 0.993s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:52:56 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-524a09c1-46bc-4214-84b2-3a5d2b9f1105 tempest-VolumesExtendTest-1981556661 None] Created reservations ['0fda4ac9-79cb-4414-a49a-0e3408890ab7', '40a45813-0831-4177-a742-41626fa43d3e', 'ec7fbbef-7c64-4337-afc1-d7269868b1d3', 'f45cb748-2bbb-439c-a226-614c50df1224'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:52:56 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-9586d901-44b5-4b78-8770-4cac5c708645 tempest-VolumesActionsTest-1451753164 None] Created reservations ['9a868b2c-2008-45d2-b57c-c04fa1ac411e', 'd82382d5-3ed8-414f-a67b-9b4195a1f4df', 'fabe5ca6-3083-45f6-a32e-a7c3598b3a5a', '8e815eb5-fad1-4f73-8712-193fafb3f91b'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:52:56 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-524a09c1-46bc-4214-84b2-3a5d2b9f1105 tempest-VolumesExtendTest-1981556661 None] Delete snapshot completed successfully. Nov 06 17:52:56 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-524a09c1-46bc-4214-84b2-3a5d2b9f1105 tempest-VolumesExtendTest-1981556661 None] Lock "cinder-60ec712e-c362-4ed6-8f15-4956201bba19-delete_snapshot" released by "delete_snapshot" :: held 3.678s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:52:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9586d901-44b5-4b78-8770-4cac5c708645 tempest-VolumesActionsTest-1451753164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:52:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9586d901-44b5-4b78-8770-4cac5c708645 tempest-VolumesActionsTest-1451753164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:52:56 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9586d901-44b5-4b78-8770-4cac5c708645 tempest-VolumesActionsTest-1451753164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:52:56 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9586d901-44b5-4b78-8770-4cac5c708645 tempest-VolumesActionsTest-1451753164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:52:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9586d901-44b5-4b78-8770-4cac5c708645 tempest-VolumesActionsTest-1451753164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:52:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9586d901-44b5-4b78-8770-4cac5c708645 tempest-VolumesActionsTest-1451753164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:52:56 devstack sudo[97284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:52:56 devstack sudo[97284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:52:56 devstack sudo[97284]: pam_unix(sudo:session): session closed for user root Nov 06 17:52:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9586d901-44b5-4b78-8770-4cac5c708645 tempest-VolumesActionsTest-1451753164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.452s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:52:56 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-9586d901-44b5-4b78-8770-4cac5c708645 tempest-VolumesActionsTest-1451753164 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:52:56 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-9586d901-44b5-4b78-8770-4cac5c708645 tempest-VolumesActionsTest-1451753164 None] Deleted volume successfully. Nov 06 17:52:56 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9586d901-44b5-4b78-8770-4cac5c708645 tempest-VolumesActionsTest-1451753164 None] Lock "cinder-b3539713-4d1e-4b82-b369-64bf969a0d42-delete_volume" released by "delete_volume" :: held 1.992s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:52:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-383e1054-22f2-4a2a-bf94-699f6eba8bae tempest-VolumesExtendTest-1981556661 None] Acquiring lock "cinder-ded71664-2c42-46b4-92e7-7aa9e1438f6a-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:52:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-383e1054-22f2-4a2a-bf94-699f6eba8bae tempest-VolumesExtendTest-1981556661 None] Lock "cinder-ded71664-2c42-46b4-92e7-7aa9e1438f6a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:52:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-383e1054-22f2-4a2a-bf94-699f6eba8bae tempest-VolumesExtendTest-1981556661 None] Acquiring lock "cinder-quobyte-ded71664-2c42-46b4-92e7-7aa9e1438f6a" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:52:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-383e1054-22f2-4a2a-bf94-699f6eba8bae tempest-VolumesExtendTest-1981556661 None] Lock "cinder-quobyte-ded71664-2c42-46b4-92e7-7aa9e1438f6a" acquired by "delete_volume" :: waited 0.052s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:52:57 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0163f36b-0a2a-4108-8551-1e9ab4e78e23]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:52:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-383e1054-22f2-4a2a-bf94-699f6eba8bae tempest-VolumesExtendTest-1981556661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ded71664-2c42-46b4-92e7-7aa9e1438f6a {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:52:57 devstack sudo[97294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ded71664-2c42-46b4-92e7-7aa9e1438f6a Nov 06 17:52:57 devstack sudo[97294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:52:58 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-15bd3139-d035-4d99-ae83-b9d049e57cda tempest-VolumesActionsTest-1603869063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:52:58 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-15bd3139-d035-4d99-ae83-b9d049e57cda tempest-VolumesActionsTest-1603869063 None] Flow 'volume_create_manager' (4b08dc3f-c7fa-4f4a-a0cc-64135ca2b127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:52:58 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-15bd3139-d035-4d99-ae83-b9d049e57cda tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff731270-dcc6-42be-9e6e-4f0f7258aee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:52:58 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-15bd3139-d035-4d99-ae83-b9d049e57cda tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff731270-dcc6-42be-9e6e-4f0f7258aee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-234258346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9540564d-6797-459a-a90b-85ef61a04527,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61a32a6744ec449280a9b0af8e2adc4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:52:58Z,use_quota=True,user_id='6a1654f7f8c04863834119a414f584e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:52:58 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-15bd3139-d035-4d99-ae83-b9d049e57cda tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (911df48b-7617-4e57-84e0-62428dd6f1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:52:58 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-15bd3139-d035-4d99-ae83-b9d049e57cda tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (911df48b-7617-4e57-84e0-62428dd6f1d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:52:58 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-15bd3139-d035-4d99-ae83-b9d049e57cda tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f90f292-750e-40fa-ad26-142e484ef999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:52:58 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-15bd3139-d035-4d99-ae83-b9d049e57cda tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f90f292-750e-40fa-ad26-142e484ef999) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9540564d-6797-459a-a90b-85ef61a04527', 'volume_name': 'volume-9540564d-6797-459a-a90b-85ef61a04527', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:52:58 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-15bd3139-d035-4d99-ae83-b9d049e57cda tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df1445c5-2e77-402c-9b75-693859cce7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:52:58 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-15bd3139-d035-4d99-ae83-b9d049e57cda tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df1445c5-2e77-402c-9b75-693859cce7f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:52:58 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-15bd3139-d035-4d99-ae83-b9d049e57cda tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4c4d4c3-1c00-4708-ad07-6fb36a754a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:52:58 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-15bd3139-d035-4d99-ae83-b9d049e57cda tempest-VolumesActionsTest-1603869063 None] Volume 9540564d-6797-459a-a90b-85ef61a04527: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9540564d-6797-459a-a90b-85ef61a04527', 'volume_size': 1} Nov 06 17:52:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-15bd3139-d035-4d99-ae83-b9d049e57cda tempest-VolumesActionsTest-1603869063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:52:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-15bd3139-d035-4d99-ae83-b9d049e57cda tempest-VolumesActionsTest-1603869063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:52:58 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-15bd3139-d035-4d99-ae83-b9d049e57cda tempest-VolumesActionsTest-1603869063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-234258346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9540564d-6797-459a-a90b-85ef61a04527,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61a32a6744ec449280a9b0af8e2adc4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:52:58Z,use_quota=True,user_id='6a1654f7f8c04863834119a414f584e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:52:58 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-15bd3139-d035-4d99-ae83-b9d049e57cda tempest-VolumesActionsTest-1603869063 None] Creating volume 9540564d-6797-459a-a90b-85ef61a04527 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:52:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-15bd3139-d035-4d99-ae83-b9d049e57cda tempest-VolumesActionsTest-1603869063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:52:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-15bd3139-d035-4d99-ae83-b9d049e57cda tempest-VolumesActionsTest-1603869063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:52:58 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-15bd3139-d035-4d99-ae83-b9d049e57cda tempest-VolumesActionsTest-1603869063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:52:58 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-15bd3139-d035-4d99-ae83-b9d049e57cda tempest-VolumesActionsTest-1603869063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:52:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-15bd3139-d035-4d99-ae83-b9d049e57cda tempest-VolumesActionsTest-1603869063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:52:58 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-15bd3139-d035-4d99-ae83-b9d049e57cda tempest-VolumesActionsTest-1603869063 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:52:58 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-15bd3139-d035-4d99-ae83-b9d049e57cda tempest-VolumesActionsTest-1603869063 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:52:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-15bd3139-d035-4d99-ae83-b9d049e57cda tempest-VolumesActionsTest-1603869063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9540564d-6797-459a-a90b-85ef61a04527 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:52:58 devstack sudo[97304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9540564d-6797-459a-a90b-85ef61a04527 1073741824 Nov 06 17:52:58 devstack sudo[97304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:52:58 devstack sudo[97294]: pam_unix(sudo:session): session closed for user root Nov 06 17:52:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-383e1054-22f2-4a2a-bf94-699f6eba8bae tempest-VolumesExtendTest-1981556661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ded71664-2c42-46b4-92e7-7aa9e1438f6a" returned: 0 in 0.866s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:52:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-383e1054-22f2-4a2a-bf94-699f6eba8bae tempest-VolumesExtendTest-1981556661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ded71664-2c42-46b4-92e7-7aa9e1438f6a {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:52:58 devstack sudo[97306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ded71664-2c42-46b4-92e7-7aa9e1438f6a Nov 06 17:52:58 devstack sudo[97306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:52:58 devstack sudo[97306]: pam_unix(sudo:session): session closed for user root Nov 06 17:52:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-383e1054-22f2-4a2a-bf94-699f6eba8bae tempest-VolumesExtendTest-1981556661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ded71664-2c42-46b4-92e7-7aa9e1438f6a" returned: 0 in 0.335s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:52:58 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-383e1054-22f2-4a2a-bf94-699f6eba8bae tempest-VolumesExtendTest-1981556661 None] Lock "cinder-quobyte-ded71664-2c42-46b4-92e7-7aa9e1438f6a" released by "delete_volume" :: held 1.327s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:52:58 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-383e1054-22f2-4a2a-bf94-699f6eba8bae tempest-VolumesExtendTest-1981556661 None] Created reservations ['7930a2eb-bbb2-427e-bb3a-7e1ca5a6eb15', '2f839e2b-6fbb-4f9c-aab5-641afd6c9a03', 'd902dabc-bb50-402f-afc1-25bd5c91b57d', '8de510c1-1171-4985-a1ec-ed7cfc456f05'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:52:58 devstack sudo[97304]: pam_unix(sudo:session): session closed for user root Nov 06 17:52:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-15bd3139-d035-4d99-ae83-b9d049e57cda tempest-VolumesActionsTest-1603869063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9540564d-6797-459a-a90b-85ef61a04527 1073741824" returned: 0 in 0.571s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:52:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-383e1054-22f2-4a2a-bf94-699f6eba8bae tempest-VolumesExtendTest-1981556661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:52:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-383e1054-22f2-4a2a-bf94-699f6eba8bae tempest-VolumesExtendTest-1981556661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:52:58 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-383e1054-22f2-4a2a-bf94-699f6eba8bae tempest-VolumesExtendTest-1981556661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:52:58 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-383e1054-22f2-4a2a-bf94-699f6eba8bae tempest-VolumesExtendTest-1981556661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:52:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-383e1054-22f2-4a2a-bf94-699f6eba8bae tempest-VolumesExtendTest-1981556661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:52:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-383e1054-22f2-4a2a-bf94-699f6eba8bae tempest-VolumesExtendTest-1981556661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:52:58 devstack sudo[97315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:52:58 devstack sudo[97315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:52:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-15bd3139-d035-4d99-ae83-b9d049e57cda tempest-VolumesActionsTest-1603869063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9540564d-6797-459a-a90b-85ef61a04527 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:52:58 devstack sudo[97318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9540564d-6797-459a-a90b-85ef61a04527 Nov 06 17:52:58 devstack sudo[97318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:52:59 devstack sudo[97315]: pam_unix(sudo:session): session closed for user root Nov 06 17:52:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-383e1054-22f2-4a2a-bf94-699f6eba8bae tempest-VolumesExtendTest-1981556661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.332s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:52:59 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-383e1054-22f2-4a2a-bf94-699f6eba8bae tempest-VolumesExtendTest-1981556661 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:52:59 devstack sudo[97318]: pam_unix(sudo:session): session closed for user root Nov 06 17:52:59 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-383e1054-22f2-4a2a-bf94-699f6eba8bae tempest-VolumesExtendTest-1981556661 None] Deleted volume successfully. Nov 06 17:52:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-15bd3139-d035-4d99-ae83-b9d049e57cda tempest-VolumesActionsTest-1603869063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9540564d-6797-459a-a90b-85ef61a04527" returned: 0 in 0.303s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:52:59 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-15bd3139-d035-4d99-ae83-b9d049e57cda tempest-VolumesActionsTest-1603869063 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:52:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-15bd3139-d035-4d99-ae83-b9d049e57cda tempest-VolumesActionsTest-1603869063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:52:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-15bd3139-d035-4d99-ae83-b9d049e57cda tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4c4d4c3-1c00-4708-ad07-6fb36a754a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9540564d-6797-459a-a90b-85ef61a04527', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:52:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-15bd3139-d035-4d99-ae83-b9d049e57cda tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9da71be1-ff9a-4e2b-b5fe-b0da0638fcd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:52:59 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-383e1054-22f2-4a2a-bf94-699f6eba8bae tempest-VolumesExtendTest-1981556661 None] Lock "cinder-ded71664-2c42-46b4-92e7-7aa9e1438f6a-delete_volume" released by "delete_volume" :: held 2.029s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:52:59 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-15bd3139-d035-4d99-ae83-b9d049e57cda tempest-VolumesActionsTest-1603869063 None] Volume volume-9540564d-6797-459a-a90b-85ef61a04527 (9540564d-6797-459a-a90b-85ef61a04527): created successfully Nov 06 17:52:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-15bd3139-d035-4d99-ae83-b9d049e57cda tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9da71be1-ff9a-4e2b-b5fe-b0da0638fcd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:52:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-15bd3139-d035-4d99-ae83-b9d049e57cda tempest-VolumesActionsTest-1603869063 None] Flow 'volume_create_manager' (4b08dc3f-c7fa-4f4a-a0cc-64135ca2b127) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:52:59 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-15bd3139-d035-4d99-ae83-b9d049e57cda tempest-VolumesActionsTest-1603869063 None] Created volume successfully. Nov 06 17:53:00 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-78363756-c0ba-4a50-9036-4170173d3a10 tempest-ServersNegativeTestJSON-47159344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:53:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-78363756-c0ba-4a50-9036-4170173d3a10 tempest-ServersNegativeTestJSON-47159344 None] Flow 'volume_create_manager' (278d1518-493e-464a-9a13-c90859854f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:53:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-78363756-c0ba-4a50-9036-4170173d3a10 tempest-ServersNegativeTestJSON-47159344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e15b5ae6-635c-42c7-a15f-4213b696c053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-78363756-c0ba-4a50-9036-4170173d3a10 tempest-ServersNegativeTestJSON-47159344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e15b5ae6-635c-42c7-a15f-4213b696c053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:53:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-48309358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a38467af-2be7-4014-962e-274410ac1e7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae173e94c91f48e09a3e9358ea7750eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:53:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:53:00Z,use_quota=True,user_id='1fe71a407a554f62a547a10ec0127dd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-78363756-c0ba-4a50-9036-4170173d3a10 tempest-ServersNegativeTestJSON-47159344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c05a1541-2241-418e-8f02-fb939a148ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-78363756-c0ba-4a50-9036-4170173d3a10 tempest-ServersNegativeTestJSON-47159344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c05a1541-2241-418e-8f02-fb939a148ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-78363756-c0ba-4a50-9036-4170173d3a10 tempest-ServersNegativeTestJSON-47159344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09a577ae-c7c7-4f0f-9e58-7d5dc5573629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-78363756-c0ba-4a50-9036-4170173d3a10 tempest-ServersNegativeTestJSON-47159344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09a577ae-c7c7-4f0f-9e58-7d5dc5573629) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a38467af-2be7-4014-962e-274410ac1e7c', 'volume_name': 'volume-a38467af-2be7-4014-962e-274410ac1e7c', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-78363756-c0ba-4a50-9036-4170173d3a10 tempest-ServersNegativeTestJSON-47159344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5483f578-aae4-4099-9fc3-891b157753a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-78363756-c0ba-4a50-9036-4170173d3a10 tempest-ServersNegativeTestJSON-47159344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5483f578-aae4-4099-9fc3-891b157753a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-78363756-c0ba-4a50-9036-4170173d3a10 tempest-ServersNegativeTestJSON-47159344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0c760c4-48fb-448b-976f-07531e2aa88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:00 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-78363756-c0ba-4a50-9036-4170173d3a10 tempest-ServersNegativeTestJSON-47159344 None] Volume a38467af-2be7-4014-962e-274410ac1e7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a38467af-2be7-4014-962e-274410ac1e7c', 'volume_size': 1} Nov 06 17:53:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-78363756-c0ba-4a50-9036-4170173d3a10 tempest-ServersNegativeTestJSON-47159344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:53:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-78363756-c0ba-4a50-9036-4170173d3a10 tempest-ServersNegativeTestJSON-47159344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:53:00 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-78363756-c0ba-4a50-9036-4170173d3a10 tempest-ServersNegativeTestJSON-47159344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:53:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-48309358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a38467af-2be7-4014-962e-274410ac1e7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae173e94c91f48e09a3e9358ea7750eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:53:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:53:00Z,use_quota=True,user_id='1fe71a407a554f62a547a10ec0127dd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:53:00 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-78363756-c0ba-4a50-9036-4170173d3a10 tempest-ServersNegativeTestJSON-47159344 None] Creating volume a38467af-2be7-4014-962e-274410ac1e7c {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:53:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-78363756-c0ba-4a50-9036-4170173d3a10 tempest-ServersNegativeTestJSON-47159344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:53:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-78363756-c0ba-4a50-9036-4170173d3a10 tempest-ServersNegativeTestJSON-47159344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:53:00 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-78363756-c0ba-4a50-9036-4170173d3a10 tempest-ServersNegativeTestJSON-47159344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:53:00 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-78363756-c0ba-4a50-9036-4170173d3a10 tempest-ServersNegativeTestJSON-47159344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:53:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-78363756-c0ba-4a50-9036-4170173d3a10 tempest-ServersNegativeTestJSON-47159344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:53:00 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-78363756-c0ba-4a50-9036-4170173d3a10 tempest-ServersNegativeTestJSON-47159344 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:53:00 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-78363756-c0ba-4a50-9036-4170173d3a10 tempest-ServersNegativeTestJSON-47159344 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:53:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-78363756-c0ba-4a50-9036-4170173d3a10 tempest-ServersNegativeTestJSON-47159344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a38467af-2be7-4014-962e-274410ac1e7c 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:00 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1b038ed3-4559-47f7-b387-c8b88778334e tempest-VolumesActionsTest-1451753164 None] Acquiring lock "cinder-9540564d-6797-459a-a90b-85ef61a04527-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:53:00 devstack sudo[97322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a38467af-2be7-4014-962e-274410ac1e7c 1073741824 Nov 06 17:53:00 devstack sudo[97322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:00 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1b038ed3-4559-47f7-b387-c8b88778334e tempest-VolumesActionsTest-1451753164 None] Lock "cinder-9540564d-6797-459a-a90b-85ef61a04527-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:53:00 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1b038ed3-4559-47f7-b387-c8b88778334e tempest-VolumesActionsTest-1451753164 None] Acquiring lock "cinder-quobyte-9540564d-6797-459a-a90b-85ef61a04527" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:53:00 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1b038ed3-4559-47f7-b387-c8b88778334e tempest-VolumesActionsTest-1451753164 None] Lock "cinder-quobyte-9540564d-6797-459a-a90b-85ef61a04527" acquired by "delete_volume" :: waited 0.041s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:53:00 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cdbda58-e373-40a2-8e1a-97b7f340d4fb]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:53:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1b038ed3-4559-47f7-b387-c8b88778334e tempest-VolumesActionsTest-1451753164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9540564d-6797-459a-a90b-85ef61a04527 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:00 devstack sudo[97325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9540564d-6797-459a-a90b-85ef61a04527 Nov 06 17:53:00 devstack sudo[97325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:01 devstack sudo[97322]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-78363756-c0ba-4a50-9036-4170173d3a10 tempest-ServersNegativeTestJSON-47159344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a38467af-2be7-4014-962e-274410ac1e7c 1073741824" returned: 0 in 0.750s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-78363756-c0ba-4a50-9036-4170173d3a10 tempest-ServersNegativeTestJSON-47159344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a38467af-2be7-4014-962e-274410ac1e7c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:01 devstack sudo[97346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a38467af-2be7-4014-962e-274410ac1e7c Nov 06 17:53:01 devstack sudo[97346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:01 devstack sudo[97325]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1b038ed3-4559-47f7-b387-c8b88778334e tempest-VolumesActionsTest-1451753164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9540564d-6797-459a-a90b-85ef61a04527" returned: 0 in 0.611s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1b038ed3-4559-47f7-b387-c8b88778334e tempest-VolumesActionsTest-1451753164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9540564d-6797-459a-a90b-85ef61a04527 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:01 devstack sudo[97348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9540564d-6797-459a-a90b-85ef61a04527 Nov 06 17:53:01 devstack sudo[97348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:01 devstack sudo[97346]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-78363756-c0ba-4a50-9036-4170173d3a10 tempest-ServersNegativeTestJSON-47159344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a38467af-2be7-4014-962e-274410ac1e7c" returned: 0 in 0.385s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-78363756-c0ba-4a50-9036-4170173d3a10 tempest-ServersNegativeTestJSON-47159344 None] <== create_volume: return (1217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:53:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-78363756-c0ba-4a50-9036-4170173d3a10 tempest-ServersNegativeTestJSON-47159344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.225s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:53:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-78363756-c0ba-4a50-9036-4170173d3a10 tempest-ServersNegativeTestJSON-47159344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0c760c4-48fb-448b-976f-07531e2aa88d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a38467af-2be7-4014-962e-274410ac1e7c', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-78363756-c0ba-4a50-9036-4170173d3a10 tempest-ServersNegativeTestJSON-47159344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1019af9-091f-4bd3-98ff-a0d6eb60bb49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:01 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-78363756-c0ba-4a50-9036-4170173d3a10 tempest-ServersNegativeTestJSON-47159344 None] Volume volume-a38467af-2be7-4014-962e-274410ac1e7c (a38467af-2be7-4014-962e-274410ac1e7c): created successfully Nov 06 17:53:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-78363756-c0ba-4a50-9036-4170173d3a10 tempest-ServersNegativeTestJSON-47159344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1019af9-091f-4bd3-98ff-a0d6eb60bb49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-78363756-c0ba-4a50-9036-4170173d3a10 tempest-ServersNegativeTestJSON-47159344 None] Flow 'volume_create_manager' (278d1518-493e-464a-9a13-c90859854f97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:53:01 devstack sudo[97348]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:01 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-78363756-c0ba-4a50-9036-4170173d3a10 tempest-ServersNegativeTestJSON-47159344 None] Created volume successfully. Nov 06 17:53:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1b038ed3-4559-47f7-b387-c8b88778334e tempest-VolumesActionsTest-1451753164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9540564d-6797-459a-a90b-85ef61a04527" returned: 0 in 0.477s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:01 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1b038ed3-4559-47f7-b387-c8b88778334e tempest-VolumesActionsTest-1451753164 None] Lock "cinder-quobyte-9540564d-6797-459a-a90b-85ef61a04527" released by "delete_volume" :: held 1.167s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:53:01 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-1b038ed3-4559-47f7-b387-c8b88778334e tempest-VolumesActionsTest-1451753164 None] Created reservations ['08bd2a74-fe27-4b5e-8629-145ec29f2deb', '716ae516-486e-4642-80bb-8581e9935411', 'a295778f-7ccd-4c06-a7df-20174875e617', '88cf47d0-db1c-4c8c-b58d-786621afb197'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:53:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1b038ed3-4559-47f7-b387-c8b88778334e tempest-VolumesActionsTest-1451753164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:53:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1b038ed3-4559-47f7-b387-c8b88778334e tempest-VolumesActionsTest-1451753164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:53:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1b038ed3-4559-47f7-b387-c8b88778334e tempest-VolumesActionsTest-1451753164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:53:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1b038ed3-4559-47f7-b387-c8b88778334e tempest-VolumesActionsTest-1451753164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:53:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1b038ed3-4559-47f7-b387-c8b88778334e tempest-VolumesActionsTest-1451753164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:53:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1b038ed3-4559-47f7-b387-c8b88778334e tempest-VolumesActionsTest-1451753164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:01 devstack sudo[97359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:53:01 devstack sudo[97359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:02 devstack sudo[97359]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1b038ed3-4559-47f7-b387-c8b88778334e tempest-VolumesActionsTest-1451753164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.295s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:02 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-1b038ed3-4559-47f7-b387-c8b88778334e tempest-VolumesActionsTest-1451753164 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:53:02 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-1b038ed3-4559-47f7-b387-c8b88778334e tempest-VolumesActionsTest-1451753164 None] Deleted volume successfully. Nov 06 17:53:02 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1b038ed3-4559-47f7-b387-c8b88778334e tempest-VolumesActionsTest-1451753164 None] Lock "cinder-9540564d-6797-459a-a90b-85ef61a04527-delete_volume" released by "delete_volume" :: held 1.850s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:53:03 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-b19e5a9b-ae50-4ad1-a427-270579af8cd2 tempest-VolumesActionsTest-1603869063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:53:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b19e5a9b-ae50-4ad1-a427-270579af8cd2 tempest-VolumesActionsTest-1603869063 None] Flow 'volume_create_manager' (a6a89452-1a64-4624-89ad-4be63acb78e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:53:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b19e5a9b-ae50-4ad1-a427-270579af8cd2 tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90eaebfb-ab12-486b-835e-d980bbe5f744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b19e5a9b-ae50-4ad1-a427-270579af8cd2 tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90eaebfb-ab12-486b-835e-d980bbe5f744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:53:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1936873685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfb853b0-c412-4138-81e8-ad963189dd75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61a32a6744ec449280a9b0af8e2adc4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:53:03Z,use_quota=True,user_id='6a1654f7f8c04863834119a414f584e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b19e5a9b-ae50-4ad1-a427-270579af8cd2 tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99c74db8-f3a9-4597-af99-ab24f0b8bb16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b19e5a9b-ae50-4ad1-a427-270579af8cd2 tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99c74db8-f3a9-4597-af99-ab24f0b8bb16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b19e5a9b-ae50-4ad1-a427-270579af8cd2 tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57075d6c-aacc-4d5e-a2b0-712751f559db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b19e5a9b-ae50-4ad1-a427-270579af8cd2 tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57075d6c-aacc-4d5e-a2b0-712751f559db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfb853b0-c412-4138-81e8-ad963189dd75', 'volume_name': 'volume-bfb853b0-c412-4138-81e8-ad963189dd75', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b19e5a9b-ae50-4ad1-a427-270579af8cd2 tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0db446e-5b18-490c-b800-20c44de263ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b19e5a9b-ae50-4ad1-a427-270579af8cd2 tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0db446e-5b18-490c-b800-20c44de263ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b19e5a9b-ae50-4ad1-a427-270579af8cd2 tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eb58c63-207e-4685-b107-9dfbf86ccff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:03 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-b19e5a9b-ae50-4ad1-a427-270579af8cd2 tempest-VolumesActionsTest-1603869063 None] Volume bfb853b0-c412-4138-81e8-ad963189dd75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfb853b0-c412-4138-81e8-ad963189dd75', 'volume_size': 1} Nov 06 17:53:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b19e5a9b-ae50-4ad1-a427-270579af8cd2 tempest-VolumesActionsTest-1603869063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:53:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b19e5a9b-ae50-4ad1-a427-270579af8cd2 tempest-VolumesActionsTest-1603869063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:53:03 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b19e5a9b-ae50-4ad1-a427-270579af8cd2 tempest-VolumesActionsTest-1603869063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:53:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1936873685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfb853b0-c412-4138-81e8-ad963189dd75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61a32a6744ec449280a9b0af8e2adc4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:53:03Z,use_quota=True,user_id='6a1654f7f8c04863834119a414f584e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:53:03 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-b19e5a9b-ae50-4ad1-a427-270579af8cd2 tempest-VolumesActionsTest-1603869063 None] Creating volume bfb853b0-c412-4138-81e8-ad963189dd75 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:53:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b19e5a9b-ae50-4ad1-a427-270579af8cd2 tempest-VolumesActionsTest-1603869063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:53:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b19e5a9b-ae50-4ad1-a427-270579af8cd2 tempest-VolumesActionsTest-1603869063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:53:03 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b19e5a9b-ae50-4ad1-a427-270579af8cd2 tempest-VolumesActionsTest-1603869063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:53:03 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b19e5a9b-ae50-4ad1-a427-270579af8cd2 tempest-VolumesActionsTest-1603869063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:53:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b19e5a9b-ae50-4ad1-a427-270579af8cd2 tempest-VolumesActionsTest-1603869063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:53:03 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b19e5a9b-ae50-4ad1-a427-270579af8cd2 tempest-VolumesActionsTest-1603869063 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:53:03 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-b19e5a9b-ae50-4ad1-a427-270579af8cd2 tempest-VolumesActionsTest-1603869063 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:53:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b19e5a9b-ae50-4ad1-a427-270579af8cd2 tempest-VolumesActionsTest-1603869063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bfb853b0-c412-4138-81e8-ad963189dd75 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:03 devstack sudo[97363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bfb853b0-c412-4138-81e8-ad963189dd75 1073741824 Nov 06 17:53:03 devstack sudo[97363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:04 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-9013a270-7296-4300-940c-474218b6c424 tempest-ServersNegativeTestJSON-47159344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:53:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9013a270-7296-4300-940c-474218b6c424 tempest-ServersNegativeTestJSON-47159344 None] Flow 'volume_create_manager' (7df98d0b-5420-4db1-ad51-4a724728acea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:53:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9013a270-7296-4300-940c-474218b6c424 tempest-ServersNegativeTestJSON-47159344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59207499-0d42-49f7-bd90-b3b0d645c8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9013a270-7296-4300-940c-474218b6c424 tempest-ServersNegativeTestJSON-47159344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59207499-0d42-49f7-bd90-b3b0d645c8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1199108314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d94412c-ea08-4681-8b32-8d165bef9665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae173e94c91f48e09a3e9358ea7750eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:53:04Z,use_quota=True,user_id='1fe71a407a554f62a547a10ec0127dd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9013a270-7296-4300-940c-474218b6c424 tempest-ServersNegativeTestJSON-47159344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18eb0584-2375-41f1-a4f4-d20e304e9284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9013a270-7296-4300-940c-474218b6c424 tempest-ServersNegativeTestJSON-47159344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18eb0584-2375-41f1-a4f4-d20e304e9284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9013a270-7296-4300-940c-474218b6c424 tempest-ServersNegativeTestJSON-47159344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fef1179-2769-497f-bce8-a4c91e3cb74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9013a270-7296-4300-940c-474218b6c424 tempest-ServersNegativeTestJSON-47159344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fef1179-2769-497f-bce8-a4c91e3cb74b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d94412c-ea08-4681-8b32-8d165bef9665', 'volume_name': 'volume-4d94412c-ea08-4681-8b32-8d165bef9665', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9013a270-7296-4300-940c-474218b6c424 tempest-ServersNegativeTestJSON-47159344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63f4aa35-1e5c-4da9-83ae-b5148b9d42a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9013a270-7296-4300-940c-474218b6c424 tempest-ServersNegativeTestJSON-47159344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63f4aa35-1e5c-4da9-83ae-b5148b9d42a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9013a270-7296-4300-940c-474218b6c424 tempest-ServersNegativeTestJSON-47159344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bac3ffaf-d607-44f0-be4b-4e616ad881ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:04 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-9013a270-7296-4300-940c-474218b6c424 tempest-ServersNegativeTestJSON-47159344 None] Volume 4d94412c-ea08-4681-8b32-8d165bef9665: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d94412c-ea08-4681-8b32-8d165bef9665', 'volume_size': 1} Nov 06 17:53:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9013a270-7296-4300-940c-474218b6c424 tempest-ServersNegativeTestJSON-47159344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:53:04 devstack sudo[97363]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b19e5a9b-ae50-4ad1-a427-270579af8cd2 tempest-VolumesActionsTest-1603869063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bfb853b0-c412-4138-81e8-ad963189dd75 1073741824" returned: 0 in 1.022s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b19e5a9b-ae50-4ad1-a427-270579af8cd2 tempest-VolumesActionsTest-1603869063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bfb853b0-c412-4138-81e8-ad963189dd75 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:04 devstack sudo[97409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bfb853b0-c412-4138-81e8-ad963189dd75 Nov 06 17:53:04 devstack sudo[97409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:05 devstack sudo[97409]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b19e5a9b-ae50-4ad1-a427-270579af8cd2 tempest-VolumesActionsTest-1603869063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bfb853b0-c412-4138-81e8-ad963189dd75" returned: 0 in 0.577s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:05 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b19e5a9b-ae50-4ad1-a427-270579af8cd2 tempest-VolumesActionsTest-1603869063 None] <== create_volume: return (1666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:53:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b19e5a9b-ae50-4ad1-a427-270579af8cd2 tempest-VolumesActionsTest-1603869063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.673s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:53:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9013a270-7296-4300-940c-474218b6c424 tempest-ServersNegativeTestJSON-47159344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.659s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:53:05 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9013a270-7296-4300-940c-474218b6c424 tempest-ServersNegativeTestJSON-47159344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1199108314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d94412c-ea08-4681-8b32-8d165bef9665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae173e94c91f48e09a3e9358ea7750eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:53:04Z,use_quota=True,user_id='1fe71a407a554f62a547a10ec0127dd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:53:05 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-9013a270-7296-4300-940c-474218b6c424 tempest-ServersNegativeTestJSON-47159344 None] Creating volume 4d94412c-ea08-4681-8b32-8d165bef9665 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:53:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9013a270-7296-4300-940c-474218b6c424 tempest-ServersNegativeTestJSON-47159344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:53:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9013a270-7296-4300-940c-474218b6c424 tempest-ServersNegativeTestJSON-47159344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:53:05 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9013a270-7296-4300-940c-474218b6c424 tempest-ServersNegativeTestJSON-47159344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:53:05 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9013a270-7296-4300-940c-474218b6c424 tempest-ServersNegativeTestJSON-47159344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:53:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9013a270-7296-4300-940c-474218b6c424 tempest-ServersNegativeTestJSON-47159344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:53:05 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9013a270-7296-4300-940c-474218b6c424 tempest-ServersNegativeTestJSON-47159344 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:53:05 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-9013a270-7296-4300-940c-474218b6c424 tempest-ServersNegativeTestJSON-47159344 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:53:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9013a270-7296-4300-940c-474218b6c424 tempest-ServersNegativeTestJSON-47159344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4d94412c-ea08-4681-8b32-8d165bef9665 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:05 devstack sudo[97434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4d94412c-ea08-4681-8b32-8d165bef9665 1073741824 Nov 06 17:53:05 devstack sudo[97434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b19e5a9b-ae50-4ad1-a427-270579af8cd2 tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eb58c63-207e-4685-b107-9dfbf86ccff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfb853b0-c412-4138-81e8-ad963189dd75', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b19e5a9b-ae50-4ad1-a427-270579af8cd2 tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3919bf5-6e0c-4090-a9c4-9928742e4070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:05 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-b19e5a9b-ae50-4ad1-a427-270579af8cd2 tempest-VolumesActionsTest-1603869063 None] Volume volume-bfb853b0-c412-4138-81e8-ad963189dd75 (bfb853b0-c412-4138-81e8-ad963189dd75): created successfully Nov 06 17:53:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b19e5a9b-ae50-4ad1-a427-270579af8cd2 tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3919bf5-6e0c-4090-a9c4-9928742e4070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b19e5a9b-ae50-4ad1-a427-270579af8cd2 tempest-VolumesActionsTest-1603869063 None] Flow 'volume_create_manager' (a6a89452-1a64-4624-89ad-4be63acb78e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:53:05 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-b19e5a9b-ae50-4ad1-a427-270579af8cd2 tempest-VolumesActionsTest-1603869063 None] Created volume successfully. Nov 06 17:53:06 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ce4f1d0-031c-4315-98be-911621f3d807 tempest-VolumesGetTest-154484293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:53:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5ce4f1d0-031c-4315-98be-911621f3d807 tempest-VolumesGetTest-154484293 None] Flow 'volume_create_manager' (e26c2b68-3cc0-4cdf-b2a0-7273491ba84d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:53:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5ce4f1d0-031c-4315-98be-911621f3d807 tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b98928a7-91a4-480b-8a24-c831215d9685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5ce4f1d0-031c-4315-98be-911621f3d807 tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b98928a7-91a4-480b-8a24-c831215d9685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:53:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-376762610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=086e6518-c381-44bd-998d-3603206b9782,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='83b317dc0b0f4329aa3bf9863f7ddd5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:53:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:53:06Z,use_quota=True,user_id='ea09cba9a9d94ad6a595472e62d9a066',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5ce4f1d0-031c-4315-98be-911621f3d807 tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfb67fdd-42f8-4786-b0f3-edce4333b248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5ce4f1d0-031c-4315-98be-911621f3d807 tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfb67fdd-42f8-4786-b0f3-edce4333b248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5ce4f1d0-031c-4315-98be-911621f3d807 tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c274ad0-13b5-4b12-b2b8-42468b31f8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5ce4f1d0-031c-4315-98be-911621f3d807 tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c274ad0-13b5-4b12-b2b8-42468b31f8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '086e6518-c381-44bd-998d-3603206b9782', 'volume_name': 'volume-086e6518-c381-44bd-998d-3603206b9782', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5ce4f1d0-031c-4315-98be-911621f3d807 tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb0db12d-c710-4a5c-a144-3b7ca77d1098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5ce4f1d0-031c-4315-98be-911621f3d807 tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb0db12d-c710-4a5c-a144-3b7ca77d1098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5ce4f1d0-031c-4315-98be-911621f3d807 tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33503cfc-5441-47ce-96b5-0200ede32964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:06 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-5ce4f1d0-031c-4315-98be-911621f3d807 tempest-VolumesGetTest-154484293 None] Volume 086e6518-c381-44bd-998d-3603206b9782: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-086e6518-c381-44bd-998d-3603206b9782', 'volume_size': 1} Nov 06 17:53:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5ce4f1d0-031c-4315-98be-911621f3d807 tempest-VolumesGetTest-154484293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:53:06 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-3499045e-0ba0-478c-bbff-e32d82ffe249 tempest-VolumesActionsTest-1451753164 None] Acquiring lock "cinder-bfb853b0-c412-4138-81e8-ad963189dd75-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:53:06 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-3499045e-0ba0-478c-bbff-e32d82ffe249 tempest-VolumesActionsTest-1451753164 None] Lock "cinder-bfb853b0-c412-4138-81e8-ad963189dd75-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:53:06 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-3499045e-0ba0-478c-bbff-e32d82ffe249 tempest-VolumesActionsTest-1451753164 None] Acquiring lock "cinder-quobyte-bfb853b0-c412-4138-81e8-ad963189dd75" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:53:06 devstack sudo[97434]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9013a270-7296-4300-940c-474218b6c424 tempest-ServersNegativeTestJSON-47159344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4d94412c-ea08-4681-8b32-8d165bef9665 1073741824" returned: 0 in 0.958s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:06 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-3499045e-0ba0-478c-bbff-e32d82ffe249 tempest-VolumesActionsTest-1451753164 None] Lock "cinder-quobyte-bfb853b0-c412-4138-81e8-ad963189dd75" acquired by "delete_volume" :: waited 0.059s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:53:06 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b15ec25-5189-45f9-80a4-039a47bfe3ef]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:53:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3499045e-0ba0-478c-bbff-e32d82ffe249 tempest-VolumesActionsTest-1451753164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bfb853b0-c412-4138-81e8-ad963189dd75 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9013a270-7296-4300-940c-474218b6c424 tempest-ServersNegativeTestJSON-47159344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4d94412c-ea08-4681-8b32-8d165bef9665 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:06 devstack sudo[97447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4d94412c-ea08-4681-8b32-8d165bef9665 Nov 06 17:53:06 devstack sudo[97447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:06 devstack sudo[97446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bfb853b0-c412-4138-81e8-ad963189dd75 Nov 06 17:53:06 devstack sudo[97446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:06 devstack sudo[97447]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9013a270-7296-4300-940c-474218b6c424 tempest-ServersNegativeTestJSON-47159344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4d94412c-ea08-4681-8b32-8d165bef9665" returned: 0 in 0.355s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9013a270-7296-4300-940c-474218b6c424 tempest-ServersNegativeTestJSON-47159344 None] <== create_volume: return (1468ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:53:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9013a270-7296-4300-940c-474218b6c424 tempest-ServersNegativeTestJSON-47159344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.479s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:53:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5ce4f1d0-031c-4315-98be-911621f3d807 tempest-VolumesGetTest-154484293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.650s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:53:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5ce4f1d0-031c-4315-98be-911621f3d807 tempest-VolumesGetTest-154484293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:53:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-376762610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=086e6518-c381-44bd-998d-3603206b9782,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='83b317dc0b0f4329aa3bf9863f7ddd5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:53:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:53:06Z,use_quota=True,user_id='ea09cba9a9d94ad6a595472e62d9a066',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:53:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-5ce4f1d0-031c-4315-98be-911621f3d807 tempest-VolumesGetTest-154484293 None] Creating volume 086e6518-c381-44bd-998d-3603206b9782 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:53:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5ce4f1d0-031c-4315-98be-911621f3d807 tempest-VolumesGetTest-154484293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:53:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5ce4f1d0-031c-4315-98be-911621f3d807 tempest-VolumesGetTest-154484293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:53:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5ce4f1d0-031c-4315-98be-911621f3d807 tempest-VolumesGetTest-154484293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:53:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5ce4f1d0-031c-4315-98be-911621f3d807 tempest-VolumesGetTest-154484293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:53:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5ce4f1d0-031c-4315-98be-911621f3d807 tempest-VolumesGetTest-154484293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:53:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5ce4f1d0-031c-4315-98be-911621f3d807 tempest-VolumesGetTest-154484293 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:53:06 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-5ce4f1d0-031c-4315-98be-911621f3d807 tempest-VolumesGetTest-154484293 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:53:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5ce4f1d0-031c-4315-98be-911621f3d807 tempest-VolumesGetTest-154484293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-086e6518-c381-44bd-998d-3603206b9782 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:06 devstack sudo[97453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-086e6518-c381-44bd-998d-3603206b9782 1073741824 Nov 06 17:53:06 devstack sudo[97453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9013a270-7296-4300-940c-474218b6c424 tempest-ServersNegativeTestJSON-47159344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bac3ffaf-d607-44f0-be4b-4e616ad881ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d94412c-ea08-4681-8b32-8d165bef9665', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9013a270-7296-4300-940c-474218b6c424 tempest-ServersNegativeTestJSON-47159344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46c21ee3-65a2-46a4-910b-9c5865237128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:06 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-9013a270-7296-4300-940c-474218b6c424 tempest-ServersNegativeTestJSON-47159344 None] Volume volume-4d94412c-ea08-4681-8b32-8d165bef9665 (4d94412c-ea08-4681-8b32-8d165bef9665): created successfully Nov 06 17:53:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9013a270-7296-4300-940c-474218b6c424 tempest-ServersNegativeTestJSON-47159344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46c21ee3-65a2-46a4-910b-9c5865237128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9013a270-7296-4300-940c-474218b6c424 tempest-ServersNegativeTestJSON-47159344 None] Flow 'volume_create_manager' (7df98d0b-5420-4db1-ad51-4a724728acea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:53:06 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-9013a270-7296-4300-940c-474218b6c424 tempest-ServersNegativeTestJSON-47159344 None] Created volume successfully. Nov 06 17:53:06 devstack sudo[97446]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3499045e-0ba0-478c-bbff-e32d82ffe249 tempest-VolumesActionsTest-1451753164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bfb853b0-c412-4138-81e8-ad963189dd75" returned: 0 in 0.596s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3499045e-0ba0-478c-bbff-e32d82ffe249 tempest-VolumesActionsTest-1451753164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bfb853b0-c412-4138-81e8-ad963189dd75 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:07 devstack sudo[97456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bfb853b0-c412-4138-81e8-ad963189dd75 Nov 06 17:53:07 devstack sudo[97456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:07 devstack sudo[97456]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3499045e-0ba0-478c-bbff-e32d82ffe249 tempest-VolumesActionsTest-1451753164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bfb853b0-c412-4138-81e8-ad963189dd75" returned: 0 in 0.291s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:07 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-3499045e-0ba0-478c-bbff-e32d82ffe249 tempest-VolumesActionsTest-1451753164 None] Lock "cinder-quobyte-bfb853b0-c412-4138-81e8-ad963189dd75" released by "delete_volume" :: held 0.947s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:53:07 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-3499045e-0ba0-478c-bbff-e32d82ffe249 tempest-VolumesActionsTest-1451753164 None] Created reservations ['b0e3ccbc-292c-48f1-ae6b-a5cf7e441684', 'f8e1d9a1-0312-4ab3-8c97-0fefd319f54f', '72c6b7b8-a740-4696-a5a0-40fd00337fbd', 'b7e2e3c1-1963-4a2f-b868-c2bc0c8368ee'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:53:07 devstack sudo[97453]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5ce4f1d0-031c-4315-98be-911621f3d807 tempest-VolumesGetTest-154484293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-086e6518-c381-44bd-998d-3603206b9782 1073741824" returned: 0 in 0.674s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3499045e-0ba0-478c-bbff-e32d82ffe249 tempest-VolumesActionsTest-1451753164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:53:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3499045e-0ba0-478c-bbff-e32d82ffe249 tempest-VolumesActionsTest-1451753164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:53:07 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3499045e-0ba0-478c-bbff-e32d82ffe249 tempest-VolumesActionsTest-1451753164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:53:07 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3499045e-0ba0-478c-bbff-e32d82ffe249 tempest-VolumesActionsTest-1451753164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:53:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3499045e-0ba0-478c-bbff-e32d82ffe249 tempest-VolumesActionsTest-1451753164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:53:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3499045e-0ba0-478c-bbff-e32d82ffe249 tempest-VolumesActionsTest-1451753164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:07 devstack sudo[97463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:53:07 devstack sudo[97463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5ce4f1d0-031c-4315-98be-911621f3d807 tempest-VolumesGetTest-154484293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-086e6518-c381-44bd-998d-3603206b9782 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:07 devstack sudo[97465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-086e6518-c381-44bd-998d-3603206b9782 Nov 06 17:53:07 devstack sudo[97465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:07 devstack sudo[97463]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3499045e-0ba0-478c-bbff-e32d82ffe249 tempest-VolumesActionsTest-1451753164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.369s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:07 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-3499045e-0ba0-478c-bbff-e32d82ffe249 tempest-VolumesActionsTest-1451753164 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:53:07 devstack sudo[97465]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:07 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-3499045e-0ba0-478c-bbff-e32d82ffe249 tempest-VolumesActionsTest-1451753164 None] Deleted volume successfully. Nov 06 17:53:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5ce4f1d0-031c-4315-98be-911621f3d807 tempest-VolumesGetTest-154484293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-086e6518-c381-44bd-998d-3603206b9782" returned: 0 in 0.315s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:07 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5ce4f1d0-031c-4315-98be-911621f3d807 tempest-VolumesGetTest-154484293 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:53:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5ce4f1d0-031c-4315-98be-911621f3d807 tempest-VolumesGetTest-154484293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:53:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5ce4f1d0-031c-4315-98be-911621f3d807 tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33503cfc-5441-47ce-96b5-0200ede32964) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-086e6518-c381-44bd-998d-3603206b9782', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5ce4f1d0-031c-4315-98be-911621f3d807 tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68e319fb-2276-447a-acb3-14b47714b4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:07 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-3499045e-0ba0-478c-bbff-e32d82ffe249 tempest-VolumesActionsTest-1451753164 None] Lock "cinder-bfb853b0-c412-4138-81e8-ad963189dd75-delete_volume" released by "delete_volume" :: held 1.772s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:53:07 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-5ce4f1d0-031c-4315-98be-911621f3d807 tempest-VolumesGetTest-154484293 None] Volume volume-086e6518-c381-44bd-998d-3603206b9782 (086e6518-c381-44bd-998d-3603206b9782): created successfully Nov 06 17:53:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5ce4f1d0-031c-4315-98be-911621f3d807 tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68e319fb-2276-447a-acb3-14b47714b4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5ce4f1d0-031c-4315-98be-911621f3d807 tempest-VolumesGetTest-154484293 None] Flow 'volume_create_manager' (e26c2b68-3cc0-4cdf-b2a0-7273491ba84d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:53:07 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-5ce4f1d0-031c-4315-98be-911621f3d807 tempest-VolumesGetTest-154484293 None] Created volume successfully. Nov 06 17:53:08 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1cadce2e-ccc5-4ba6-8835-9d91d948042a tempest-ServersNegativeTestJSON-47159344 None] Acquiring lock "cinder-4d94412c-ea08-4681-8b32-8d165bef9665-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:53:08 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1cadce2e-ccc5-4ba6-8835-9d91d948042a tempest-ServersNegativeTestJSON-47159344 None] Lock "cinder-4d94412c-ea08-4681-8b32-8d165bef9665-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:53:08 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f0383995-52ba-4657-b6d5-43971e792a91 tempest-VolumesActionsTest-404676404 None] Acquiring lock "cinder-d5f35b33-fa78-4485-8e77-db85147e5172" by "attach_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:53:08 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1cadce2e-ccc5-4ba6-8835-9d91d948042a tempest-ServersNegativeTestJSON-47159344 None] Acquiring lock "cinder-quobyte-4d94412c-ea08-4681-8b32-8d165bef9665" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:53:08 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f0383995-52ba-4657-b6d5-43971e792a91 tempest-VolumesActionsTest-404676404 None] Lock "cinder-d5f35b33-fa78-4485-8e77-db85147e5172" acquired by "attach_volume" :: waited 0.030s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:53:08 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1cadce2e-ccc5-4ba6-8835-9d91d948042a tempest-ServersNegativeTestJSON-47159344 None] Lock "cinder-quobyte-4d94412c-ea08-4681-8b32-8d165bef9665" acquired by "delete_volume" :: waited 0.030s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:53:08 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e156438-f532-4d7b-9c82-8087ccd447a8]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:53:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1cadce2e-ccc5-4ba6-8835-9d91d948042a tempest-ServersNegativeTestJSON-47159344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4d94412c-ea08-4681-8b32-8d165bef9665 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:08 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-f0383995-52ba-4657-b6d5-43971e792a91 tempest-VolumesActionsTest-404676404 None] Attaching volume d5f35b33-fa78-4485-8e77-db85147e5172 to instance aaf4fe4d-c468-4d2c-91c1-7f761ac52663 at mountpoint /dev/vdb on host None. Nov 06 17:53:08 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-f0383995-52ba-4657-b6d5-43971e792a91 tempest-VolumesActionsTest-404676404 None] Attach volume completed successfully. Nov 06 17:53:08 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f0383995-52ba-4657-b6d5-43971e792a91 tempest-VolumesActionsTest-404676404 None] Lock "cinder-d5f35b33-fa78-4485-8e77-db85147e5172" released by "attach_volume" :: held 0.212s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:53:08 devstack sudo[97469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4d94412c-ea08-4681-8b32-8d165bef9665 Nov 06 17:53:08 devstack sudo[97469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:09 devstack sudo[97469]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1cadce2e-ccc5-4ba6-8835-9d91d948042a tempest-ServersNegativeTestJSON-47159344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4d94412c-ea08-4681-8b32-8d165bef9665" returned: 0 in 0.549s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1cadce2e-ccc5-4ba6-8835-9d91d948042a tempest-ServersNegativeTestJSON-47159344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4d94412c-ea08-4681-8b32-8d165bef9665 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:09 devstack sudo[97474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4d94412c-ea08-4681-8b32-8d165bef9665 Nov 06 17:53:09 devstack sudo[97474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:09 devstack sudo[97474]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1cadce2e-ccc5-4ba6-8835-9d91d948042a tempest-ServersNegativeTestJSON-47159344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4d94412c-ea08-4681-8b32-8d165bef9665" returned: 0 in 0.447s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:09 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cc9d801b-a331-4d02-9990-d0b36945ef7d tempest-VolumesActionsTest-404676404 None] Acquiring lock "cinder-d5f35b33-fa78-4485-8e77-db85147e5172-detach_volume" by "detach_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:53:09 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1cadce2e-ccc5-4ba6-8835-9d91d948042a tempest-ServersNegativeTestJSON-47159344 None] Lock "cinder-quobyte-4d94412c-ea08-4681-8b32-8d165bef9665" released by "delete_volume" :: held 1.121s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:53:09 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cc9d801b-a331-4d02-9990-d0b36945ef7d tempest-VolumesActionsTest-404676404 None] Lock "cinder-d5f35b33-fa78-4485-8e77-db85147e5172-detach_volume" acquired by "detach_volume" :: waited 0.061s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:53:09 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-cc9d801b-a331-4d02-9990-d0b36945ef7d tempest-VolumesActionsTest-404676404 None] Detaching volume d5f35b33-fa78-4485-8e77-db85147e5172 from instance aaf4fe4d-c468-4d2c-91c1-7f761ac52663. Nov 06 17:53:09 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-763e5fbb-76de-4b1e-b104-9c4509e9a72d tempest-VolumesGetTest-154484293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:53:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-763e5fbb-76de-4b1e-b104-9c4509e9a72d tempest-VolumesGetTest-154484293 None] Flow 'volume_create_manager' (64175df2-2045-4bd6-9d67-629c36f08229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:53:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-763e5fbb-76de-4b1e-b104-9c4509e9a72d tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58a442a6-add4-4c6f-a606-a0faae7e720e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-763e5fbb-76de-4b1e-b104-9c4509e9a72d tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58a442a6-add4-4c6f-a606-a0faae7e720e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:53:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-727465081',display_name='tempest-VolumesGetTest-Volume-1356274292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cb33723-0f9b-4335-88f3-c7668bfaa423,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83b317dc0b0f4329aa3bf9863f7ddd5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:53:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:53:09Z,use_quota=True,user_id='ea09cba9a9d94ad6a595472e62d9a066',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-763e5fbb-76de-4b1e-b104-9c4509e9a72d tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60f4bd32-714c-42d9-a762-8b01e7ad404d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-763e5fbb-76de-4b1e-b104-9c4509e9a72d tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60f4bd32-714c-42d9-a762-8b01e7ad404d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-763e5fbb-76de-4b1e-b104-9c4509e9a72d tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91ab5bb5-3fc0-4835-a97d-f9db1684b604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-763e5fbb-76de-4b1e-b104-9c4509e9a72d tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91ab5bb5-3fc0-4835-a97d-f9db1684b604) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cb33723-0f9b-4335-88f3-c7668bfaa423', 'volume_name': 'volume-8cb33723-0f9b-4335-88f3-c7668bfaa423', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-763e5fbb-76de-4b1e-b104-9c4509e9a72d tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64307b9c-d850-4d22-852a-33284e21574a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-763e5fbb-76de-4b1e-b104-9c4509e9a72d tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64307b9c-d850-4d22-852a-33284e21574a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-763e5fbb-76de-4b1e-b104-9c4509e9a72d tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30f8327f-96e7-4d35-bc9d-70a07ea50fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:09 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-763e5fbb-76de-4b1e-b104-9c4509e9a72d tempest-VolumesGetTest-154484293 None] Volume 8cb33723-0f9b-4335-88f3-c7668bfaa423: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cb33723-0f9b-4335-88f3-c7668bfaa423', 'volume_size': 1} Nov 06 17:53:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-763e5fbb-76de-4b1e-b104-9c4509e9a72d tempest-VolumesGetTest-154484293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:53:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-763e5fbb-76de-4b1e-b104-9c4509e9a72d tempest-VolumesGetTest-154484293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:53:09 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-763e5fbb-76de-4b1e-b104-9c4509e9a72d tempest-VolumesGetTest-154484293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:53:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-727465081',display_name='tempest-VolumesGetTest-Volume-1356274292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cb33723-0f9b-4335-88f3-c7668bfaa423,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83b317dc0b0f4329aa3bf9863f7ddd5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:53:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:53:09Z,use_quota=True,user_id='ea09cba9a9d94ad6a595472e62d9a066',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:53:09 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-763e5fbb-76de-4b1e-b104-9c4509e9a72d tempest-VolumesGetTest-154484293 None] Creating volume 8cb33723-0f9b-4335-88f3-c7668bfaa423 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:53:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-763e5fbb-76de-4b1e-b104-9c4509e9a72d tempest-VolumesGetTest-154484293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:53:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-763e5fbb-76de-4b1e-b104-9c4509e9a72d tempest-VolumesGetTest-154484293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:53:09 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-763e5fbb-76de-4b1e-b104-9c4509e9a72d tempest-VolumesGetTest-154484293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:53:09 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-763e5fbb-76de-4b1e-b104-9c4509e9a72d tempest-VolumesGetTest-154484293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:53:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-763e5fbb-76de-4b1e-b104-9c4509e9a72d tempest-VolumesGetTest-154484293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:53:09 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-763e5fbb-76de-4b1e-b104-9c4509e9a72d tempest-VolumesGetTest-154484293 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:53:09 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-763e5fbb-76de-4b1e-b104-9c4509e9a72d tempest-VolumesGetTest-154484293 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:53:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-763e5fbb-76de-4b1e-b104-9c4509e9a72d tempest-VolumesGetTest-154484293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8cb33723-0f9b-4335-88f3-c7668bfaa423 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:09 devstack sudo[97478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8cb33723-0f9b-4335-88f3-c7668bfaa423 1073741824 Nov 06 17:53:09 devstack sudo[97478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:09 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0872a13-8381-4d94-b3ec-f63f23fcc63e tempest-VolumesActionsTest-1603869063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:53:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a0872a13-8381-4d94-b3ec-f63f23fcc63e tempest-VolumesActionsTest-1603869063 None] Flow 'volume_create_manager' (1fc34183-0a64-4d31-b7c3-7f7a978c2688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:53:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a0872a13-8381-4d94-b3ec-f63f23fcc63e tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9012bba9-f1ed-4bd1-9703-5fbf96329af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:09 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-1cadce2e-ccc5-4ba6-8835-9d91d948042a tempest-ServersNegativeTestJSON-47159344 None] Created reservations ['6314007f-f394-44fe-9a85-30188804316a', '881159ef-216a-48a3-a6ec-f39c5d69a846', 'cc2b4d43-5543-4119-aee8-434c29e26d77', '1b4f17a9-fd07-4d0d-8540-5b8066a2713e'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:53:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a0872a13-8381-4d94-b3ec-f63f23fcc63e tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9012bba9-f1ed-4bd1-9703-5fbf96329af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:53:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1868391884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25f2e09c-cd96-4ef5-8b5f-1262dd9385c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61a32a6744ec449280a9b0af8e2adc4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:53:10Z,use_quota=True,user_id='6a1654f7f8c04863834119a414f584e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a0872a13-8381-4d94-b3ec-f63f23fcc63e tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcdb2b38-2ec3-41ba-ac69-3386b316bf2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a0872a13-8381-4d94-b3ec-f63f23fcc63e tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcdb2b38-2ec3-41ba-ac69-3386b316bf2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a0872a13-8381-4d94-b3ec-f63f23fcc63e tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71a27ab3-4c50-42de-8651-87de3b805a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a0872a13-8381-4d94-b3ec-f63f23fcc63e tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71a27ab3-4c50-42de-8651-87de3b805a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25f2e09c-cd96-4ef5-8b5f-1262dd9385c5', 'volume_name': 'volume-25f2e09c-cd96-4ef5-8b5f-1262dd9385c5', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a0872a13-8381-4d94-b3ec-f63f23fcc63e tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2244410-f8a0-4637-8485-2c11c7f0917f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a0872a13-8381-4d94-b3ec-f63f23fcc63e tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2244410-f8a0-4637-8485-2c11c7f0917f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a0872a13-8381-4d94-b3ec-f63f23fcc63e tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b54dc4f-1a56-47cc-81f7-74ce37186bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:09 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-a0872a13-8381-4d94-b3ec-f63f23fcc63e tempest-VolumesActionsTest-1603869063 None] Volume 25f2e09c-cd96-4ef5-8b5f-1262dd9385c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25f2e09c-cd96-4ef5-8b5f-1262dd9385c5', 'volume_size': 1} Nov 06 17:53:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a0872a13-8381-4d94-b3ec-f63f23fcc63e tempest-VolumesActionsTest-1603869063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:53:09 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-cc9d801b-a331-4d02-9990-d0b36945ef7d tempest-VolumesActionsTest-404676404 None] Detach volume completed successfully. Nov 06 17:53:09 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cc9d801b-a331-4d02-9990-d0b36945ef7d tempest-VolumesActionsTest-404676404 None] Lock "cinder-d5f35b33-fa78-4485-8e77-db85147e5172-detach_volume" released by "detach_volume" :: held 0.336s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:53:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1cadce2e-ccc5-4ba6-8835-9d91d948042a tempest-ServersNegativeTestJSON-47159344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:53:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1cadce2e-ccc5-4ba6-8835-9d91d948042a tempest-ServersNegativeTestJSON-47159344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:53:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1cadce2e-ccc5-4ba6-8835-9d91d948042a tempest-ServersNegativeTestJSON-47159344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:53:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1cadce2e-ccc5-4ba6-8835-9d91d948042a tempest-ServersNegativeTestJSON-47159344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:53:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1cadce2e-ccc5-4ba6-8835-9d91d948042a tempest-ServersNegativeTestJSON-47159344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:53:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1cadce2e-ccc5-4ba6-8835-9d91d948042a tempest-ServersNegativeTestJSON-47159344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:10 devstack sudo[97482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:53:10 devstack sudo[97482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:10 devstack sudo[97478]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-763e5fbb-76de-4b1e-b104-9c4509e9a72d tempest-VolumesGetTest-154484293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8cb33723-0f9b-4335-88f3-c7668bfaa423 1073741824" returned: 0 in 0.587s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-763e5fbb-76de-4b1e-b104-9c4509e9a72d tempest-VolumesGetTest-154484293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8cb33723-0f9b-4335-88f3-c7668bfaa423 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:10 devstack sudo[97482]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1cadce2e-ccc5-4ba6-8835-9d91d948042a tempest-ServersNegativeTestJSON-47159344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.410s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:10 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-1cadce2e-ccc5-4ba6-8835-9d91d948042a tempest-ServersNegativeTestJSON-47159344 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:53:10 devstack sudo[97490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8cb33723-0f9b-4335-88f3-c7668bfaa423 Nov 06 17:53:10 devstack sudo[97490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:10 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-1cadce2e-ccc5-4ba6-8835-9d91d948042a tempest-ServersNegativeTestJSON-47159344 None] Deleted volume successfully. Nov 06 17:53:10 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1cadce2e-ccc5-4ba6-8835-9d91d948042a tempest-ServersNegativeTestJSON-47159344 None] Lock "cinder-4d94412c-ea08-4681-8b32-8d165bef9665-delete_volume" released by "delete_volume" :: held 2.148s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:53:10 devstack sudo[97490]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-763e5fbb-76de-4b1e-b104-9c4509e9a72d tempest-VolumesGetTest-154484293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8cb33723-0f9b-4335-88f3-c7668bfaa423" returned: 0 in 0.403s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-763e5fbb-76de-4b1e-b104-9c4509e9a72d tempest-VolumesGetTest-154484293 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:53:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-763e5fbb-76de-4b1e-b104-9c4509e9a72d tempest-VolumesGetTest-154484293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:53:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a0872a13-8381-4d94-b3ec-f63f23fcc63e tempest-VolumesActionsTest-1603869063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.907s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:53:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a0872a13-8381-4d94-b3ec-f63f23fcc63e tempest-VolumesActionsTest-1603869063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:53:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1868391884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25f2e09c-cd96-4ef5-8b5f-1262dd9385c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61a32a6744ec449280a9b0af8e2adc4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:53:10Z,use_quota=True,user_id='6a1654f7f8c04863834119a414f584e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:53:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-a0872a13-8381-4d94-b3ec-f63f23fcc63e tempest-VolumesActionsTest-1603869063 None] Creating volume 25f2e09c-cd96-4ef5-8b5f-1262dd9385c5 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:53:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a0872a13-8381-4d94-b3ec-f63f23fcc63e tempest-VolumesActionsTest-1603869063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:53:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a0872a13-8381-4d94-b3ec-f63f23fcc63e tempest-VolumesActionsTest-1603869063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:53:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a0872a13-8381-4d94-b3ec-f63f23fcc63e tempest-VolumesActionsTest-1603869063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:53:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a0872a13-8381-4d94-b3ec-f63f23fcc63e tempest-VolumesActionsTest-1603869063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:53:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a0872a13-8381-4d94-b3ec-f63f23fcc63e tempest-VolumesActionsTest-1603869063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:53:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a0872a13-8381-4d94-b3ec-f63f23fcc63e tempest-VolumesActionsTest-1603869063 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:53:10 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-a0872a13-8381-4d94-b3ec-f63f23fcc63e tempest-VolumesActionsTest-1603869063 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:53:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a0872a13-8381-4d94-b3ec-f63f23fcc63e tempest-VolumesActionsTest-1603869063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-25f2e09c-cd96-4ef5-8b5f-1262dd9385c5 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:10 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-56905ca3-e733-433d-9dcf-ac657ac38e0c tempest-ServersNegativeTestJSON-47159344 None] Acquiring lock "cinder-a38467af-2be7-4014-962e-274410ac1e7c-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:53:10 devstack sudo[97508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-25f2e09c-cd96-4ef5-8b5f-1262dd9385c5 1073741824 Nov 06 17:53:10 devstack sudo[97508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-763e5fbb-76de-4b1e-b104-9c4509e9a72d tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30f8327f-96e7-4d35-bc9d-70a07ea50fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cb33723-0f9b-4335-88f3-c7668bfaa423', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-763e5fbb-76de-4b1e-b104-9c4509e9a72d tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0049efb0-9ae2-4df1-b358-fe628560f1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:10 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-56905ca3-e733-433d-9dcf-ac657ac38e0c tempest-ServersNegativeTestJSON-47159344 None] Lock "cinder-a38467af-2be7-4014-962e-274410ac1e7c-delete_volume" acquired by "delete_volume" :: waited 0.096s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:53:10 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-763e5fbb-76de-4b1e-b104-9c4509e9a72d tempest-VolumesGetTest-154484293 None] Volume volume-8cb33723-0f9b-4335-88f3-c7668bfaa423 (8cb33723-0f9b-4335-88f3-c7668bfaa423): created successfully Nov 06 17:53:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-763e5fbb-76de-4b1e-b104-9c4509e9a72d tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0049efb0-9ae2-4df1-b358-fe628560f1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-763e5fbb-76de-4b1e-b104-9c4509e9a72d tempest-VolumesGetTest-154484293 None] Flow 'volume_create_manager' (64175df2-2045-4bd6-9d67-629c36f08229) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:53:11 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-763e5fbb-76de-4b1e-b104-9c4509e9a72d tempest-VolumesGetTest-154484293 None] Created volume successfully. Nov 06 17:53:11 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-56905ca3-e733-433d-9dcf-ac657ac38e0c tempest-ServersNegativeTestJSON-47159344 None] Acquiring lock "cinder-quobyte-a38467af-2be7-4014-962e-274410ac1e7c" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:53:11 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-56905ca3-e733-433d-9dcf-ac657ac38e0c tempest-ServersNegativeTestJSON-47159344 None] Lock "cinder-quobyte-a38467af-2be7-4014-962e-274410ac1e7c" acquired by "delete_volume" :: waited 0.039s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:53:11 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7513302b-3307-4ba5-b87c-aafcba2eb937]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:53:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-56905ca3-e733-433d-9dcf-ac657ac38e0c tempest-ServersNegativeTestJSON-47159344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a38467af-2be7-4014-962e-274410ac1e7c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:11 devstack sudo[97517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a38467af-2be7-4014-962e-274410ac1e7c Nov 06 17:53:11 devstack sudo[97517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:11 devstack sudo[97508]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a0872a13-8381-4d94-b3ec-f63f23fcc63e tempest-VolumesActionsTest-1603869063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-25f2e09c-cd96-4ef5-8b5f-1262dd9385c5 1073741824" returned: 0 in 0.586s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a0872a13-8381-4d94-b3ec-f63f23fcc63e tempest-VolumesActionsTest-1603869063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-25f2e09c-cd96-4ef5-8b5f-1262dd9385c5 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:11 devstack sudo[97522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-25f2e09c-cd96-4ef5-8b5f-1262dd9385c5 Nov 06 17:53:11 devstack sudo[97522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:11 devstack sudo[97517]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-56905ca3-e733-433d-9dcf-ac657ac38e0c tempest-ServersNegativeTestJSON-47159344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a38467af-2be7-4014-962e-274410ac1e7c" returned: 0 in 0.528s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-56905ca3-e733-433d-9dcf-ac657ac38e0c tempest-ServersNegativeTestJSON-47159344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a38467af-2be7-4014-962e-274410ac1e7c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:11 devstack sudo[97527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a38467af-2be7-4014-962e-274410ac1e7c Nov 06 17:53:11 devstack sudo[97527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:11 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-65c57af7-55a5-4f14-996c-8cb10148b50d tempest-VolumesGetTest-154484293 None] Acquiring lock "cinder-8cb33723-0f9b-4335-88f3-c7668bfaa423-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:53:12 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-65c57af7-55a5-4f14-996c-8cb10148b50d tempest-VolumesGetTest-154484293 None] Lock "cinder-8cb33723-0f9b-4335-88f3-c7668bfaa423-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:53:12 devstack sudo[97522]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a0872a13-8381-4d94-b3ec-f63f23fcc63e tempest-VolumesActionsTest-1603869063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-25f2e09c-cd96-4ef5-8b5f-1262dd9385c5" returned: 0 in 0.574s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:12 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a0872a13-8381-4d94-b3ec-f63f23fcc63e tempest-VolumesActionsTest-1603869063 None] <== create_volume: return (1235ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:53:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a0872a13-8381-4d94-b3ec-f63f23fcc63e tempest-VolumesActionsTest-1603869063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.247s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:53:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a0872a13-8381-4d94-b3ec-f63f23fcc63e tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b54dc4f-1a56-47cc-81f7-74ce37186bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25f2e09c-cd96-4ef5-8b5f-1262dd9385c5', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a0872a13-8381-4d94-b3ec-f63f23fcc63e tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ba5d422-c772-4b1d-a831-1782b2190bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:12 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-65c57af7-55a5-4f14-996c-8cb10148b50d tempest-VolumesGetTest-154484293 None] Acquiring lock "cinder-quobyte-8cb33723-0f9b-4335-88f3-c7668bfaa423" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:53:12 devstack sudo[97527]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:12 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-a0872a13-8381-4d94-b3ec-f63f23fcc63e tempest-VolumesActionsTest-1603869063 None] Volume volume-25f2e09c-cd96-4ef5-8b5f-1262dd9385c5 (25f2e09c-cd96-4ef5-8b5f-1262dd9385c5): created successfully Nov 06 17:53:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a0872a13-8381-4d94-b3ec-f63f23fcc63e tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ba5d422-c772-4b1d-a831-1782b2190bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a0872a13-8381-4d94-b3ec-f63f23fcc63e tempest-VolumesActionsTest-1603869063 None] Flow 'volume_create_manager' (1fc34183-0a64-4d31-b7c3-7f7a978c2688) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:53:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-56905ca3-e733-433d-9dcf-ac657ac38e0c tempest-ServersNegativeTestJSON-47159344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a38467af-2be7-4014-962e-274410ac1e7c" returned: 0 in 0.506s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:12 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-65c57af7-55a5-4f14-996c-8cb10148b50d tempest-VolumesGetTest-154484293 None] Lock "cinder-quobyte-8cb33723-0f9b-4335-88f3-c7668bfaa423" acquired by "delete_volume" :: waited 0.047s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:53:12 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-56905ca3-e733-433d-9dcf-ac657ac38e0c tempest-ServersNegativeTestJSON-47159344 None] Lock "cinder-quobyte-a38467af-2be7-4014-962e-274410ac1e7c" released by "delete_volume" :: held 1.121s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:53:12 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9698a0-4337-4b2d-bee1-ff872fa6f6bb]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:53:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-65c57af7-55a5-4f14-996c-8cb10148b50d tempest-VolumesGetTest-154484293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8cb33723-0f9b-4335-88f3-c7668bfaa423 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:12 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-a0872a13-8381-4d94-b3ec-f63f23fcc63e tempest-VolumesActionsTest-1603869063 None] Created volume successfully. Nov 06 17:53:12 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-56905ca3-e733-433d-9dcf-ac657ac38e0c tempest-ServersNegativeTestJSON-47159344 None] Created reservations ['a769b0a3-5776-4272-8221-58ac0cb6a0b6', '0d353c8b-0bb2-422b-837e-10d46a38db87', '0b4e0998-70ad-4b47-aae0-96d2976d5ce9', 'a4182180-e733-4b48-a30d-8e873ea5bd5c'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:53:12 devstack sudo[97533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8cb33723-0f9b-4335-88f3-c7668bfaa423 Nov 06 17:53:12 devstack sudo[97533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-56905ca3-e733-433d-9dcf-ac657ac38e0c tempest-ServersNegativeTestJSON-47159344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:53:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-56905ca3-e733-433d-9dcf-ac657ac38e0c tempest-ServersNegativeTestJSON-47159344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:53:12 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-56905ca3-e733-433d-9dcf-ac657ac38e0c tempest-ServersNegativeTestJSON-47159344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:53:12 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-56905ca3-e733-433d-9dcf-ac657ac38e0c tempest-ServersNegativeTestJSON-47159344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:53:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-56905ca3-e733-433d-9dcf-ac657ac38e0c tempest-ServersNegativeTestJSON-47159344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:53:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-56905ca3-e733-433d-9dcf-ac657ac38e0c tempest-ServersNegativeTestJSON-47159344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:12 devstack sudo[97535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:53:12 devstack sudo[97535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:12 devstack sudo[97533]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-65c57af7-55a5-4f14-996c-8cb10148b50d tempest-VolumesGetTest-154484293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8cb33723-0f9b-4335-88f3-c7668bfaa423" returned: 0 in 0.423s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-65c57af7-55a5-4f14-996c-8cb10148b50d tempest-VolumesGetTest-154484293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8cb33723-0f9b-4335-88f3-c7668bfaa423 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:12 devstack sudo[97535]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:12 devstack sudo[97541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8cb33723-0f9b-4335-88f3-c7668bfaa423 Nov 06 17:53:12 devstack sudo[97541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-56905ca3-e733-433d-9dcf-ac657ac38e0c tempest-ServersNegativeTestJSON-47159344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.290s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:12 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-56905ca3-e733-433d-9dcf-ac657ac38e0c tempest-ServersNegativeTestJSON-47159344 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:53:12 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-56905ca3-e733-433d-9dcf-ac657ac38e0c tempest-ServersNegativeTestJSON-47159344 None] Deleted volume successfully. Nov 06 17:53:12 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-56905ca3-e733-433d-9dcf-ac657ac38e0c tempest-ServersNegativeTestJSON-47159344 None] Lock "cinder-a38467af-2be7-4014-962e-274410ac1e7c-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:53:12 devstack sudo[97541]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-65c57af7-55a5-4f14-996c-8cb10148b50d tempest-VolumesGetTest-154484293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8cb33723-0f9b-4335-88f3-c7668bfaa423" returned: 0 in 0.299s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:12 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-65c57af7-55a5-4f14-996c-8cb10148b50d tempest-VolumesGetTest-154484293 None] Lock "cinder-quobyte-8cb33723-0f9b-4335-88f3-c7668bfaa423" released by "delete_volume" :: held 0.782s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:53:13 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8d8862dd-c0ca-4641-a0b3-33c6649fef1a tempest-VolumesActionsTest-1451753164 None] Acquiring lock "cinder-25f2e09c-cd96-4ef5-8b5f-1262dd9385c5-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:53:13 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-65c57af7-55a5-4f14-996c-8cb10148b50d tempest-VolumesGetTest-154484293 None] Created reservations ['681c6002-0c96-4dde-a5c1-257629e81f29', 'cc8305cb-90fb-4caa-a5c6-f05243ff428c', 'a27fc2ba-32f5-49f7-bc21-0268e29a1173', '67d9a05e-4d74-49ce-9647-6cc92e4ace52'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:53:13 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8d8862dd-c0ca-4641-a0b3-33c6649fef1a tempest-VolumesActionsTest-1451753164 None] Lock "cinder-25f2e09c-cd96-4ef5-8b5f-1262dd9385c5-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:53:13 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8d8862dd-c0ca-4641-a0b3-33c6649fef1a tempest-VolumesActionsTest-1451753164 None] Acquiring lock "cinder-quobyte-25f2e09c-cd96-4ef5-8b5f-1262dd9385c5" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:53:13 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8d8862dd-c0ca-4641-a0b3-33c6649fef1a tempest-VolumesActionsTest-1451753164 None] Lock "cinder-quobyte-25f2e09c-cd96-4ef5-8b5f-1262dd9385c5" acquired by "delete_volume" :: waited 0.031s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:53:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-65c57af7-55a5-4f14-996c-8cb10148b50d tempest-VolumesGetTest-154484293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:53:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-65c57af7-55a5-4f14-996c-8cb10148b50d tempest-VolumesGetTest-154484293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:53:13 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-65c57af7-55a5-4f14-996c-8cb10148b50d tempest-VolumesGetTest-154484293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:53:13 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-65c57af7-55a5-4f14-996c-8cb10148b50d tempest-VolumesGetTest-154484293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:53:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-65c57af7-55a5-4f14-996c-8cb10148b50d tempest-VolumesGetTest-154484293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:53:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-65c57af7-55a5-4f14-996c-8cb10148b50d tempest-VolumesGetTest-154484293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:13 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e95bfe-991f-4afe-aa06-3967ae4a41eb]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:53:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8d8862dd-c0ca-4641-a0b3-33c6649fef1a tempest-VolumesActionsTest-1451753164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-25f2e09c-cd96-4ef5-8b5f-1262dd9385c5 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:13 devstack sudo[97544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:53:13 devstack sudo[97544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:13 devstack sudo[97546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-25f2e09c-cd96-4ef5-8b5f-1262dd9385c5 Nov 06 17:53:13 devstack sudo[97546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:13 devstack sudo[97544]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-65c57af7-55a5-4f14-996c-8cb10148b50d tempest-VolumesGetTest-154484293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.304s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:13 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-65c57af7-55a5-4f14-996c-8cb10148b50d tempest-VolumesGetTest-154484293 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:53:13 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-65c57af7-55a5-4f14-996c-8cb10148b50d tempest-VolumesGetTest-154484293 None] Deleted volume successfully. Nov 06 17:53:13 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5338863c-091c-4e08-8dd3-c875e8ad4547 tempest-VolumesGetTest-154484293 None] Acquiring lock "cinder-086e6518-c381-44bd-998d-3603206b9782-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:53:13 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-65c57af7-55a5-4f14-996c-8cb10148b50d tempest-VolumesGetTest-154484293 None] Lock "cinder-8cb33723-0f9b-4335-88f3-c7668bfaa423-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:53:13 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5338863c-091c-4e08-8dd3-c875e8ad4547 tempest-VolumesGetTest-154484293 None] Lock "cinder-086e6518-c381-44bd-998d-3603206b9782-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:53:13 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5338863c-091c-4e08-8dd3-c875e8ad4547 tempest-VolumesGetTest-154484293 None] Acquiring lock "cinder-quobyte-086e6518-c381-44bd-998d-3603206b9782" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:53:13 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5338863c-091c-4e08-8dd3-c875e8ad4547 tempest-VolumesGetTest-154484293 None] Lock "cinder-quobyte-086e6518-c381-44bd-998d-3603206b9782" acquired by "delete_volume" :: waited 0.020s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:53:13 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4edfdfd-5e3f-4c8d-9f7b-17a71bbfbee3]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:53:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5338863c-091c-4e08-8dd3-c875e8ad4547 tempest-VolumesGetTest-154484293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-086e6518-c381-44bd-998d-3603206b9782 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:13 devstack sudo[97546]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8d8862dd-c0ca-4641-a0b3-33c6649fef1a tempest-VolumesActionsTest-1451753164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-25f2e09c-cd96-4ef5-8b5f-1262dd9385c5" returned: 0 in 0.584s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8d8862dd-c0ca-4641-a0b3-33c6649fef1a tempest-VolumesActionsTest-1451753164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-25f2e09c-cd96-4ef5-8b5f-1262dd9385c5 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:13 devstack sudo[97554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-25f2e09c-cd96-4ef5-8b5f-1262dd9385c5 Nov 06 17:53:13 devstack sudo[97554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:13 devstack sudo[97552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-086e6518-c381-44bd-998d-3603206b9782 Nov 06 17:53:13 devstack sudo[97552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:14 devstack sudo[97554]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8d8862dd-c0ca-4641-a0b3-33c6649fef1a tempest-VolumesActionsTest-1451753164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-25f2e09c-cd96-4ef5-8b5f-1262dd9385c5" returned: 0 in 0.493s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:14 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8d8862dd-c0ca-4641-a0b3-33c6649fef1a tempest-VolumesActionsTest-1451753164 None] Lock "cinder-quobyte-25f2e09c-cd96-4ef5-8b5f-1262dd9385c5" released by "delete_volume" :: held 1.206s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:53:14 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-8d8862dd-c0ca-4641-a0b3-33c6649fef1a tempest-VolumesActionsTest-1451753164 None] Created reservations ['8b06f29f-592f-461e-a783-5e899dedc1fc', 'c23a0c58-f0ed-40a5-aba7-2cf1558718bc', 'cb57763f-39e3-42bf-859f-9842c29c6cb7', '7c472bcf-0b2b-47a0-8357-da36750e5df6'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:53:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8d8862dd-c0ca-4641-a0b3-33c6649fef1a tempest-VolumesActionsTest-1451753164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:53:14 devstack sudo[97552]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8d8862dd-c0ca-4641-a0b3-33c6649fef1a tempest-VolumesActionsTest-1451753164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:53:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8d8862dd-c0ca-4641-a0b3-33c6649fef1a tempest-VolumesActionsTest-1451753164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:53:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8d8862dd-c0ca-4641-a0b3-33c6649fef1a tempest-VolumesActionsTest-1451753164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:53:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8d8862dd-c0ca-4641-a0b3-33c6649fef1a tempest-VolumesActionsTest-1451753164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:53:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8d8862dd-c0ca-4641-a0b3-33c6649fef1a tempest-VolumesActionsTest-1451753164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5338863c-091c-4e08-8dd3-c875e8ad4547 tempest-VolumesGetTest-154484293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-086e6518-c381-44bd-998d-3603206b9782" returned: 0 in 0.834s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5338863c-091c-4e08-8dd3-c875e8ad4547 tempest-VolumesGetTest-154484293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-086e6518-c381-44bd-998d-3603206b9782 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:14 devstack sudo[97580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:53:14 devstack sudo[97580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:14 devstack sudo[97583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-086e6518-c381-44bd-998d-3603206b9782 Nov 06 17:53:14 devstack sudo[97583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:14 devstack sudo[97580]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8d8862dd-c0ca-4641-a0b3-33c6649fef1a tempest-VolumesActionsTest-1451753164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.393s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:14 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-8d8862dd-c0ca-4641-a0b3-33c6649fef1a tempest-VolumesActionsTest-1451753164 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:53:14 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-8d8862dd-c0ca-4641-a0b3-33c6649fef1a tempest-VolumesActionsTest-1451753164 None] Deleted volume successfully. Nov 06 17:53:14 devstack sudo[97583]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5338863c-091c-4e08-8dd3-c875e8ad4547 tempest-VolumesGetTest-154484293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-086e6518-c381-44bd-998d-3603206b9782" returned: 0 in 0.403s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:14 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5338863c-091c-4e08-8dd3-c875e8ad4547 tempest-VolumesGetTest-154484293 None] Lock "cinder-quobyte-086e6518-c381-44bd-998d-3603206b9782" released by "delete_volume" :: held 1.309s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:53:14 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8d8862dd-c0ca-4641-a0b3-33c6649fef1a tempest-VolumesActionsTest-1451753164 None] Lock "cinder-25f2e09c-cd96-4ef5-8b5f-1262dd9385c5-delete_volume" released by "delete_volume" :: held 1.950s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:53:15 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-5338863c-091c-4e08-8dd3-c875e8ad4547 tempest-VolumesGetTest-154484293 None] Created reservations ['e9e4a3af-a1e1-4277-ae5d-8e7a4741f07f', 'dcdb2152-9d62-4c05-8296-3561b08a7e5e', '2de4dad1-82da-47c4-9afb-addfbbb9b042', '2524503f-a182-47e9-b4e4-b9c56516acad'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:53:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5338863c-091c-4e08-8dd3-c875e8ad4547 tempest-VolumesGetTest-154484293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:53:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5338863c-091c-4e08-8dd3-c875e8ad4547 tempest-VolumesGetTest-154484293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:53:15 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5338863c-091c-4e08-8dd3-c875e8ad4547 tempest-VolumesGetTest-154484293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:53:15 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5338863c-091c-4e08-8dd3-c875e8ad4547 tempest-VolumesGetTest-154484293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:53:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5338863c-091c-4e08-8dd3-c875e8ad4547 tempest-VolumesGetTest-154484293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:53:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5338863c-091c-4e08-8dd3-c875e8ad4547 tempest-VolumesGetTest-154484293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:15 devstack sudo[97588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:53:15 devstack sudo[97588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:15 devstack sudo[97588]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5338863c-091c-4e08-8dd3-c875e8ad4547 tempest-VolumesGetTest-154484293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.412s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:15 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-5338863c-091c-4e08-8dd3-c875e8ad4547 tempest-VolumesGetTest-154484293 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:53:15 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-5338863c-091c-4e08-8dd3-c875e8ad4547 tempest-VolumesGetTest-154484293 None] Deleted volume successfully. Nov 06 17:53:15 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5338863c-091c-4e08-8dd3-c875e8ad4547 tempest-VolumesGetTest-154484293 None] Lock "cinder-086e6518-c381-44bd-998d-3603206b9782-delete_volume" released by "delete_volume" :: held 2.045s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:53:16 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-d311caf3-c09e-418b-8727-ccd4849328d7 tempest-VolumesActionsTest-1603869063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:53:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d311caf3-c09e-418b-8727-ccd4849328d7 tempest-VolumesActionsTest-1603869063 None] Flow 'volume_create_manager' (290900c3-7348-4818-8712-794a6cfa4fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:53:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d311caf3-c09e-418b-8727-ccd4849328d7 tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f39d7f34-a7e9-49df-b2a4-1b7e9d0aae1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d311caf3-c09e-418b-8727-ccd4849328d7 tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f39d7f34-a7e9-49df-b2a4-1b7e9d0aae1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:53:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1113644335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3af16f11-117f-4563-bf51-6e042bd99cf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61a32a6744ec449280a9b0af8e2adc4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:53:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:53:16Z,use_quota=True,user_id='6a1654f7f8c04863834119a414f584e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d311caf3-c09e-418b-8727-ccd4849328d7 tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bca80ff-9168-437b-ae74-0432763216bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d311caf3-c09e-418b-8727-ccd4849328d7 tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bca80ff-9168-437b-ae74-0432763216bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d311caf3-c09e-418b-8727-ccd4849328d7 tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e349b7b-51dd-4af6-bc78-92c6f4fa2a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d311caf3-c09e-418b-8727-ccd4849328d7 tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e349b7b-51dd-4af6-bc78-92c6f4fa2a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3af16f11-117f-4563-bf51-6e042bd99cf5', 'volume_name': 'volume-3af16f11-117f-4563-bf51-6e042bd99cf5', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d311caf3-c09e-418b-8727-ccd4849328d7 tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d56a174f-4de7-491c-aa75-44022d84d250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d311caf3-c09e-418b-8727-ccd4849328d7 tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d56a174f-4de7-491c-aa75-44022d84d250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d311caf3-c09e-418b-8727-ccd4849328d7 tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98663469-311b-4b2b-8eb6-fc68dc17ac08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:16 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-d311caf3-c09e-418b-8727-ccd4849328d7 tempest-VolumesActionsTest-1603869063 None] Volume 3af16f11-117f-4563-bf51-6e042bd99cf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3af16f11-117f-4563-bf51-6e042bd99cf5', 'volume_size': 1} Nov 06 17:53:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d311caf3-c09e-418b-8727-ccd4849328d7 tempest-VolumesActionsTest-1603869063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:53:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d311caf3-c09e-418b-8727-ccd4849328d7 tempest-VolumesActionsTest-1603869063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:53:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d311caf3-c09e-418b-8727-ccd4849328d7 tempest-VolumesActionsTest-1603869063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:53:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1113644335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3af16f11-117f-4563-bf51-6e042bd99cf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61a32a6744ec449280a9b0af8e2adc4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:53:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:53:16Z,use_quota=True,user_id='6a1654f7f8c04863834119a414f584e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:53:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-d311caf3-c09e-418b-8727-ccd4849328d7 tempest-VolumesActionsTest-1603869063 None] Creating volume 3af16f11-117f-4563-bf51-6e042bd99cf5 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:53:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d311caf3-c09e-418b-8727-ccd4849328d7 tempest-VolumesActionsTest-1603869063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:53:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d311caf3-c09e-418b-8727-ccd4849328d7 tempest-VolumesActionsTest-1603869063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:53:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d311caf3-c09e-418b-8727-ccd4849328d7 tempest-VolumesActionsTest-1603869063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:53:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d311caf3-c09e-418b-8727-ccd4849328d7 tempest-VolumesActionsTest-1603869063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:53:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d311caf3-c09e-418b-8727-ccd4849328d7 tempest-VolumesActionsTest-1603869063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:53:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d311caf3-c09e-418b-8727-ccd4849328d7 tempest-VolumesActionsTest-1603869063 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:53:16 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-d311caf3-c09e-418b-8727-ccd4849328d7 tempest-VolumesActionsTest-1603869063 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:53:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d311caf3-c09e-418b-8727-ccd4849328d7 tempest-VolumesActionsTest-1603869063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3af16f11-117f-4563-bf51-6e042bd99cf5 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-bea08c84-e0ed-45be-8a68-044a8f2ae9b3 tempest-VolumesActionsTest-404676404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:53:16 devstack sudo[97594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3af16f11-117f-4563-bf51-6e042bd99cf5 1073741824 Nov 06 17:53:16 devstack sudo[97594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:16 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-9add165b-1ffa-40b6-9225-8318f95e06a6 tempest-VolumesGetTest-154484293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:53:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9add165b-1ffa-40b6-9225-8318f95e06a6 tempest-VolumesGetTest-154484293 None] Flow 'volume_create_manager' (22a2320f-7cb7-4c8a-be2e-1e89eef51cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:53:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9add165b-1ffa-40b6-9225-8318f95e06a6 tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40db461a-4663-41b0-8e3f-8c5e0dbf8f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9add165b-1ffa-40b6-9225-8318f95e06a6 tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40db461a-4663-41b0-8e3f-8c5e0dbf8f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:53:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-813502116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79705078-8562-4675-9e55-a3ab5e022e7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83b317dc0b0f4329aa3bf9863f7ddd5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:53:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:53:16Z,use_quota=True,user_id='ea09cba9a9d94ad6a595472e62d9a066',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9add165b-1ffa-40b6-9225-8318f95e06a6 tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (559927c0-a3be-4ad4-9245-b41eecadd51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9add165b-1ffa-40b6-9225-8318f95e06a6 tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (559927c0-a3be-4ad4-9245-b41eecadd51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9add165b-1ffa-40b6-9225-8318f95e06a6 tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aea53f8f-6482-402a-8e9c-0602b6bfee2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9add165b-1ffa-40b6-9225-8318f95e06a6 tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aea53f8f-6482-402a-8e9c-0602b6bfee2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79705078-8562-4675-9e55-a3ab5e022e7a', 'volume_name': 'volume-79705078-8562-4675-9e55-a3ab5e022e7a', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9add165b-1ffa-40b6-9225-8318f95e06a6 tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f1a0167-05b3-4de8-9ee6-8bf21a815c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9add165b-1ffa-40b6-9225-8318f95e06a6 tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f1a0167-05b3-4de8-9ee6-8bf21a815c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9add165b-1ffa-40b6-9225-8318f95e06a6 tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (304f63df-58cb-4757-ab34-14761f15bfda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:16 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-9add165b-1ffa-40b6-9225-8318f95e06a6 tempest-VolumesGetTest-154484293 None] Volume 79705078-8562-4675-9e55-a3ab5e022e7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79705078-8562-4675-9e55-a3ab5e022e7a', 'volume_size': 1} Nov 06 17:53:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9add165b-1ffa-40b6-9225-8318f95e06a6 tempest-VolumesGetTest-154484293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:53:16 devstack sudo[97594]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d311caf3-c09e-418b-8727-ccd4849328d7 tempest-VolumesActionsTest-1603869063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3af16f11-117f-4563-bf51-6e042bd99cf5 1073741824" returned: 0 in 0.507s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d311caf3-c09e-418b-8727-ccd4849328d7 tempest-VolumesActionsTest-1603869063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3af16f11-117f-4563-bf51-6e042bd99cf5 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:16 devstack sudo[97600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3af16f11-117f-4563-bf51-6e042bd99cf5 Nov 06 17:53:16 devstack sudo[97600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:17 devstack sudo[97600]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d311caf3-c09e-418b-8727-ccd4849328d7 tempest-VolumesActionsTest-1603869063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3af16f11-117f-4563-bf51-6e042bd99cf5" returned: 0 in 0.259s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d311caf3-c09e-418b-8727-ccd4849328d7 tempest-VolumesActionsTest-1603869063 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:53:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d311caf3-c09e-418b-8727-ccd4849328d7 tempest-VolumesActionsTest-1603869063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:53:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-bea08c84-e0ed-45be-8a68-044a8f2ae9b3 tempest-VolumesActionsTest-404676404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.791s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:53:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d311caf3-c09e-418b-8727-ccd4849328d7 tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98663469-311b-4b2b-8eb6-fc68dc17ac08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3af16f11-117f-4563-bf51-6e042bd99cf5', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d311caf3-c09e-418b-8727-ccd4849328d7 tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c790fa50-4944-49c5-b50d-8aedab77e22f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:17 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36addac-2353-4a62-9131-f594886e658a]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:53:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bea08c84-e0ed-45be-8a68-044a8f2ae9b3 tempest-VolumesActionsTest-404676404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d5f35b33-fa78-4485-8e77-db85147e5172 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:17 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-d311caf3-c09e-418b-8727-ccd4849328d7 tempest-VolumesActionsTest-1603869063 None] Volume volume-3af16f11-117f-4563-bf51-6e042bd99cf5 (3af16f11-117f-4563-bf51-6e042bd99cf5): created successfully Nov 06 17:53:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d311caf3-c09e-418b-8727-ccd4849328d7 tempest-VolumesActionsTest-1603869063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c790fa50-4944-49c5-b50d-8aedab77e22f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d311caf3-c09e-418b-8727-ccd4849328d7 tempest-VolumesActionsTest-1603869063 None] Flow 'volume_create_manager' (290900c3-7348-4818-8712-794a6cfa4fb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:53:17 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:UPDATE=144,cinder:SELECT=118,cinder:INSERT=42,cinder:DELETE=12 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 17:53:17 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-d311caf3-c09e-418b-8727-ccd4849328d7 tempest-VolumesActionsTest-1603869063 None] Created volume successfully. Nov 06 17:53:17 devstack sudo[97603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d5f35b33-fa78-4485-8e77-db85147e5172 Nov 06 17:53:17 devstack sudo[97603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:17 devstack sudo[97603]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bea08c84-e0ed-45be-8a68-044a8f2ae9b3 tempest-VolumesActionsTest-404676404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d5f35b33-fa78-4485-8e77-db85147e5172" returned: 0 in 0.415s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:17 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c94d5c1-5104-4c36-a29e-2b5acc675e0c]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:53:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bea08c84-e0ed-45be-8a68-044a8f2ae9b3 tempest-VolumesActionsTest-404676404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d5f35b33-fa78-4485-8e77-db85147e5172 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:17 devstack sudo[97608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d5f35b33-fa78-4485-8e77-db85147e5172 Nov 06 17:53:17 devstack sudo[97608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:17 devstack sudo[97608]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bea08c84-e0ed-45be-8a68-044a8f2ae9b3 tempest-VolumesActionsTest-404676404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d5f35b33-fa78-4485-8e77-db85147e5172" returned: 0 in 0.377s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bea08c84-e0ed-45be-8a68-044a8f2ae9b3 tempest-VolumesActionsTest-404676404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d5f35b33-fa78-4485-8e77-db85147e5172 /opt/stack/data/cinder/conversion/d5f35b33-fa78-4485-8e77-db85147e5172.temp_image.38acdee5-a371-49bb-906b-99b6b1ab18892u66zh_l.img {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:17 devstack sudo[97614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d5f35b33-fa78-4485-8e77-db85147e5172 /opt/stack/data/cinder/conversion/d5f35b33-fa78-4485-8e77-db85147e5172.temp_image.38acdee5-a371-49bb-906b-99b6b1ab18892u66zh_l.img Nov 06 17:53:17 devstack sudo[97614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:19 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-20b95dd3-2632-4162-9f72-f9c13a64e31b tempest-VolumesActionsTest-1603869063 None] Acquiring lock "cinder-3af16f11-117f-4563-bf51-6e042bd99cf5-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:53:19 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-20b95dd3-2632-4162-9f72-f9c13a64e31b tempest-VolumesActionsTest-1603869063 None] Lock "cinder-3af16f11-117f-4563-bf51-6e042bd99cf5-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:53:19 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=128,cinder:UPDATE=157,cinder:INSERT=39,cinder:DELETE=13 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 17:53:19 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-20b95dd3-2632-4162-9f72-f9c13a64e31b tempest-VolumesActionsTest-1603869063 None] Acquiring lock "cinder-quobyte-3af16f11-117f-4563-bf51-6e042bd99cf5" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:53:19 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-20b95dd3-2632-4162-9f72-f9c13a64e31b tempest-VolumesActionsTest-1603869063 None] Lock "cinder-quobyte-3af16f11-117f-4563-bf51-6e042bd99cf5" acquired by "delete_volume" :: waited 0.050s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:53:19 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e850098-26ec-47f3-9f2f-8f8cd327b8f6]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:53:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-20b95dd3-2632-4162-9f72-f9c13a64e31b tempest-VolumesActionsTest-1603869063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3af16f11-117f-4563-bf51-6e042bd99cf5 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:19 devstack sudo[97627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3af16f11-117f-4563-bf51-6e042bd99cf5 Nov 06 17:53:19 devstack sudo[97627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:20 devstack sudo[97627]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-20b95dd3-2632-4162-9f72-f9c13a64e31b tempest-VolumesActionsTest-1603869063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3af16f11-117f-4563-bf51-6e042bd99cf5" returned: 0 in 0.755s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-20b95dd3-2632-4162-9f72-f9c13a64e31b tempest-VolumesActionsTest-1603869063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3af16f11-117f-4563-bf51-6e042bd99cf5 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:20 devstack sudo[97632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3af16f11-117f-4563-bf51-6e042bd99cf5 Nov 06 17:53:20 devstack sudo[97632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:20 devstack sudo[97632]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-20b95dd3-2632-4162-9f72-f9c13a64e31b tempest-VolumesActionsTest-1603869063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3af16f11-117f-4563-bf51-6e042bd99cf5" returned: 0 in 0.517s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:20 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-20b95dd3-2632-4162-9f72-f9c13a64e31b tempest-VolumesActionsTest-1603869063 None] Lock "cinder-quobyte-3af16f11-117f-4563-bf51-6e042bd99cf5" released by "delete_volume" :: held 1.372s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:53:20 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-20b95dd3-2632-4162-9f72-f9c13a64e31b tempest-VolumesActionsTest-1603869063 None] Created reservations ['f83c0364-2c57-4823-9f14-cf1847f62a6f', 'b7698afe-c4a3-4edd-a49f-9a3acf23f2d8', '25297a78-59ad-4121-a358-bdbd53d8c62b', '13a392d2-3de8-47b5-8605-112d1d946e04'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:53:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-20b95dd3-2632-4162-9f72-f9c13a64e31b tempest-VolumesActionsTest-1603869063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:53:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-20b95dd3-2632-4162-9f72-f9c13a64e31b tempest-VolumesActionsTest-1603869063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:53:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-20b95dd3-2632-4162-9f72-f9c13a64e31b tempest-VolumesActionsTest-1603869063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:53:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-20b95dd3-2632-4162-9f72-f9c13a64e31b tempest-VolumesActionsTest-1603869063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:53:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-20b95dd3-2632-4162-9f72-f9c13a64e31b tempest-VolumesActionsTest-1603869063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:53:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-20b95dd3-2632-4162-9f72-f9c13a64e31b tempest-VolumesActionsTest-1603869063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:20 devstack sudo[97637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:53:20 devstack sudo[97637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:21 devstack sudo[97637]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-20b95dd3-2632-4162-9f72-f9c13a64e31b tempest-VolumesActionsTest-1603869063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.316s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:21 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-20b95dd3-2632-4162-9f72-f9c13a64e31b tempest-VolumesActionsTest-1603869063 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:53:21 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-20b95dd3-2632-4162-9f72-f9c13a64e31b tempest-VolumesActionsTest-1603869063 None] Deleted volume successfully. Nov 06 17:53:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-20b95dd3-2632-4162-9f72-f9c13a64e31b tempest-VolumesActionsTest-1603869063 None] Lock "cinder-3af16f11-117f-4563-bf51-6e042bd99cf5-delete_volume" released by "delete_volume" :: held 2.137s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:53:26 devstack sudo[97614]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bea08c84-e0ed-45be-8a68-044a8f2ae9b3 tempest-VolumesActionsTest-404676404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d5f35b33-fa78-4485-8e77-db85147e5172 /opt/stack/data/cinder/conversion/d5f35b33-fa78-4485-8e77-db85147e5172.temp_image.38acdee5-a371-49bb-906b-99b6b1ab18892u66zh_l.img" returned: 0 in 8.188s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:26 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f7de7c-9e89-459d-93d3-d4f1f15b84be]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:53:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bea08c84-e0ed-45be-8a68-044a8f2ae9b3 tempest-VolumesActionsTest-404676404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d5f35b33-fa78-4485-8e77-db85147e5172 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:26 devstack sudo[97642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d5f35b33-fa78-4485-8e77-db85147e5172 Nov 06 17:53:26 devstack sudo[97642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:26 devstack sudo[97642]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bea08c84-e0ed-45be-8a68-044a8f2ae9b3 tempest-VolumesActionsTest-404676404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d5f35b33-fa78-4485-8e77-db85147e5172" returned: 0 in 0.599s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:26 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-bea08c84-e0ed-45be-8a68-044a8f2ae9b3 tempest-VolumesActionsTest-404676404 None] Image conversion details: src /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d5f35b33-fa78-4485-8e77-db85147e5172, size 1024.00 MB, duration 8.19 sec, destination /opt/stack/data/cinder/conversion/d5f35b33-fa78-4485-8e77-db85147e5172.temp_image.38acdee5-a371-49bb-906b-99b6b1ab18892u66zh_l.img {{(pid=87068) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 17:53:26 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-bea08c84-e0ed-45be-8a68-044a8f2ae9b3 tempest-VolumesActionsTest-404676404 None] Converted 1024.00 MB image at 125.05 MB/s Nov 06 17:53:26 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-bea08c84-e0ed-45be-8a68-044a8f2ae9b3 tempest-VolumesActionsTest-404676404 None] 38acdee5-a371-49bb-906b-99b6b1ab1889 was raw, no need to convert to raw {{(pid=87068) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 06 17:53:28 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-34d9a75b-1dfa-4ecb-b884-8bc8cd858636 tempest-VolumesTestJSON-1277705981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:53:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-34d9a75b-1dfa-4ecb-b884-8bc8cd858636 tempest-VolumesTestJSON-1277705981 None] Flow 'volume_create_manager' (c1907b26-9f78-469b-9d1d-74a5cf0fcff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:53:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-34d9a75b-1dfa-4ecb-b884-8bc8cd858636 tempest-VolumesTestJSON-1277705981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c216739-1d16-44c3-b832-c02d3e6391a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-34d9a75b-1dfa-4ecb-b884-8bc8cd858636 tempest-VolumesTestJSON-1277705981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c216739-1d16-44c3-b832-c02d3e6391a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:53:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1251309822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84dad189-2de2-4ebe-b798-c77ed0e37093,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eceee33d074e4ed3bf85efb7fa57c5d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:53:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:53:29Z,use_quota=True,user_id='b213975080fc4ce0a90fb4fa17fed9cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-34d9a75b-1dfa-4ecb-b884-8bc8cd858636 tempest-VolumesTestJSON-1277705981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d32a7c3-3408-416a-8a72-9d0c7204b8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-34d9a75b-1dfa-4ecb-b884-8bc8cd858636 tempest-VolumesTestJSON-1277705981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d32a7c3-3408-416a-8a72-9d0c7204b8a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-34d9a75b-1dfa-4ecb-b884-8bc8cd858636 tempest-VolumesTestJSON-1277705981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceeb45bf-dc3c-429c-8587-a8d4299b6196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-34d9a75b-1dfa-4ecb-b884-8bc8cd858636 tempest-VolumesTestJSON-1277705981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceeb45bf-dc3c-429c-8587-a8d4299b6196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84dad189-2de2-4ebe-b798-c77ed0e37093', 'volume_name': 'volume-84dad189-2de2-4ebe-b798-c77ed0e37093', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-34d9a75b-1dfa-4ecb-b884-8bc8cd858636 tempest-VolumesTestJSON-1277705981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fa522e3-84c1-46bc-b724-9096f031558d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-34d9a75b-1dfa-4ecb-b884-8bc8cd858636 tempest-VolumesTestJSON-1277705981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fa522e3-84c1-46bc-b724-9096f031558d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-34d9a75b-1dfa-4ecb-b884-8bc8cd858636 tempest-VolumesTestJSON-1277705981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (198985de-141a-4d47-9f07-0448f12b9e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:28 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-34d9a75b-1dfa-4ecb-b884-8bc8cd858636 tempest-VolumesTestJSON-1277705981 None] Volume 84dad189-2de2-4ebe-b798-c77ed0e37093: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84dad189-2de2-4ebe-b798-c77ed0e37093', 'volume_size': 1} Nov 06 17:53:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-34d9a75b-1dfa-4ecb-b884-8bc8cd858636 tempest-VolumesTestJSON-1277705981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:53:36 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:UPDATE=8,cinder:SELECT=7,cinder:INSERT=3 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 17:53:38 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 17:53:42 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:53:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] Flow 'volume_create_manager' (80160415-7434-4bf4-b5c8-de902674268b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:53:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e594b033-297d-43a6-901c-8a8fd78f18ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e594b033-297d-43a6-901c-8a8fd78f18ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:53:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1421888098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66267c31-4115-4c85-96d4-388e87f41361,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a35fdbaf99164568ad8a184071873806',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:53:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:53:43Z,use_quota=True,user_id='9c858b1a8b344df9b247767fd16e343f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89f18697-004d-4342-8e33-42abc37192ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89f18697-004d-4342-8e33-42abc37192ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b8df70e-3ed2-42e7-b807-b4c6c97bb090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:42 devstack cinder-volume[87068]: DEBUG cinder.image.glance [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] Creating Keystone auth plugin from conf {{(pid=87068) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 17:53:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b8df70e-3ed2-42e7-b807-b4c6c97bb090) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '66267c31-4115-4c85-96d4-388e87f41361', 'volume_name': 'volume-66267c31-4115-4c85-96d4-388e87f41361', 'volume_size': 1, 'image_id': '514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '344c8ba807084eedb5afd931913d7a80', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'created_at': datetime.datetime(2026, 11, 6, 16, 39, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 16, 39, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/514846ea-e0c6-4037-8ba4-bcd35ce3fba9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89c81974-cbf4-4ed6-888c-b1ae656359c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89c81974-cbf4-4ed6-888c-b1ae656359c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81f5cf7b-e83e-4012-9b22-d20e2a525bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:43 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] Volume 66267c31-4115-4c85-96d4-388e87f41361: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-66267c31-4115-4c85-96d4-388e87f41361', 'volume_size': 1, 'image_id': '514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '344c8ba807084eedb5afd931913d7a80', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'created_at': datetime.datetime(2026, 11, 6, 16, 39, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 16, 39, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/514846ea-e0c6-4037-8ba4-bcd35ce3fba9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 17:53:43 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] Trying to clone 66267c31-4115-4c85-96d4-388e87f41361 from image 514846ea-e0c6-4037-8ba4-bcd35ce3fba9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'metadata': {}}]). {{(pid=87068) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 17:53:43 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_zqhx5q7ddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87068) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 06 17:53:43 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] Image download 20.69 MB at 20.69 MB/s Nov 06 17:53:43 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3543ab2-847c-4482-9fde-143ec0551d41]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:53:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_zqhx5q7ddevstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:43 devstack sudo[97655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_zqhx5q7ddevstack@QuobyteHD Nov 06 17:53:43 devstack sudo[97655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:44 devstack sudo[97655]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_zqhx5q7ddevstack@QuobyteHD" returned: 0 in 0.375s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:44 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] Temporary image 514846ea-e0c6-4037-8ba4-bcd35ce3fba9 is fetched for user 9c858b1a8b344df9b247767fd16e343f. {{(pid=87068) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 06 17:53:44 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb010b4-fe48-44c1-8e6d-76753997319b]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:53:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_zqhx5q7ddevstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:44 devstack sudo[97660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_zqhx5q7ddevstack@QuobyteHD Nov 06 17:53:44 devstack sudo[97660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:44 devstack sudo[97660]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_zqhx5q7ddevstack@QuobyteHD" returned: 0 in 0.346s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:53:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-bea08c84-e0ed-45be-8a68-044a8f2ae9b3 tempest-VolumesActionsTest-404676404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.922s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:53:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bea08c84-e0ed-45be-8a68-044a8f2ae9b3 tempest-VolumesActionsTest-404676404 None] Uploaded volume to glance image-id: 38acdee5-a371-49bb-906b-99b6b1ab1889. {{(pid=87068) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 06 17:53:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9add165b-1ffa-40b6-9225-8318f95e06a6 tempest-VolumesGetTest-154484293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 31.338s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:53:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9add165b-1ffa-40b6-9225-8318f95e06a6 tempest-VolumesGetTest-154484293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:53:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-813502116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79705078-8562-4675-9e55-a3ab5e022e7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83b317dc0b0f4329aa3bf9863f7ddd5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:53:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:53:16Z,use_quota=True,user_id='ea09cba9a9d94ad6a595472e62d9a066',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:53:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-9add165b-1ffa-40b6-9225-8318f95e06a6 tempest-VolumesGetTest-154484293 None] Creating volume 79705078-8562-4675-9e55-a3ab5e022e7a {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:53:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9add165b-1ffa-40b6-9225-8318f95e06a6 tempest-VolumesGetTest-154484293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:53:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9add165b-1ffa-40b6-9225-8318f95e06a6 tempest-VolumesGetTest-154484293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:53:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9add165b-1ffa-40b6-9225-8318f95e06a6 tempest-VolumesGetTest-154484293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:53:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9add165b-1ffa-40b6-9225-8318f95e06a6 tempest-VolumesGetTest-154484293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:53:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9add165b-1ffa-40b6-9225-8318f95e06a6 tempest-VolumesGetTest-154484293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:53:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9add165b-1ffa-40b6-9225-8318f95e06a6 tempest-VolumesGetTest-154484293 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:53:47 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-9add165b-1ffa-40b6-9225-8318f95e06a6 tempest-VolumesGetTest-154484293 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:53:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9add165b-1ffa-40b6-9225-8318f95e06a6 tempest-VolumesGetTest-154484293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-79705078-8562-4675-9e55-a3ab5e022e7a 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:48 devstack sudo[97699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-79705078-8562-4675-9e55-a3ab5e022e7a 1073741824 Nov 06 17:53:48 devstack sudo[97699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:48 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-bea08c84-e0ed-45be-8a68-044a8f2ae9b3 tempest-VolumesActionsTest-404676404 None] Copy volume to image completed successfully. Nov 06 17:53:48 devstack sudo[97699]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9add165b-1ffa-40b6-9225-8318f95e06a6 tempest-VolumesGetTest-154484293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-79705078-8562-4675-9e55-a3ab5e022e7a 1073741824" returned: 0 in 0.454s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9add165b-1ffa-40b6-9225-8318f95e06a6 tempest-VolumesGetTest-154484293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-79705078-8562-4675-9e55-a3ab5e022e7a {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:48 devstack sudo[97707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-79705078-8562-4675-9e55-a3ab5e022e7a Nov 06 17:53:48 devstack sudo[97707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:48 devstack sudo[97707]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9add165b-1ffa-40b6-9225-8318f95e06a6 tempest-VolumesGetTest-154484293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-79705078-8562-4675-9e55-a3ab5e022e7a" returned: 0 in 0.249s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:48 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9add165b-1ffa-40b6-9225-8318f95e06a6 tempest-VolumesGetTest-154484293 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:53:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9add165b-1ffa-40b6-9225-8318f95e06a6 tempest-VolumesGetTest-154484293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:53:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-34d9a75b-1dfa-4ecb-b884-8bc8cd858636 tempest-VolumesTestJSON-1277705981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.962s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:53:48 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-34d9a75b-1dfa-4ecb-b884-8bc8cd858636 tempest-VolumesTestJSON-1277705981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:53:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1251309822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84dad189-2de2-4ebe-b798-c77ed0e37093,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eceee33d074e4ed3bf85efb7fa57c5d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:53:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:53:29Z,use_quota=True,user_id='b213975080fc4ce0a90fb4fa17fed9cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:53:48 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-34d9a75b-1dfa-4ecb-b884-8bc8cd858636 tempest-VolumesTestJSON-1277705981 None] Creating volume 84dad189-2de2-4ebe-b798-c77ed0e37093 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:53:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-34d9a75b-1dfa-4ecb-b884-8bc8cd858636 tempest-VolumesTestJSON-1277705981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:53:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-34d9a75b-1dfa-4ecb-b884-8bc8cd858636 tempest-VolumesTestJSON-1277705981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:53:48 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-34d9a75b-1dfa-4ecb-b884-8bc8cd858636 tempest-VolumesTestJSON-1277705981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:53:48 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-34d9a75b-1dfa-4ecb-b884-8bc8cd858636 tempest-VolumesTestJSON-1277705981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:53:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-34d9a75b-1dfa-4ecb-b884-8bc8cd858636 tempest-VolumesTestJSON-1277705981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:53:48 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-34d9a75b-1dfa-4ecb-b884-8bc8cd858636 tempest-VolumesTestJSON-1277705981 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:53:48 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-34d9a75b-1dfa-4ecb-b884-8bc8cd858636 tempest-VolumesTestJSON-1277705981 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:53:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-34d9a75b-1dfa-4ecb-b884-8bc8cd858636 tempest-VolumesTestJSON-1277705981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-84dad189-2de2-4ebe-b798-c77ed0e37093 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:48 devstack sudo[97710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-84dad189-2de2-4ebe-b798-c77ed0e37093 1073741824 Nov 06 17:53:48 devstack sudo[97710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9add165b-1ffa-40b6-9225-8318f95e06a6 tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (304f63df-58cb-4757-ab34-14761f15bfda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79705078-8562-4675-9e55-a3ab5e022e7a', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9add165b-1ffa-40b6-9225-8318f95e06a6 tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7203766d-1c6e-4ed3-8d98-bd948e7a42a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:48 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-9add165b-1ffa-40b6-9225-8318f95e06a6 tempest-VolumesGetTest-154484293 None] Volume volume-79705078-8562-4675-9e55-a3ab5e022e7a (79705078-8562-4675-9e55-a3ab5e022e7a): created successfully Nov 06 17:53:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9add165b-1ffa-40b6-9225-8318f95e06a6 tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7203766d-1c6e-4ed3-8d98-bd948e7a42a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9add165b-1ffa-40b6-9225-8318f95e06a6 tempest-VolumesGetTest-154484293 None] Flow 'volume_create_manager' (22a2320f-7cb7-4c8a-be2e-1e89eef51cc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:53:48 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-9add165b-1ffa-40b6-9225-8318f95e06a6 tempest-VolumesGetTest-154484293 None] Created volume successfully. Nov 06 17:53:49 devstack sudo[97710]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-34d9a75b-1dfa-4ecb-b884-8bc8cd858636 tempest-VolumesTestJSON-1277705981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-84dad189-2de2-4ebe-b798-c77ed0e37093 1073741824" returned: 0 in 0.540s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-34d9a75b-1dfa-4ecb-b884-8bc8cd858636 tempest-VolumesTestJSON-1277705981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-84dad189-2de2-4ebe-b798-c77ed0e37093 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:49 devstack sudo[97715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-84dad189-2de2-4ebe-b798-c77ed0e37093 Nov 06 17:53:49 devstack sudo[97715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:49 devstack sudo[97715]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-34d9a75b-1dfa-4ecb-b884-8bc8cd858636 tempest-VolumesTestJSON-1277705981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-84dad189-2de2-4ebe-b798-c77ed0e37093" returned: 0 in 0.298s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-34d9a75b-1dfa-4ecb-b884-8bc8cd858636 tempest-VolumesTestJSON-1277705981 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:53:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-34d9a75b-1dfa-4ecb-b884-8bc8cd858636 tempest-VolumesTestJSON-1277705981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:53:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.089s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:53:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:53:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1421888098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66267c31-4115-4c85-96d4-388e87f41361,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a35fdbaf99164568ad8a184071873806',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:53:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:53:43Z,use_quota=True,user_id='9c858b1a8b344df9b247767fd16e343f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:53:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] Creating volume 66267c31-4115-4c85-96d4-388e87f41361 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:53:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:53:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:53:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:53:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:53:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:53:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:53:49 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:53:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-66267c31-4115-4c85-96d4-388e87f41361 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:49 devstack sudo[97718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-66267c31-4115-4c85-96d4-388e87f41361 1073741824 Nov 06 17:53:49 devstack sudo[97718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-34d9a75b-1dfa-4ecb-b884-8bc8cd858636 tempest-VolumesTestJSON-1277705981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (198985de-141a-4d47-9f07-0448f12b9e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84dad189-2de2-4ebe-b798-c77ed0e37093', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-34d9a75b-1dfa-4ecb-b884-8bc8cd858636 tempest-VolumesTestJSON-1277705981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96f019a9-1c42-427f-94e6-027ae7e7afb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:49 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-34d9a75b-1dfa-4ecb-b884-8bc8cd858636 tempest-VolumesTestJSON-1277705981 None] Volume volume-84dad189-2de2-4ebe-b798-c77ed0e37093 (84dad189-2de2-4ebe-b798-c77ed0e37093): created successfully Nov 06 17:53:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-34d9a75b-1dfa-4ecb-b884-8bc8cd858636 tempest-VolumesTestJSON-1277705981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96f019a9-1c42-427f-94e6-027ae7e7afb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-34d9a75b-1dfa-4ecb-b884-8bc8cd858636 tempest-VolumesTestJSON-1277705981 None] Flow 'volume_create_manager' (c1907b26-9f78-469b-9d1d-74a5cf0fcff6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:53:49 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-34d9a75b-1dfa-4ecb-b884-8bc8cd858636 tempest-VolumesTestJSON-1277705981 None] Created volume successfully. Nov 06 17:53:49 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:53:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] Flow 'volume_create_manager' (aea13b32-9818-4d2b-89b9-5ca92be89907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:53:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8850a73f-268f-4623-bd01-0ad6a4e64ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8850a73f-268f-4623-bd01-0ad6a4e64ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:53:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1169031018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8988efc5-58df-4fe5-8fcf-5e28373dfe6b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='83b317dc0b0f4329aa3bf9863f7ddd5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:53:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=79705078-8562-4675-9e55-a3ab5e022e7a,status='creating',terminated_at=None,updated_at=2026-11-06T16:53:50Z,use_quota=True,user_id='ea09cba9a9d94ad6a595472e62d9a066',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (061cf232-bb60-4627-b604-d95314f014f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (061cf232-bb60-4627-b604-d95314f014f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93c07ac4-0cae-41c2-af57-487b9972167d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93c07ac4-0cae-41c2-af57-487b9972167d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '8988efc5-58df-4fe5-8fcf-5e28373dfe6b', 'volume_name': 'volume-8988efc5-58df-4fe5-8fcf-5e28373dfe6b', 'volume_size': 1, 'source_volid': '79705078-8562-4675-9e55-a3ab5e022e7a', 'source_volstatus': 'available'}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (332d2980-6305-48d9-ae89-9e9e4da2438a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (332d2980-6305-48d9-ae89-9e9e4da2438a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f111079b-949f-4f32-b4f7-a43058127fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:49 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] Volume 8988efc5-58df-4fe5-8fcf-5e28373dfe6b: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-8988efc5-58df-4fe5-8fcf-5e28373dfe6b', 'volume_size': 1, 'source_volid': '79705078-8562-4675-9e55-a3ab5e022e7a', 'source_volstatus': 'available'} Nov 06 17:53:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:53:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-27aed179-76aa-49a8-8ae9-d3bca5615d5f tempest-VolumesActionsTest-404676404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:53:50 devstack sudo[97718]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-66267c31-4115-4c85-96d4-388e87f41361 1073741824" returned: 0 in 0.482s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-66267c31-4115-4c85-96d4-388e87f41361 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:50 devstack sudo[97724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-66267c31-4115-4c85-96d4-388e87f41361 Nov 06 17:53:50 devstack sudo[97724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:50 devstack sudo[97724]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-66267c31-4115-4c85-96d4-388e87f41361" returned: 0 in 0.271s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:50 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:53:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:53:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.507s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:53:50 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] Cloning volume 79705078-8562-4675-9e55-a3ab5e022e7a to volume 8988efc5-58df-4fe5-8fcf-5e28373dfe6b Nov 06 17:53:50 devstack cinder-volume[87068]: DEBUG cinder.volume.volume_utils [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] Attempting download of 514846ea-e0c6-4037-8ba4-bcd35ce3fba9 ((None, [{'url': 'file:///opt/stack/data/glance/images/514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'metadata': {}}])) to volume 66267c31-4115-4c85-96d4-388e87f41361. {{(pid=87068) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 17:53:50 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] Creating offline snapshot bd1370e6-e7c2-46e9-bed9-5f7f47fd3cad of volume 79705078-8562-4675-9e55-a3ab5e022e7a {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 17:53:50 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[450e29eb-7313-41df-a48e-8f479f469015]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:53:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-79705078-8562-4675-9e55-a3ab5e022e7a {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:50 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[668fb826-3a42-4f23-915f-cb1adf68f5cf]: (4, 'raw') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:53:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_3wbpdod9 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:50 devstack sudo[97728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-79705078-8562-4675-9e55-a3ab5e022e7a Nov 06 17:53:50 devstack sudo[97728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:50 devstack sudo[97729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_3wbpdod9 Nov 06 17:53:50 devstack sudo[97729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:50 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d120b75-e309-47e0-a42d-29d7c1d690cd tempest-VolumesTestJSON-1277705981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:53:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3d120b75-e309-47e0-a42d-29d7c1d690cd tempest-VolumesTestJSON-1277705981 None] Flow 'volume_create_manager' (09051276-43da-4dd4-b98f-41bbb820d960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:53:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3d120b75-e309-47e0-a42d-29d7c1d690cd tempest-VolumesTestJSON-1277705981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41bdca0a-673f-4a19-88a0-a5f6d0efa83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3d120b75-e309-47e0-a42d-29d7c1d690cd tempest-VolumesTestJSON-1277705981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41bdca0a-673f-4a19-88a0-a5f6d0efa83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-576365884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ec7028d-7834-46a0-9d28-ee0b6772db03,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eceee33d074e4ed3bf85efb7fa57c5d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:53:51Z,use_quota=True,user_id='b213975080fc4ce0a90fb4fa17fed9cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3d120b75-e309-47e0-a42d-29d7c1d690cd tempest-VolumesTestJSON-1277705981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b15a9cee-11e5-4b6f-946f-1906f6ccc65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3d120b75-e309-47e0-a42d-29d7c1d690cd tempest-VolumesTestJSON-1277705981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b15a9cee-11e5-4b6f-946f-1906f6ccc65a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3d120b75-e309-47e0-a42d-29d7c1d690cd tempest-VolumesTestJSON-1277705981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60c48aad-6a35-426a-93e8-840f55effaaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3d120b75-e309-47e0-a42d-29d7c1d690cd tempest-VolumesTestJSON-1277705981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60c48aad-6a35-426a-93e8-840f55effaaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ec7028d-7834-46a0-9d28-ee0b6772db03', 'volume_name': 'volume-9ec7028d-7834-46a0-9d28-ee0b6772db03', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3d120b75-e309-47e0-a42d-29d7c1d690cd tempest-VolumesTestJSON-1277705981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b253d990-dc62-4ec4-bada-bfe0f6ef458e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3d120b75-e309-47e0-a42d-29d7c1d690cd tempest-VolumesTestJSON-1277705981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b253d990-dc62-4ec4-bada-bfe0f6ef458e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3d120b75-e309-47e0-a42d-29d7c1d690cd tempest-VolumesTestJSON-1277705981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9174fca-29e6-4c92-ab63-28fbd3ed0277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:50 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-3d120b75-e309-47e0-a42d-29d7c1d690cd tempest-VolumesTestJSON-1277705981 None] Volume 9ec7028d-7834-46a0-9d28-ee0b6772db03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ec7028d-7834-46a0-9d28-ee0b6772db03', 'volume_size': 1} Nov 06 17:53:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d120b75-e309-47e0-a42d-29d7c1d690cd tempest-VolumesTestJSON-1277705981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:53:50 devstack sudo[97729]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_3wbpdod9" returned: 0 in 0.400s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_3wbpdod9 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:50 devstack sudo[97728]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-79705078-8562-4675-9e55-a3ab5e022e7a" returned: 0 in 0.445s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-79705078-8562-4675-9e55-a3ab5e022e7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-79705078-8562-4675-9e55-a3ab5e022e7a.bd1370e6-e7c2-46e9-bed9-5f7f47fd3cad 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:50 devstack sudo[97740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-79705078-8562-4675-9e55-a3ab5e022e7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-79705078-8562-4675-9e55-a3ab5e022e7a.bd1370e6-e7c2-46e9-bed9-5f7f47fd3cad 1G Nov 06 17:53:50 devstack sudo[97740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:51 devstack sudo[97739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_3wbpdod9 Nov 06 17:53:51 devstack sudo[97739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:51 devstack sudo[97739]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_3wbpdod9" returned: 1 in 0.382s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_3wbpdod9' failed. Not Retrying. {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 17:53:51 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01bb43e-c486-4b54-b671-cd4261564c10]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:53:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_zqhx5q7ddevstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:51 devstack sudo[97740]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-79705078-8562-4675-9e55-a3ab5e022e7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-79705078-8562-4675-9e55-a3ab5e022e7a.bd1370e6-e7c2-46e9-bed9-5f7f47fd3cad 1G" returned: 0 in 0.451s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79705078-8562-4675-9e55-a3ab5e022e7a -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-79705078-8562-4675-9e55-a3ab5e022e7a.bd1370e6-e7c2-46e9-bed9-5f7f47fd3cad {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:51 devstack sudo[97749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79705078-8562-4675-9e55-a3ab5e022e7a -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-79705078-8562-4675-9e55-a3ab5e022e7a.bd1370e6-e7c2-46e9-bed9-5f7f47fd3cad Nov 06 17:53:51 devstack sudo[97749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:51 devstack sudo[97748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_zqhx5q7ddevstack@QuobyteHD Nov 06 17:53:51 devstack sudo[97748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:51 devstack sudo[97748]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_zqhx5q7ddevstack@QuobyteHD" returned: 0 in 0.365s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:51 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] 514846ea-e0c6-4037-8ba4-bcd35ce3fba9 was qcow2, converting to qcow2 {{(pid=87068) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 06 17:53:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_zqhx5q7ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-66267c31-4115-4c85-96d4-388e87f41361 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:51 devstack sudo[97749]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79705078-8562-4675-9e55-a3ab5e022e7a -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-79705078-8562-4675-9e55-a3ab5e022e7a.bd1370e6-e7c2-46e9-bed9-5f7f47fd3cad" returned: 0 in 0.321s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:51 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-79705078-8562-4675-9e55-a3ab5e022e7a.bd1370e6-e7c2-46e9-bed9-5f7f47fd3cad is being set with open permissions: ugo+rw Nov 06 17:53:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-79705078-8562-4675-9e55-a3ab5e022e7a.bd1370e6-e7c2-46e9-bed9-5f7f47fd3cad {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:51 devstack sudo[97764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_zqhx5q7ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-66267c31-4115-4c85-96d4-388e87f41361 Nov 06 17:53:51 devstack sudo[97764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:51 devstack sudo[97766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-79705078-8562-4675-9e55-a3ab5e022e7a.bd1370e6-e7c2-46e9-bed9-5f7f47fd3cad Nov 06 17:53:51 devstack sudo[97766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:51 devstack sudo[97766]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-79705078-8562-4675-9e55-a3ab5e022e7a.bd1370e6-e7c2-46e9-bed9-5f7f47fd3cad" returned: 0 in 0.266s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-79705078-8562-4675-9e55-a3ab5e022e7a.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:52 devstack sudo[97772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-79705078-8562-4675-9e55-a3ab5e022e7a.info Nov 06 17:53:52 devstack sudo[97772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:52 devstack sudo[97772]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-79705078-8562-4675-9e55-a3ab5e022e7a.info" returned: 0 in 0.288s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:52 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-79705078-8562-4675-9e55-a3ab5e022e7a.info is being set with open permissions: ugo+rw Nov 06 17:53:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-79705078-8562-4675-9e55-a3ab5e022e7a.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:52 devstack sudo[97778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-79705078-8562-4675-9e55-a3ab5e022e7a.info Nov 06 17:53:52 devstack sudo[97778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:52 devstack sudo[97778]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-79705078-8562-4675-9e55-a3ab5e022e7a.info" returned: 0 in 0.281s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:52 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] Acquiring lock "cinder-quobyte-8988efc5-58df-4fe5-8fcf-5e28373dfe6b" by "_copy_volume_from_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:53:52 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] Lock "cinder-quobyte-8988efc5-58df-4fe5-8fcf-5e28373dfe6b" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:53:52 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] snapshot: bd1370e6-e7c2-46e9-bed9-5f7f47fd3cad, volume: 8988efc5-58df-4fe5-8fcf-5e28373dfe6b, {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 17:53:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:53:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:53:52 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:53:52 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:53:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:53:52 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40817ab-47fc-4a86-88b0-110de418123f]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:53:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-79705078-8562-4675-9e55-a3ab5e022e7a.bd1370e6-e7c2-46e9-bed9-5f7f47fd3cad {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:52 devstack sudo[97781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-79705078-8562-4675-9e55-a3ab5e022e7a.bd1370e6-e7c2-46e9-bed9-5f7f47fd3cad Nov 06 17:53:52 devstack sudo[97781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:53 devstack sudo[97781]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-79705078-8562-4675-9e55-a3ab5e022e7a.bd1370e6-e7c2-46e9-bed9-5f7f47fd3cad" returned: 0 in 0.436s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79705078-8562-4675-9e55-a3ab5e022e7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 17:53:53 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6db392-0899-401c-a2db-00839dea573c]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:53:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-79705078-8562-4675-9e55-a3ab5e022e7a {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:53 devstack sudo[97786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-79705078-8562-4675-9e55-a3ab5e022e7a Nov 06 17:53:53 devstack sudo[97786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:53 devstack sudo[97786]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-79705078-8562-4675-9e55-a3ab5e022e7a" returned: 0 in 0.404s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-79705078-8562-4675-9e55-a3ab5e022e7a {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 17:53:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] Creating direct copy from snapshot {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 17:53:53 devstack cinder-volume[87068]: DEBUG cinder.utils [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] Path /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8988efc5-58df-4fe5-8fcf-5e28373dfe6b not found in is_blk_device check {{(pid=87068) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 17:53:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-79705078-8562-4675-9e55-a3ab5e022e7a /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8988efc5-58df-4fe5-8fcf-5e28373dfe6b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:53 devstack sudo[97792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-79705078-8562-4675-9e55-a3ab5e022e7a /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8988efc5-58df-4fe5-8fcf-5e28373dfe6b Nov 06 17:53:53 devstack sudo[97792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:53 devstack sudo[97764]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_zqhx5q7ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-66267c31-4115-4c85-96d4-388e87f41361" returned: 0 in 1.930s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:53 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_zqhx5q7ddevstack@QuobyteHD, size 112.00 MB, duration 1.93 sec, destination /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-66267c31-4115-4c85-96d4-388e87f41361 {{(pid=87068) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 17:53:53 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] Converted 112.00 MB image at 58.00 MB/s Nov 06 17:53:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-66267c31-4115-4c85-96d4-388e87f41361 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:53 devstack sudo[97794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-66267c31-4115-4c85-96d4-388e87f41361 1G Nov 06 17:53:53 devstack sudo[97794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:53 devstack sudo[97794]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-66267c31-4115-4c85-96d4-388e87f41361 1G" returned: 0 in 0.355s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:53 devstack cinder-volume[87068]: DEBUG cinder.volume.volume_utils [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] Downloaded image 514846ea-e0c6-4037-8ba4-bcd35ce3fba9 ((None, [{'url': 'file:///opt/stack/data/glance/images/514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'metadata': {}}])) to volume 66267c31-4115-4c85-96d4-388e87f41361 successfully. {{(pid=87068) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 17:53:53 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] Temporary image 514846ea-e0c6-4037-8ba4-bcd35ce3fba9 for user 9c858b1a8b344df9b247767fd16e343f is deleted. {{(pid=87068) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 06 17:53:53 devstack cinder-volume[87068]: DEBUG cinder.volume.volume_utils [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] Marking volume 66267c31-4115-4c85-96d4-388e87f41361 as bootable. {{(pid=87068) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 17:53:54 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] Copying metadata from image 514846ea-e0c6-4037-8ba4-bcd35ce3fba9 to 66267c31-4115-4c85-96d4-388e87f41361. {{(pid=87068) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 17:53:54 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] Creating volume glance metadata for volume 66267c31-4115-4c85-96d4-388e87f41361 backed by image 514846ea-e0c6-4037-8ba4-bcd35ce3fba9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87068) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 17:53:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81f5cf7b-e83e-4012-9b22-d20e2a525bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66267c31-4115-4c85-96d4-388e87f41361', 'volume_size': 1, 'image_id': '514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '344c8ba807084eedb5afd931913d7a80', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'created_at': datetime.datetime(2026, 11, 6, 16, 39, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 16, 39, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/514846ea-e0c6-4037-8ba4-bcd35ce3fba9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (922d28fa-14d9-4a12-94d6-fdcc8a7987dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:53:54 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] Volume volume-66267c31-4115-4c85-96d4-388e87f41361 (66267c31-4115-4c85-96d4-388e87f41361): created successfully Nov 06 17:53:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (922d28fa-14d9-4a12-94d6-fdcc8a7987dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:53:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] Flow 'volume_create_manager' (80160415-7434-4bf4-b5c8-de902674268b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:53:54 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-00921365-f6c8-4057-bc6e-8ee765840f5a tempest-VolumesImageMetadata-914380581 None] Created volume successfully. Nov 06 17:53:54 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running periodic task VolumeManager._thread_info {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 17:53:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] thread count: 28 {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 17:53:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] thread info: [<_MainThread(MainThread, started 133940619505792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 17:53:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-88844ef9-49ea-408b-bcec-d398e3e9b204 tempest-VolumesImageMetadata-914380581 None] Acquiring lock "cinder-66267c31-4115-4c85-96d4-388e87f41361-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:53:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-88844ef9-49ea-408b-bcec-d398e3e9b204 tempest-VolumesImageMetadata-914380581 None] Lock "cinder-66267c31-4115-4c85-96d4-388e87f41361-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:53:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-88844ef9-49ea-408b-bcec-d398e3e9b204 tempest-VolumesImageMetadata-914380581 None] Acquiring lock "cinder-quobyte-66267c31-4115-4c85-96d4-388e87f41361" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:53:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-88844ef9-49ea-408b-bcec-d398e3e9b204 tempest-VolumesImageMetadata-914380581 None] Lock "cinder-quobyte-66267c31-4115-4c85-96d4-388e87f41361" acquired by "delete_volume" :: waited 0.037s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:53:55 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[644442e2-4938-4d93-b22c-21f467e1f7da]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:53:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-88844ef9-49ea-408b-bcec-d398e3e9b204 tempest-VolumesImageMetadata-914380581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-66267c31-4115-4c85-96d4-388e87f41361 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:55 devstack sudo[97811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-66267c31-4115-4c85-96d4-388e87f41361 Nov 06 17:53:55 devstack sudo[97811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:56 devstack sudo[97811]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-88844ef9-49ea-408b-bcec-d398e3e9b204 tempest-VolumesImageMetadata-914380581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-66267c31-4115-4c85-96d4-388e87f41361" returned: 0 in 0.690s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-88844ef9-49ea-408b-bcec-d398e3e9b204 tempest-VolumesImageMetadata-914380581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-66267c31-4115-4c85-96d4-388e87f41361 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:56 devstack sudo[97816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-66267c31-4115-4c85-96d4-388e87f41361 Nov 06 17:53:56 devstack sudo[97816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:56 devstack sudo[97816]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-88844ef9-49ea-408b-bcec-d398e3e9b204 tempest-VolumesImageMetadata-914380581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-66267c31-4115-4c85-96d4-388e87f41361" returned: 0 in 0.494s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:56 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-88844ef9-49ea-408b-bcec-d398e3e9b204 tempest-VolumesImageMetadata-914380581 None] Lock "cinder-quobyte-66267c31-4115-4c85-96d4-388e87f41361" released by "delete_volume" :: held 1.283s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:53:57 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-88844ef9-49ea-408b-bcec-d398e3e9b204 tempest-VolumesImageMetadata-914380581 None] Created reservations ['67d27258-2b70-4fb2-84e0-db1f28b650d5', '6353fe62-0a04-4ae2-b8c1-9cb076cc2710', '1d8191d4-2a6e-435b-805f-f54a6b89ca21', '97be6eda-6987-4aa1-bb58-f620c3278439'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:53:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-88844ef9-49ea-408b-bcec-d398e3e9b204 tempest-VolumesImageMetadata-914380581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:53:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-88844ef9-49ea-408b-bcec-d398e3e9b204 tempest-VolumesImageMetadata-914380581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:53:57 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-88844ef9-49ea-408b-bcec-d398e3e9b204 tempest-VolumesImageMetadata-914380581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:53:57 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-88844ef9-49ea-408b-bcec-d398e3e9b204 tempest-VolumesImageMetadata-914380581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:53:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-88844ef9-49ea-408b-bcec-d398e3e9b204 tempest-VolumesImageMetadata-914380581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:53:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-88844ef9-49ea-408b-bcec-d398e3e9b204 tempest-VolumesImageMetadata-914380581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:53:57 devstack sudo[97819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:53:57 devstack sudo[97819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:53:57 devstack sudo[97819]: pam_unix(sudo:session): session closed for user root Nov 06 17:53:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-88844ef9-49ea-408b-bcec-d398e3e9b204 tempest-VolumesImageMetadata-914380581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.308s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:53:57 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-88844ef9-49ea-408b-bcec-d398e3e9b204 tempest-VolumesImageMetadata-914380581 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:53:57 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-88844ef9-49ea-408b-bcec-d398e3e9b204 tempest-VolumesImageMetadata-914380581 None] Deleted volume successfully. Nov 06 17:53:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-88844ef9-49ea-408b-bcec-d398e3e9b204 tempest-VolumesImageMetadata-914380581 None] Lock "cinder-66267c31-4115-4c85-96d4-388e87f41361-delete_volume" released by "delete_volume" :: held 2.036s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:54:01 devstack sudo[97792]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-79705078-8562-4675-9e55-a3ab5e022e7a /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8988efc5-58df-4fe5-8fcf-5e28373dfe6b" returned: 0 in 7.522s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:01 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] Image conversion details: src /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-79705078-8562-4675-9e55-a3ab5e022e7a, size 1024.00 MB, duration 7.52 sec, destination /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8988efc5-58df-4fe5-8fcf-5e28373dfe6b {{(pid=87068) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 17:54:01 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] Converted 1024.00 MB image at 136.12 MB/s Nov 06 17:54:01 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8988efc5-58df-4fe5-8fcf-5e28373dfe6b is being set with open permissions: ugo+rw Nov 06 17:54:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8988efc5-58df-4fe5-8fcf-5e28373dfe6b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:01 devstack sudo[97827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8988efc5-58df-4fe5-8fcf-5e28373dfe6b Nov 06 17:54:01 devstack sudo[97827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:01 devstack sudo[97827]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8988efc5-58df-4fe5-8fcf-5e28373dfe6b" returned: 0 in 0.251s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:01 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] Lock "cinder-quobyte-8988efc5-58df-4fe5-8fcf-5e28373dfe6b" released by "_copy_volume_from_snapshot" :: held 8.713s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:54:01 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] Acquiring lock "cinder-quobyte-bd1370e6-e7c2-46e9-bed9-5f7f47fd3cad" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:54:01 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] Lock "cinder-quobyte-bd1370e6-e7c2-46e9-bed9-5f7f47fd3cad" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:54:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] Deleting offline snapshot bd1370e6-e7c2-46e9-bed9-5f7f47fd3cad of volume 79705078-8562-4675-9e55-a3ab5e022e7a {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 17:54:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] snapshot_file for this snap is: volume-79705078-8562-4675-9e55-a3ab5e022e7a.bd1370e6-e7c2-46e9-bed9-5f7f47fd3cad {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 17:54:01 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec95ec39-9114-44f9-9c0c-7849f52d4c38]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:54:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-79705078-8562-4675-9e55-a3ab5e022e7a.bd1370e6-e7c2-46e9-bed9-5f7f47fd3cad {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:01 devstack sudo[97830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-79705078-8562-4675-9e55-a3ab5e022e7a.bd1370e6-e7c2-46e9-bed9-5f7f47fd3cad Nov 06 17:54:01 devstack sudo[97830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:02 devstack sudo[97830]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-79705078-8562-4675-9e55-a3ab5e022e7a.bd1370e6-e7c2-46e9-bed9-5f7f47fd3cad" returned: 0 in 0.376s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:02 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79705078-8562-4675-9e55-a3ab5e022e7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 17:54:02 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3c718a-c0fd-413a-9ed7-2bdc0597c097]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:54:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-79705078-8562-4675-9e55-a3ab5e022e7a {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:02 devstack sudo[97835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-79705078-8562-4675-9e55-a3ab5e022e7a Nov 06 17:54:02 devstack sudo[97835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:02 devstack sudo[97835]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-79705078-8562-4675-9e55-a3ab5e022e7a" returned: 0 in 0.556s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-79705078-8562-4675-9e55-a3ab5e022e7a.bd1370e6-e7c2-46e9-bed9-5f7f47fd3cad {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:02 devstack sudo[97841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-79705078-8562-4675-9e55-a3ab5e022e7a.bd1370e6-e7c2-46e9-bed9-5f7f47fd3cad Nov 06 17:54:02 devstack sudo[97841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:03 devstack sudo[97841]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-79705078-8562-4675-9e55-a3ab5e022e7a.bd1370e6-e7c2-46e9-bed9-5f7f47fd3cad" returned: 0 in 0.373s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-79705078-8562-4675-9e55-a3ab5e022e7a.bd1370e6-e7c2-46e9-bed9-5f7f47fd3cad {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:03 devstack sudo[97847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-79705078-8562-4675-9e55-a3ab5e022e7a.bd1370e6-e7c2-46e9-bed9-5f7f47fd3cad Nov 06 17:54:03 devstack sudo[97847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:03 devstack sudo[97847]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-79705078-8562-4675-9e55-a3ab5e022e7a.bd1370e6-e7c2-46e9-bed9-5f7f47fd3cad" returned: 0 in 0.246s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:03 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] Lock "cinder-quobyte-bd1370e6-e7c2-46e9-bed9-5f7f47fd3cad" released by "_delete_snapshot" :: held 1.661s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:54:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.083s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:54:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-27aed179-76aa-49a8-8ae9-d3bca5615d5f tempest-VolumesActionsTest-404676404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 13.542s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:54:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f111079b-949f-4f32-b4f7-a43058127fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8988efc5-58df-4fe5-8fcf-5e28373dfe6b', 'volume_size': 1, 'source_volid': '79705078-8562-4675-9e55-a3ab5e022e7a', 'source_volstatus': 'available'}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83c535fd-7f5f-4a7a-8407-b4d99f435f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:03 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5983e710-6c46-487f-b86f-05bdb37cd7b2]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:54:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-27aed179-76aa-49a8-8ae9-d3bca5615d5f tempest-VolumesActionsTest-404676404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d5f35b33-fa78-4485-8e77-db85147e5172 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:03 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] Volume volume-8988efc5-58df-4fe5-8fcf-5e28373dfe6b (8988efc5-58df-4fe5-8fcf-5e28373dfe6b): created successfully Nov 06 17:54:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83c535fd-7f5f-4a7a-8407-b4d99f435f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] Flow 'volume_create_manager' (aea13b32-9818-4d2b-89b9-5ca92be89907) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:54:03 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-89129d28-fa39-471f-afdc-207f535716a5 tempest-VolumesGetTest-154484293 None] Created volume successfully. Nov 06 17:54:03 devstack sudo[97850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d5f35b33-fa78-4485-8e77-db85147e5172 Nov 06 17:54:03 devstack sudo[97850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:03 devstack sudo[97850]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-27aed179-76aa-49a8-8ae9-d3bca5615d5f tempest-VolumesActionsTest-404676404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d5f35b33-fa78-4485-8e77-db85147e5172" returned: 0 in 0.423s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:03 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ba7412-6fee-4d6c-b9ec-61b72442dbda]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:54:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-27aed179-76aa-49a8-8ae9-d3bca5615d5f tempest-VolumesActionsTest-404676404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d5f35b33-fa78-4485-8e77-db85147e5172 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:04 devstack sudo[97855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d5f35b33-fa78-4485-8e77-db85147e5172 Nov 06 17:54:04 devstack sudo[97855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:04 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bb45880-c3bb-4d31-9cdc-341169f1051d tempest-AbsoluteLimitsTests-383743753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:54:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9bb45880-c3bb-4d31-9cdc-341169f1051d tempest-AbsoluteLimitsTests-383743753 None] Flow 'volume_create_manager' (3b2dc24d-49c1-456b-b4e9-95c903cdd4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:54:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9bb45880-c3bb-4d31-9cdc-341169f1051d tempest-AbsoluteLimitsTests-383743753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fb5fb78-8143-442c-bb63-df5862b0d392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9bb45880-c3bb-4d31-9cdc-341169f1051d tempest-AbsoluteLimitsTests-383743753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fb5fb78-8143-442c-bb63-df5862b0d392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-864626612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d925053f-4e43-4d35-82c7-df14c8b2e89f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='592a3e5ff17f4db7b74d1cba7c839541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:54:04Z,use_quota=True,user_id='2a5576a65eb24d62b9bebfe765107bec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9bb45880-c3bb-4d31-9cdc-341169f1051d tempest-AbsoluteLimitsTests-383743753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13c888dc-fcaf-43e3-9221-da70a2eafe9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9bb45880-c3bb-4d31-9cdc-341169f1051d tempest-AbsoluteLimitsTests-383743753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13c888dc-fcaf-43e3-9221-da70a2eafe9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9bb45880-c3bb-4d31-9cdc-341169f1051d tempest-AbsoluteLimitsTests-383743753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de96389d-3d9b-4408-890e-c1edf9b7eba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9bb45880-c3bb-4d31-9cdc-341169f1051d tempest-AbsoluteLimitsTests-383743753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de96389d-3d9b-4408-890e-c1edf9b7eba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd925053f-4e43-4d35-82c7-df14c8b2e89f', 'volume_name': 'volume-d925053f-4e43-4d35-82c7-df14c8b2e89f', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9bb45880-c3bb-4d31-9cdc-341169f1051d tempest-AbsoluteLimitsTests-383743753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc0dcffc-9623-40bc-b61a-86ca571b42e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9bb45880-c3bb-4d31-9cdc-341169f1051d tempest-AbsoluteLimitsTests-383743753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc0dcffc-9623-40bc-b61a-86ca571b42e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9bb45880-c3bb-4d31-9cdc-341169f1051d tempest-AbsoluteLimitsTests-383743753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a82c895-f518-47e2-979d-65bf9d472d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:04 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-9bb45880-c3bb-4d31-9cdc-341169f1051d tempest-AbsoluteLimitsTests-383743753 None] Volume d925053f-4e43-4d35-82c7-df14c8b2e89f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d925053f-4e43-4d35-82c7-df14c8b2e89f', 'volume_size': 1} Nov 06 17:54:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9bb45880-c3bb-4d31-9cdc-341169f1051d tempest-AbsoluteLimitsTests-383743753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:54:04 devstack sudo[97855]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-27aed179-76aa-49a8-8ae9-d3bca5615d5f tempest-VolumesActionsTest-404676404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d5f35b33-fa78-4485-8e77-db85147e5172" returned: 0 in 0.399s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-27aed179-76aa-49a8-8ae9-d3bca5615d5f tempest-VolumesActionsTest-404676404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d5f35b33-fa78-4485-8e77-db85147e5172 /opt/stack/data/cinder/conversion/d5f35b33-fa78-4485-8e77-db85147e5172.temp_image.ad88619a-ee51-4718-ae69-0f6c4097674e4zraree6.img {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:04 devstack sudo[97860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d5f35b33-fa78-4485-8e77-db85147e5172 /opt/stack/data/cinder/conversion/d5f35b33-fa78-4485-8e77-db85147e5172.temp_image.ad88619a-ee51-4718-ae69-0f6c4097674e4zraree6.img Nov 06 17:54:04 devstack sudo[97860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:04 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ddd1c47-e8fa-492f-a24d-8ee26b82cb56 tempest-VolumesGetTest-154484293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:54:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6ddd1c47-e8fa-492f-a24d-8ee26b82cb56 tempest-VolumesGetTest-154484293 None] Flow 'volume_create_manager' (5db157c6-3fbd-4309-b3a1-4dc55edc5cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:54:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6ddd1c47-e8fa-492f-a24d-8ee26b82cb56 tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (414fa752-620e-4472-a51b-ec2f7a5b23e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6ddd1c47-e8fa-492f-a24d-8ee26b82cb56 tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (414fa752-620e-4472-a51b-ec2f7a5b23e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:54:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-818506481',display_name='tempest-VolumesGetTest-Volume-1368604464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7da98f4b-f2ca-493b-8342-aa426f9af496,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83b317dc0b0f4329aa3bf9863f7ddd5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:54:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:54:05Z,use_quota=True,user_id='ea09cba9a9d94ad6a595472e62d9a066',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6ddd1c47-e8fa-492f-a24d-8ee26b82cb56 tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ffca5db-4152-4c16-b6f8-513ff63284ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6ddd1c47-e8fa-492f-a24d-8ee26b82cb56 tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ffca5db-4152-4c16-b6f8-513ff63284ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6ddd1c47-e8fa-492f-a24d-8ee26b82cb56 tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c13853c3-e7c0-4e3b-9fe0-0ae1850a8055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6ddd1c47-e8fa-492f-a24d-8ee26b82cb56 tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c13853c3-e7c0-4e3b-9fe0-0ae1850a8055) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7da98f4b-f2ca-493b-8342-aa426f9af496', 'volume_name': 'volume-7da98f4b-f2ca-493b-8342-aa426f9af496', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6ddd1c47-e8fa-492f-a24d-8ee26b82cb56 tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b870ed4-254e-4e32-aac5-558522d60872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6ddd1c47-e8fa-492f-a24d-8ee26b82cb56 tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b870ed4-254e-4e32-aac5-558522d60872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6ddd1c47-e8fa-492f-a24d-8ee26b82cb56 tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b43d017e-7847-4586-a569-e3a4daa284e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:04 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-6ddd1c47-e8fa-492f-a24d-8ee26b82cb56 tempest-VolumesGetTest-154484293 None] Volume 7da98f4b-f2ca-493b-8342-aa426f9af496: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7da98f4b-f2ca-493b-8342-aa426f9af496', 'volume_size': 1} Nov 06 17:54:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6ddd1c47-e8fa-492f-a24d-8ee26b82cb56 tempest-VolumesGetTest-154484293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:54:10 devstack sudo[97860]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-27aed179-76aa-49a8-8ae9-d3bca5615d5f tempest-VolumesActionsTest-404676404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d5f35b33-fa78-4485-8e77-db85147e5172 /opt/stack/data/cinder/conversion/d5f35b33-fa78-4485-8e77-db85147e5172.temp_image.ad88619a-ee51-4718-ae69-0f6c4097674e4zraree6.img" returned: 0 in 6.047s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:10 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[491d3b67-8ff0-4c19-9ec8-15f78b47a474]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:54:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-27aed179-76aa-49a8-8ae9-d3bca5615d5f tempest-VolumesActionsTest-404676404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d5f35b33-fa78-4485-8e77-db85147e5172 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:10 devstack sudo[97873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d5f35b33-fa78-4485-8e77-db85147e5172 Nov 06 17:54:10 devstack sudo[97873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:10 devstack sudo[97873]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-27aed179-76aa-49a8-8ae9-d3bca5615d5f tempest-VolumesActionsTest-404676404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d5f35b33-fa78-4485-8e77-db85147e5172" returned: 0 in 0.505s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:10 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-27aed179-76aa-49a8-8ae9-d3bca5615d5f tempest-VolumesActionsTest-404676404 None] Image conversion details: src /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d5f35b33-fa78-4485-8e77-db85147e5172, size 1024.00 MB, duration 6.05 sec, destination /opt/stack/data/cinder/conversion/d5f35b33-fa78-4485-8e77-db85147e5172.temp_image.ad88619a-ee51-4718-ae69-0f6c4097674e4zraree6.img {{(pid=87068) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 17:54:10 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-27aed179-76aa-49a8-8ae9-d3bca5615d5f tempest-VolumesActionsTest-404676404 None] Converted 1024.00 MB image at 169.31 MB/s Nov 06 17:54:10 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-27aed179-76aa-49a8-8ae9-d3bca5615d5f tempest-VolumesActionsTest-404676404 None] ad88619a-ee51-4718-ae69-0f6c4097674e was raw, converting to qcow2 {{(pid=87068) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Nov 06 17:54:10 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5785f5-1699-4bdb-8ddd-3358611112ad]: (4, 'raw') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:54:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-27aed179-76aa-49a8-8ae9-d3bca5615d5f tempest-VolumesActionsTest-404676404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/d5f35b33-fa78-4485-8e77-db85147e5172.temp_image.ad88619a-ee51-4718-ae69-0f6c4097674e4zraree6.img {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:11 devstack sudo[97879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/d5f35b33-fa78-4485-8e77-db85147e5172.temp_image.ad88619a-ee51-4718-ae69-0f6c4097674e4zraree6.img Nov 06 17:54:11 devstack sudo[97879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:11 devstack sudo[97879]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-27aed179-76aa-49a8-8ae9-d3bca5615d5f tempest-VolumesActionsTest-404676404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/d5f35b33-fa78-4485-8e77-db85147e5172.temp_image.ad88619a-ee51-4718-ae69-0f6c4097674e4zraree6.img" returned: 0 in 0.317s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-27aed179-76aa-49a8-8ae9-d3bca5615d5f tempest-VolumesActionsTest-404676404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d5f35b33-fa78-4485-8e77-db85147e5172.temp_image.ad88619a-ee51-4718-ae69-0f6c4097674e4zraree6.img {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:11 devstack sudo[97883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d5f35b33-fa78-4485-8e77-db85147e5172.temp_image.ad88619a-ee51-4718-ae69-0f6c4097674e4zraree6.img Nov 06 17:54:11 devstack sudo[97883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:11 devstack sudo[97883]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-27aed179-76aa-49a8-8ae9-d3bca5615d5f tempest-VolumesActionsTest-404676404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d5f35b33-fa78-4485-8e77-db85147e5172.temp_image.ad88619a-ee51-4718-ae69-0f6c4097674e4zraree6.img" returned: 1 in 0.318s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-27aed179-76aa-49a8-8ae9-d3bca5615d5f tempest-VolumesActionsTest-404676404 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d5f35b33-fa78-4485-8e77-db85147e5172.temp_image.ad88619a-ee51-4718-ae69-0f6c4097674e4zraree6.img' failed. Not Retrying. {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 17:54:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-27aed179-76aa-49a8-8ae9-d3bca5615d5f tempest-VolumesActionsTest-404676404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/d5f35b33-fa78-4485-8e77-db85147e5172.temp_image.ad88619a-ee51-4718-ae69-0f6c4097674e4zraree6.img /opt/stack/data/cinder/conversion/vol_upload_vxey4hyr {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:11 devstack sudo[97888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/d5f35b33-fa78-4485-8e77-db85147e5172.temp_image.ad88619a-ee51-4718-ae69-0f6c4097674e4zraree6.img /opt/stack/data/cinder/conversion/vol_upload_vxey4hyr Nov 06 17:54:11 devstack sudo[97888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:11 devstack sudo[97888]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-27aed179-76aa-49a8-8ae9-d3bca5615d5f tempest-VolumesActionsTest-404676404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/d5f35b33-fa78-4485-8e77-db85147e5172.temp_image.ad88619a-ee51-4718-ae69-0f6c4097674e4zraree6.img /opt/stack/data/cinder/conversion/vol_upload_vxey4hyr" returned: 0 in 0.254s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:11 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-27aed179-76aa-49a8-8ae9-d3bca5615d5f tempest-VolumesActionsTest-404676404 None] Image conversion details: src /opt/stack/data/cinder/conversion/d5f35b33-fa78-4485-8e77-db85147e5172.temp_image.ad88619a-ee51-4718-ae69-0f6c4097674e4zraree6.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_vxey4hyr {{(pid=87068) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 17:54:11 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-27aed179-76aa-49a8-8ae9-d3bca5615d5f tempest-VolumesActionsTest-404676404 None] Converted 1024.00 MB image at 1024.00 MB/s Nov 06 17:54:11 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2a9aa1-b15c-4669-a6cc-42fdf7078c1c]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:54:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-27aed179-76aa-49a8-8ae9-d3bca5615d5f tempest-VolumesActionsTest-404676404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_vxey4hyr {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:11 devstack sudo[97893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_vxey4hyr Nov 06 17:54:11 devstack sudo[97893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:12 devstack sudo[97893]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-27aed179-76aa-49a8-8ae9-d3bca5615d5f tempest-VolumesActionsTest-404676404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_vxey4hyr" returned: 0 in 0.324s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-27aed179-76aa-49a8-8ae9-d3bca5615d5f tempest-VolumesActionsTest-404676404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.116s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:54:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-27aed179-76aa-49a8-8ae9-d3bca5615d5f tempest-VolumesActionsTest-404676404 None] Uploaded volume to glance image-id: ad88619a-ee51-4718-ae69-0f6c4097674e. {{(pid=87068) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 06 17:54:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d120b75-e309-47e0-a42d-29d7c1d690cd tempest-VolumesTestJSON-1277705981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 22.766s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:54:13 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3d120b75-e309-47e0-a42d-29d7c1d690cd tempest-VolumesTestJSON-1277705981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-576365884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ec7028d-7834-46a0-9d28-ee0b6772db03,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eceee33d074e4ed3bf85efb7fa57c5d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:53:51Z,use_quota=True,user_id='b213975080fc4ce0a90fb4fa17fed9cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:54:13 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-3d120b75-e309-47e0-a42d-29d7c1d690cd tempest-VolumesTestJSON-1277705981 None] Creating volume 9ec7028d-7834-46a0-9d28-ee0b6772db03 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:54:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d120b75-e309-47e0-a42d-29d7c1d690cd tempest-VolumesTestJSON-1277705981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:54:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d120b75-e309-47e0-a42d-29d7c1d690cd tempest-VolumesTestJSON-1277705981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:54:13 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3d120b75-e309-47e0-a42d-29d7c1d690cd tempest-VolumesTestJSON-1277705981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:54:13 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3d120b75-e309-47e0-a42d-29d7c1d690cd tempest-VolumesTestJSON-1277705981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:54:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d120b75-e309-47e0-a42d-29d7c1d690cd tempest-VolumesTestJSON-1277705981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:54:13 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3d120b75-e309-47e0-a42d-29d7c1d690cd tempest-VolumesTestJSON-1277705981 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:54:13 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-3d120b75-e309-47e0-a42d-29d7c1d690cd tempest-VolumesTestJSON-1277705981 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:54:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3d120b75-e309-47e0-a42d-29d7c1d690cd tempest-VolumesTestJSON-1277705981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9ec7028d-7834-46a0-9d28-ee0b6772db03 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:13 devstack sudo[97899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9ec7028d-7834-46a0-9d28-ee0b6772db03 1073741824 Nov 06 17:54:13 devstack sudo[97899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:13 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-27aed179-76aa-49a8-8ae9-d3bca5615d5f tempest-VolumesActionsTest-404676404 None] Copy volume to image completed successfully. Nov 06 17:54:14 devstack sudo[97899]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3d120b75-e309-47e0-a42d-29d7c1d690cd tempest-VolumesTestJSON-1277705981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9ec7028d-7834-46a0-9d28-ee0b6772db03 1073741824" returned: 0 in 0.437s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3d120b75-e309-47e0-a42d-29d7c1d690cd tempest-VolumesTestJSON-1277705981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9ec7028d-7834-46a0-9d28-ee0b6772db03 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:14 devstack sudo[97905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9ec7028d-7834-46a0-9d28-ee0b6772db03 Nov 06 17:54:14 devstack sudo[97905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:14 devstack sudo[97905]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3d120b75-e309-47e0-a42d-29d7c1d690cd tempest-VolumesTestJSON-1277705981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9ec7028d-7834-46a0-9d28-ee0b6772db03" returned: 0 in 0.256s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3d120b75-e309-47e0-a42d-29d7c1d690cd tempest-VolumesTestJSON-1277705981 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:54:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d120b75-e309-47e0-a42d-29d7c1d690cd tempest-VolumesTestJSON-1277705981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:54:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9bb45880-c3bb-4d31-9cdc-341169f1051d tempest-AbsoluteLimitsTests-383743753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.084s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:54:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9bb45880-c3bb-4d31-9cdc-341169f1051d tempest-AbsoluteLimitsTests-383743753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-864626612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d925053f-4e43-4d35-82c7-df14c8b2e89f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='592a3e5ff17f4db7b74d1cba7c839541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:54:04Z,use_quota=True,user_id='2a5576a65eb24d62b9bebfe765107bec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:54:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-9bb45880-c3bb-4d31-9cdc-341169f1051d tempest-AbsoluteLimitsTests-383743753 None] Creating volume d925053f-4e43-4d35-82c7-df14c8b2e89f {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:54:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9bb45880-c3bb-4d31-9cdc-341169f1051d tempest-AbsoluteLimitsTests-383743753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:54:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9bb45880-c3bb-4d31-9cdc-341169f1051d tempest-AbsoluteLimitsTests-383743753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:54:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9bb45880-c3bb-4d31-9cdc-341169f1051d tempest-AbsoluteLimitsTests-383743753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:54:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9bb45880-c3bb-4d31-9cdc-341169f1051d tempest-AbsoluteLimitsTests-383743753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:54:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9bb45880-c3bb-4d31-9cdc-341169f1051d tempest-AbsoluteLimitsTests-383743753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:54:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9bb45880-c3bb-4d31-9cdc-341169f1051d tempest-AbsoluteLimitsTests-383743753 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:54:14 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-9bb45880-c3bb-4d31-9cdc-341169f1051d tempest-AbsoluteLimitsTests-383743753 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:54:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9bb45880-c3bb-4d31-9cdc-341169f1051d tempest-AbsoluteLimitsTests-383743753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d925053f-4e43-4d35-82c7-df14c8b2e89f 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3d120b75-e309-47e0-a42d-29d7c1d690cd tempest-VolumesTestJSON-1277705981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9174fca-29e6-4c92-ab63-28fbd3ed0277) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ec7028d-7834-46a0-9d28-ee0b6772db03', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:14 devstack sudo[97908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d925053f-4e43-4d35-82c7-df14c8b2e89f 1073741824 Nov 06 17:54:14 devstack sudo[97908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3d120b75-e309-47e0-a42d-29d7c1d690cd tempest-VolumesTestJSON-1277705981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (955566e1-039e-4d27-a2dd-967efacfe7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:14 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-3d120b75-e309-47e0-a42d-29d7c1d690cd tempest-VolumesTestJSON-1277705981 None] Volume volume-9ec7028d-7834-46a0-9d28-ee0b6772db03 (9ec7028d-7834-46a0-9d28-ee0b6772db03): created successfully Nov 06 17:54:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3d120b75-e309-47e0-a42d-29d7c1d690cd tempest-VolumesTestJSON-1277705981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (955566e1-039e-4d27-a2dd-967efacfe7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3d120b75-e309-47e0-a42d-29d7c1d690cd tempest-VolumesTestJSON-1277705981 None] Flow 'volume_create_manager' (09051276-43da-4dd4-b98f-41bbb820d960) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:54:14 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-3d120b75-e309-47e0-a42d-29d7c1d690cd tempest-VolumesTestJSON-1277705981 None] Created volume successfully. Nov 06 17:54:14 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9e94e113-281d-47b0-a8d8-1d99154ccb12 tempest-VolumesActionsTest-404676404 None] Acquiring lock "cinder-d5f35b33-fa78-4485-8e77-db85147e5172-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:54:14 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9e94e113-281d-47b0-a8d8-1d99154ccb12 tempest-VolumesActionsTest-404676404 None] Lock "cinder-d5f35b33-fa78-4485-8e77-db85147e5172-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:54:14 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9e94e113-281d-47b0-a8d8-1d99154ccb12 tempest-VolumesActionsTest-404676404 None] Acquiring lock "cinder-quobyte-d5f35b33-fa78-4485-8e77-db85147e5172" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:54:14 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9e94e113-281d-47b0-a8d8-1d99154ccb12 tempest-VolumesActionsTest-404676404 None] Lock "cinder-quobyte-d5f35b33-fa78-4485-8e77-db85147e5172" acquired by "delete_volume" :: waited 0.017s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:54:14 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[82efc712-d1e1-4256-af0b-2ded339a0b2f]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:54:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9e94e113-281d-47b0-a8d8-1d99154ccb12 tempest-VolumesActionsTest-404676404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d5f35b33-fa78-4485-8e77-db85147e5172 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:14 devstack sudo[97908]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9bb45880-c3bb-4d31-9cdc-341169f1051d tempest-AbsoluteLimitsTests-383743753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d925053f-4e43-4d35-82c7-df14c8b2e89f 1073741824" returned: 0 in 0.497s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:14 devstack sudo[97914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d5f35b33-fa78-4485-8e77-db85147e5172 Nov 06 17:54:14 devstack sudo[97914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9bb45880-c3bb-4d31-9cdc-341169f1051d tempest-AbsoluteLimitsTests-383743753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d925053f-4e43-4d35-82c7-df14c8b2e89f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:14 devstack sudo[97916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d925053f-4e43-4d35-82c7-df14c8b2e89f Nov 06 17:54:14 devstack sudo[97916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:15 devstack sudo[97914]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9e94e113-281d-47b0-a8d8-1d99154ccb12 tempest-VolumesActionsTest-404676404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d5f35b33-fa78-4485-8e77-db85147e5172" returned: 0 in 0.390s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9e94e113-281d-47b0-a8d8-1d99154ccb12 tempest-VolumesActionsTest-404676404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d5f35b33-fa78-4485-8e77-db85147e5172 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:15 devstack sudo[97916]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9bb45880-c3bb-4d31-9cdc-341169f1051d tempest-AbsoluteLimitsTests-383743753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d925053f-4e43-4d35-82c7-df14c8b2e89f" returned: 0 in 0.249s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:15 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9bb45880-c3bb-4d31-9cdc-341169f1051d tempest-AbsoluteLimitsTests-383743753 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:54:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9bb45880-c3bb-4d31-9cdc-341169f1051d tempest-AbsoluteLimitsTests-383743753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:54:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6ddd1c47-e8fa-492f-a24d-8ee26b82cb56 tempest-VolumesGetTest-154484293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.328s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:54:15 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-6ddd1c47-e8fa-492f-a24d-8ee26b82cb56 tempest-VolumesGetTest-154484293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:54:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-818506481',display_name='tempest-VolumesGetTest-Volume-1368604464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7da98f4b-f2ca-493b-8342-aa426f9af496,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83b317dc0b0f4329aa3bf9863f7ddd5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:54:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:54:05Z,use_quota=True,user_id='ea09cba9a9d94ad6a595472e62d9a066',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:54:15 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-6ddd1c47-e8fa-492f-a24d-8ee26b82cb56 tempest-VolumesGetTest-154484293 None] Creating volume 7da98f4b-f2ca-493b-8342-aa426f9af496 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:54:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6ddd1c47-e8fa-492f-a24d-8ee26b82cb56 tempest-VolumesGetTest-154484293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:54:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6ddd1c47-e8fa-492f-a24d-8ee26b82cb56 tempest-VolumesGetTest-154484293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:54:15 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-6ddd1c47-e8fa-492f-a24d-8ee26b82cb56 tempest-VolumesGetTest-154484293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:54:15 devstack sudo[97922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d5f35b33-fa78-4485-8e77-db85147e5172 Nov 06 17:54:15 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-6ddd1c47-e8fa-492f-a24d-8ee26b82cb56 tempest-VolumesGetTest-154484293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:54:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6ddd1c47-e8fa-492f-a24d-8ee26b82cb56 tempest-VolumesGetTest-154484293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:54:15 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-6ddd1c47-e8fa-492f-a24d-8ee26b82cb56 tempest-VolumesGetTest-154484293 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:54:15 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-6ddd1c47-e8fa-492f-a24d-8ee26b82cb56 tempest-VolumesGetTest-154484293 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:54:15 devstack sudo[97922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6ddd1c47-e8fa-492f-a24d-8ee26b82cb56 tempest-VolumesGetTest-154484293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7da98f4b-f2ca-493b-8342-aa426f9af496 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9bb45880-c3bb-4d31-9cdc-341169f1051d tempest-AbsoluteLimitsTests-383743753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a82c895-f518-47e2-979d-65bf9d472d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d925053f-4e43-4d35-82c7-df14c8b2e89f', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:15 devstack sudo[97924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7da98f4b-f2ca-493b-8342-aa426f9af496 1073741824 Nov 06 17:54:15 devstack sudo[97924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9bb45880-c3bb-4d31-9cdc-341169f1051d tempest-AbsoluteLimitsTests-383743753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d067d096-d337-49eb-8063-ce80fcb1f3fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:15 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-9bb45880-c3bb-4d31-9cdc-341169f1051d tempest-AbsoluteLimitsTests-383743753 None] Volume volume-d925053f-4e43-4d35-82c7-df14c8b2e89f (d925053f-4e43-4d35-82c7-df14c8b2e89f): created successfully Nov 06 17:54:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9bb45880-c3bb-4d31-9cdc-341169f1051d tempest-AbsoluteLimitsTests-383743753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d067d096-d337-49eb-8063-ce80fcb1f3fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9bb45880-c3bb-4d31-9cdc-341169f1051d tempest-AbsoluteLimitsTests-383743753 None] Flow 'volume_create_manager' (3b2dc24d-49c1-456b-b4e9-95c903cdd4f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:54:15 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-9bb45880-c3bb-4d31-9cdc-341169f1051d tempest-AbsoluteLimitsTests-383743753 None] Created volume successfully. Nov 06 17:54:15 devstack sudo[97922]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9e94e113-281d-47b0-a8d8-1d99154ccb12 tempest-VolumesActionsTest-404676404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d5f35b33-fa78-4485-8e77-db85147e5172" returned: 0 in 0.259s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:15 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9e94e113-281d-47b0-a8d8-1d99154ccb12 tempest-VolumesActionsTest-404676404 None] Lock "cinder-quobyte-d5f35b33-fa78-4485-8e77-db85147e5172" released by "delete_volume" :: held 0.691s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:54:15 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-9e94e113-281d-47b0-a8d8-1d99154ccb12 tempest-VolumesActionsTest-404676404 None] Created reservations ['92c0e37c-b254-4533-8de6-861f4abbc8c6', 'b1b74703-3ad2-4dd0-b05d-a3469686f1c0', 'f6430f96-7b9c-4dae-8698-6dd92f0f37b5', 'ff2066f0-8e91-4f53-8d5d-e6e9d87dcf05'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:54:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9e94e113-281d-47b0-a8d8-1d99154ccb12 tempest-VolumesActionsTest-404676404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:54:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9e94e113-281d-47b0-a8d8-1d99154ccb12 tempest-VolumesActionsTest-404676404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:54:15 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9e94e113-281d-47b0-a8d8-1d99154ccb12 tempest-VolumesActionsTest-404676404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:54:15 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9e94e113-281d-47b0-a8d8-1d99154ccb12 tempest-VolumesActionsTest-404676404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:54:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9e94e113-281d-47b0-a8d8-1d99154ccb12 tempest-VolumesActionsTest-404676404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:54:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9e94e113-281d-47b0-a8d8-1d99154ccb12 tempest-VolumesActionsTest-404676404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:15 devstack sudo[97931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:54:15 devstack sudo[97931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:15 devstack sudo[97924]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6ddd1c47-e8fa-492f-a24d-8ee26b82cb56 tempest-VolumesGetTest-154484293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7da98f4b-f2ca-493b-8342-aa426f9af496 1073741824" returned: 0 in 0.526s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6ddd1c47-e8fa-492f-a24d-8ee26b82cb56 tempest-VolumesGetTest-154484293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7da98f4b-f2ca-493b-8342-aa426f9af496 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:15 devstack sudo[97933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7da98f4b-f2ca-493b-8342-aa426f9af496 Nov 06 17:54:15 devstack sudo[97933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:15 devstack sudo[97931]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9e94e113-281d-47b0-a8d8-1d99154ccb12 tempest-VolumesActionsTest-404676404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.282s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:15 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-9e94e113-281d-47b0-a8d8-1d99154ccb12 tempest-VolumesActionsTest-404676404 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:54:15 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-9e94e113-281d-47b0-a8d8-1d99154ccb12 tempest-VolumesActionsTest-404676404 None] Deleted volume successfully. Nov 06 17:54:15 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9e94e113-281d-47b0-a8d8-1d99154ccb12 tempest-VolumesActionsTest-404676404 None] Lock "cinder-d5f35b33-fa78-4485-8e77-db85147e5172-delete_volume" released by "delete_volume" :: held 1.232s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:54:16 devstack sudo[97933]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6ddd1c47-e8fa-492f-a24d-8ee26b82cb56 tempest-VolumesGetTest-154484293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7da98f4b-f2ca-493b-8342-aa426f9af496" returned: 0 in 0.327s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-6ddd1c47-e8fa-492f-a24d-8ee26b82cb56 tempest-VolumesGetTest-154484293 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:54:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6ddd1c47-e8fa-492f-a24d-8ee26b82cb56 tempest-VolumesGetTest-154484293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:54:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6ddd1c47-e8fa-492f-a24d-8ee26b82cb56 tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b43d017e-7847-4586-a569-e3a4daa284e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7da98f4b-f2ca-493b-8342-aa426f9af496', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6ddd1c47-e8fa-492f-a24d-8ee26b82cb56 tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d7c5e52-21a6-4cfa-85dc-7bb98d6ee4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:16 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-6ddd1c47-e8fa-492f-a24d-8ee26b82cb56 tempest-VolumesGetTest-154484293 None] Volume volume-7da98f4b-f2ca-493b-8342-aa426f9af496 (7da98f4b-f2ca-493b-8342-aa426f9af496): created successfully Nov 06 17:54:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6ddd1c47-e8fa-492f-a24d-8ee26b82cb56 tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d7c5e52-21a6-4cfa-85dc-7bb98d6ee4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6ddd1c47-e8fa-492f-a24d-8ee26b82cb56 tempest-VolumesGetTest-154484293 None] Flow 'volume_create_manager' (5db157c6-3fbd-4309-b3a1-4dc55edc5cd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:54:16 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-6ddd1c47-e8fa-492f-a24d-8ee26b82cb56 tempest-VolumesGetTest-154484293 None] Created volume successfully. Nov 06 17:54:16 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-59afe9a5-3edf-4379-a51d-d52aec87a3c8 tempest-VolumesTestJSON-1277705981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:54:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-59afe9a5-3edf-4379-a51d-d52aec87a3c8 tempest-VolumesTestJSON-1277705981 None] Flow 'volume_create_manager' (5efe9422-97ba-446b-8339-373c72eb13bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:54:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-59afe9a5-3edf-4379-a51d-d52aec87a3c8 tempest-VolumesTestJSON-1277705981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (147f6ca0-4740-4e94-8adb-753ca642087b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:16 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f016763d-304b-4011-b347-6c586d196aff tempest-AbsoluteLimitsTests-383743753 None] Acquiring lock "cinder-d925053f-4e43-4d35-82c7-df14c8b2e89f-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:54:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-59afe9a5-3edf-4379-a51d-d52aec87a3c8 tempest-VolumesTestJSON-1277705981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (147f6ca0-4740-4e94-8adb-753ca642087b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-356440772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a66919e-eebb-47a1-94c4-f6d908100615,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eceee33d074e4ed3bf85efb7fa57c5d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:54:16Z,use_quota=True,user_id='b213975080fc4ce0a90fb4fa17fed9cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-59afe9a5-3edf-4379-a51d-d52aec87a3c8 tempest-VolumesTestJSON-1277705981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a34d203-de54-47e5-a13c-512debfee987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-59afe9a5-3edf-4379-a51d-d52aec87a3c8 tempest-VolumesTestJSON-1277705981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a34d203-de54-47e5-a13c-512debfee987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-59afe9a5-3edf-4379-a51d-d52aec87a3c8 tempest-VolumesTestJSON-1277705981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e88d4b0-83cb-4b9d-a324-fe60dca96bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-59afe9a5-3edf-4379-a51d-d52aec87a3c8 tempest-VolumesTestJSON-1277705981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e88d4b0-83cb-4b9d-a324-fe60dca96bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a66919e-eebb-47a1-94c4-f6d908100615', 'volume_name': 'volume-5a66919e-eebb-47a1-94c4-f6d908100615', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-59afe9a5-3edf-4379-a51d-d52aec87a3c8 tempest-VolumesTestJSON-1277705981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17fd0435-4d91-45b1-8792-42290f45228a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-59afe9a5-3edf-4379-a51d-d52aec87a3c8 tempest-VolumesTestJSON-1277705981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17fd0435-4d91-45b1-8792-42290f45228a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-59afe9a5-3edf-4379-a51d-d52aec87a3c8 tempest-VolumesTestJSON-1277705981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42a2ceaa-7d74-491e-8008-008ebb2c0219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:16 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-59afe9a5-3edf-4379-a51d-d52aec87a3c8 tempest-VolumesTestJSON-1277705981 None] Volume 5a66919e-eebb-47a1-94c4-f6d908100615: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a66919e-eebb-47a1-94c4-f6d908100615', 'volume_size': 1} Nov 06 17:54:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-59afe9a5-3edf-4379-a51d-d52aec87a3c8 tempest-VolumesTestJSON-1277705981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:54:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-59afe9a5-3edf-4379-a51d-d52aec87a3c8 tempest-VolumesTestJSON-1277705981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:54:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-59afe9a5-3edf-4379-a51d-d52aec87a3c8 tempest-VolumesTestJSON-1277705981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-356440772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a66919e-eebb-47a1-94c4-f6d908100615,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eceee33d074e4ed3bf85efb7fa57c5d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:54:16Z,use_quota=True,user_id='b213975080fc4ce0a90fb4fa17fed9cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:54:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-59afe9a5-3edf-4379-a51d-d52aec87a3c8 tempest-VolumesTestJSON-1277705981 None] Creating volume 5a66919e-eebb-47a1-94c4-f6d908100615 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:54:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-59afe9a5-3edf-4379-a51d-d52aec87a3c8 tempest-VolumesTestJSON-1277705981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:54:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-59afe9a5-3edf-4379-a51d-d52aec87a3c8 tempest-VolumesTestJSON-1277705981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:54:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-59afe9a5-3edf-4379-a51d-d52aec87a3c8 tempest-VolumesTestJSON-1277705981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:54:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-59afe9a5-3edf-4379-a51d-d52aec87a3c8 tempest-VolumesTestJSON-1277705981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:54:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-59afe9a5-3edf-4379-a51d-d52aec87a3c8 tempest-VolumesTestJSON-1277705981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:54:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-59afe9a5-3edf-4379-a51d-d52aec87a3c8 tempest-VolumesTestJSON-1277705981 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:54:16 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-59afe9a5-3edf-4379-a51d-d52aec87a3c8 tempest-VolumesTestJSON-1277705981 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:54:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-59afe9a5-3edf-4379-a51d-d52aec87a3c8 tempest-VolumesTestJSON-1277705981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5a66919e-eebb-47a1-94c4-f6d908100615 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:16 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f016763d-304b-4011-b347-6c586d196aff tempest-AbsoluteLimitsTests-383743753 None] Lock "cinder-d925053f-4e43-4d35-82c7-df14c8b2e89f-delete_volume" acquired by "delete_volume" :: waited 0.096s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:54:16 devstack sudo[97937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5a66919e-eebb-47a1-94c4-f6d908100615 1073741824 Nov 06 17:54:16 devstack sudo[97937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:16 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f016763d-304b-4011-b347-6c586d196aff tempest-AbsoluteLimitsTests-383743753 None] Acquiring lock "cinder-quobyte-d925053f-4e43-4d35-82c7-df14c8b2e89f" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:54:16 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f016763d-304b-4011-b347-6c586d196aff tempest-AbsoluteLimitsTests-383743753 None] Lock "cinder-quobyte-d925053f-4e43-4d35-82c7-df14c8b2e89f" acquired by "delete_volume" :: waited 0.016s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:54:16 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ac541a-840e-4cd9-b007-77ed02fe7437]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:54:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f016763d-304b-4011-b347-6c586d196aff tempest-AbsoluteLimitsTests-383743753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d925053f-4e43-4d35-82c7-df14c8b2e89f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:16 devstack sudo[97939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d925053f-4e43-4d35-82c7-df14c8b2e89f Nov 06 17:54:16 devstack sudo[97939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:16 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-97d9d182-bb73-458b-8c00-5877d813af30 tempest-VolumesGetTest-154484293 None] Acquiring lock "cinder-7da98f4b-f2ca-493b-8342-aa426f9af496-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:54:16 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-97d9d182-bb73-458b-8c00-5877d813af30 tempest-VolumesGetTest-154484293 None] Lock "cinder-7da98f4b-f2ca-493b-8342-aa426f9af496-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:54:16 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-97d9d182-bb73-458b-8c00-5877d813af30 tempest-VolumesGetTest-154484293 None] Acquiring lock "cinder-quobyte-7da98f4b-f2ca-493b-8342-aa426f9af496" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:54:16 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-97d9d182-bb73-458b-8c00-5877d813af30 tempest-VolumesGetTest-154484293 None] Lock "cinder-quobyte-7da98f4b-f2ca-493b-8342-aa426f9af496" acquired by "delete_volume" :: waited 0.022s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:54:16 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a0db3d-0be7-4742-b73d-260c98817044]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:54:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97d9d182-bb73-458b-8c00-5877d813af30 tempest-VolumesGetTest-154484293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7da98f4b-f2ca-493b-8342-aa426f9af496 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:17 devstack sudo[97939]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f016763d-304b-4011-b347-6c586d196aff tempest-AbsoluteLimitsTests-383743753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d925053f-4e43-4d35-82c7-df14c8b2e89f" returned: 0 in 0.501s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f016763d-304b-4011-b347-6c586d196aff tempest-AbsoluteLimitsTests-383743753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d925053f-4e43-4d35-82c7-df14c8b2e89f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:17 devstack sudo[97949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d925053f-4e43-4d35-82c7-df14c8b2e89f Nov 06 17:54:17 devstack sudo[97949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:17 devstack sudo[97946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7da98f4b-f2ca-493b-8342-aa426f9af496 Nov 06 17:54:17 devstack sudo[97946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:17 devstack sudo[97937]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-59afe9a5-3edf-4379-a51d-d52aec87a3c8 tempest-VolumesTestJSON-1277705981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5a66919e-eebb-47a1-94c4-f6d908100615 1073741824" returned: 0 in 0.709s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-59afe9a5-3edf-4379-a51d-d52aec87a3c8 tempest-VolumesTestJSON-1277705981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5a66919e-eebb-47a1-94c4-f6d908100615 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:17 devstack sudo[97952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5a66919e-eebb-47a1-94c4-f6d908100615 Nov 06 17:54:17 devstack sudo[97952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:17 devstack sudo[97949]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f016763d-304b-4011-b347-6c586d196aff tempest-AbsoluteLimitsTests-383743753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d925053f-4e43-4d35-82c7-df14c8b2e89f" returned: 0 in 0.322s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:17 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f016763d-304b-4011-b347-6c586d196aff tempest-AbsoluteLimitsTests-383743753 None] Lock "cinder-quobyte-d925053f-4e43-4d35-82c7-df14c8b2e89f" released by "delete_volume" :: held 0.877s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:54:17 devstack sudo[97946]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97d9d182-bb73-458b-8c00-5877d813af30 tempest-VolumesGetTest-154484293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7da98f4b-f2ca-493b-8342-aa426f9af496" returned: 0 in 0.481s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97d9d182-bb73-458b-8c00-5877d813af30 tempest-VolumesGetTest-154484293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7da98f4b-f2ca-493b-8342-aa426f9af496 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:17 devstack sudo[97958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7da98f4b-f2ca-493b-8342-aa426f9af496 Nov 06 17:54:17 devstack sudo[97958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:17 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-f016763d-304b-4011-b347-6c586d196aff tempest-AbsoluteLimitsTests-383743753 None] Created reservations ['7dafe2fe-446b-4e5e-869a-13e4ea3a2c72', '12d45860-4970-42e6-aff7-568006337436', '65a28ce4-e9be-47fb-8376-c62aaeef6671', 'f9860b03-5ea2-4584-aff8-7e139bcbb8dd'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:54:17 devstack sudo[97952]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-59afe9a5-3edf-4379-a51d-d52aec87a3c8 tempest-VolumesTestJSON-1277705981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5a66919e-eebb-47a1-94c4-f6d908100615" returned: 0 in 0.334s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-59afe9a5-3edf-4379-a51d-d52aec87a3c8 tempest-VolumesTestJSON-1277705981 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:54:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-59afe9a5-3edf-4379-a51d-d52aec87a3c8 tempest-VolumesTestJSON-1277705981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:54:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-59afe9a5-3edf-4379-a51d-d52aec87a3c8 tempest-VolumesTestJSON-1277705981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42a2ceaa-7d74-491e-8008-008ebb2c0219) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a66919e-eebb-47a1-94c4-f6d908100615', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-59afe9a5-3edf-4379-a51d-d52aec87a3c8 tempest-VolumesTestJSON-1277705981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51699be6-98b3-49ab-bc7b-6f72f5b281ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:17 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-59afe9a5-3edf-4379-a51d-d52aec87a3c8 tempest-VolumesTestJSON-1277705981 None] Volume volume-5a66919e-eebb-47a1-94c4-f6d908100615 (5a66919e-eebb-47a1-94c4-f6d908100615): created successfully Nov 06 17:54:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-59afe9a5-3edf-4379-a51d-d52aec87a3c8 tempest-VolumesTestJSON-1277705981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51699be6-98b3-49ab-bc7b-6f72f5b281ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-59afe9a5-3edf-4379-a51d-d52aec87a3c8 tempest-VolumesTestJSON-1277705981 None] Flow 'volume_create_manager' (5efe9422-97ba-446b-8339-373c72eb13bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:54:17 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-59afe9a5-3edf-4379-a51d-d52aec87a3c8 tempest-VolumesTestJSON-1277705981 None] Created volume successfully. Nov 06 17:54:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f016763d-304b-4011-b347-6c586d196aff tempest-AbsoluteLimitsTests-383743753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:54:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f016763d-304b-4011-b347-6c586d196aff tempest-AbsoluteLimitsTests-383743753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:54:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f016763d-304b-4011-b347-6c586d196aff tempest-AbsoluteLimitsTests-383743753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:54:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f016763d-304b-4011-b347-6c586d196aff tempest-AbsoluteLimitsTests-383743753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:54:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f016763d-304b-4011-b347-6c586d196aff tempest-AbsoluteLimitsTests-383743753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:54:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f016763d-304b-4011-b347-6c586d196aff tempest-AbsoluteLimitsTests-383743753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:17 devstack sudo[97961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:54:17 devstack sudo[97961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:17 devstack sudo[97958]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97d9d182-bb73-458b-8c00-5877d813af30 tempest-VolumesGetTest-154484293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7da98f4b-f2ca-493b-8342-aa426f9af496" returned: 0 in 0.287s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:17 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-97d9d182-bb73-458b-8c00-5877d813af30 tempest-VolumesGetTest-154484293 None] Lock "cinder-quobyte-7da98f4b-f2ca-493b-8342-aa426f9af496" released by "delete_volume" :: held 0.829s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:54:17 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-97d9d182-bb73-458b-8c00-5877d813af30 tempest-VolumesGetTest-154484293 None] Created reservations ['ac1f8091-8bfc-4e04-bec2-abccbb253cd5', '3797adab-ba3a-4b18-80c8-c6ae26687ef7', 'c6cd1815-d4c9-4206-bb30-339bd26f7b74', '652f92c9-a58f-4a78-b625-809f08f8a637'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:54:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-97d9d182-bb73-458b-8c00-5877d813af30 tempest-VolumesGetTest-154484293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:54:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-97d9d182-bb73-458b-8c00-5877d813af30 tempest-VolumesGetTest-154484293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:54:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-97d9d182-bb73-458b-8c00-5877d813af30 tempest-VolumesGetTest-154484293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:54:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-97d9d182-bb73-458b-8c00-5877d813af30 tempest-VolumesGetTest-154484293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:54:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-97d9d182-bb73-458b-8c00-5877d813af30 tempest-VolumesGetTest-154484293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:54:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97d9d182-bb73-458b-8c00-5877d813af30 tempest-VolumesGetTest-154484293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:17 devstack sudo[97961]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f016763d-304b-4011-b347-6c586d196aff tempest-AbsoluteLimitsTests-383743753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.330s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:17 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-f016763d-304b-4011-b347-6c586d196aff tempest-AbsoluteLimitsTests-383743753 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:54:17 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-f016763d-304b-4011-b347-6c586d196aff tempest-AbsoluteLimitsTests-383743753 None] Deleted volume successfully. Nov 06 17:54:17 devstack sudo[97966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:54:17 devstack sudo[97966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:17 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f016763d-304b-4011-b347-6c586d196aff tempest-AbsoluteLimitsTests-383743753 None] Lock "cinder-d925053f-4e43-4d35-82c7-df14c8b2e89f-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:54:18 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ccbef8e6-0efd-41e6-b9c0-eea36ffb46a0 tempest-VolumesGetTest-154484293 None] Acquiring lock "cinder-8988efc5-58df-4fe5-8fcf-5e28373dfe6b-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:54:18 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ccbef8e6-0efd-41e6-b9c0-eea36ffb46a0 tempest-VolumesGetTest-154484293 None] Lock "cinder-8988efc5-58df-4fe5-8fcf-5e28373dfe6b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:54:18 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ccbef8e6-0efd-41e6-b9c0-eea36ffb46a0 tempest-VolumesGetTest-154484293 None] Acquiring lock "cinder-quobyte-8988efc5-58df-4fe5-8fcf-5e28373dfe6b" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:54:18 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ccbef8e6-0efd-41e6-b9c0-eea36ffb46a0 tempest-VolumesGetTest-154484293 None] Lock "cinder-quobyte-8988efc5-58df-4fe5-8fcf-5e28373dfe6b" acquired by "delete_volume" :: waited 0.016s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:54:18 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc795035-3745-48ff-b297-8c37a298c699]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:54:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ccbef8e6-0efd-41e6-b9c0-eea36ffb46a0 tempest-VolumesGetTest-154484293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8988efc5-58df-4fe5-8fcf-5e28373dfe6b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:18 devstack sudo[97966]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97d9d182-bb73-458b-8c00-5877d813af30 tempest-VolumesGetTest-154484293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.297s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:18 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-97d9d182-bb73-458b-8c00-5877d813af30 tempest-VolumesGetTest-154484293 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:54:18 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-97d9d182-bb73-458b-8c00-5877d813af30 tempest-VolumesGetTest-154484293 None] Deleted volume successfully. Nov 06 17:54:18 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-97d9d182-bb73-458b-8c00-5877d813af30 tempest-VolumesGetTest-154484293 None] Lock "cinder-7da98f4b-f2ca-493b-8342-aa426f9af496-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:54:18 devstack sudo[97969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8988efc5-58df-4fe5-8fcf-5e28373dfe6b Nov 06 17:54:18 devstack sudo[97969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:18 devstack sudo[97969]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ccbef8e6-0efd-41e6-b9c0-eea36ffb46a0 tempest-VolumesGetTest-154484293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8988efc5-58df-4fe5-8fcf-5e28373dfe6b" returned: 0 in 0.424s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ccbef8e6-0efd-41e6-b9c0-eea36ffb46a0 tempest-VolumesGetTest-154484293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8988efc5-58df-4fe5-8fcf-5e28373dfe6b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:18 devstack sudo[97974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8988efc5-58df-4fe5-8fcf-5e28373dfe6b Nov 06 17:54:18 devstack sudo[97974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:18 devstack sudo[97974]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ccbef8e6-0efd-41e6-b9c0-eea36ffb46a0 tempest-VolumesGetTest-154484293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8988efc5-58df-4fe5-8fcf-5e28373dfe6b" returned: 0 in 0.284s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:18 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ccbef8e6-0efd-41e6-b9c0-eea36ffb46a0 tempest-VolumesGetTest-154484293 None] Lock "cinder-quobyte-8988efc5-58df-4fe5-8fcf-5e28373dfe6b" released by "delete_volume" :: held 0.782s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:54:18 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-ccbef8e6-0efd-41e6-b9c0-eea36ffb46a0 tempest-VolumesGetTest-154484293 None] Created reservations ['60352b5a-171d-4702-a93c-3e72e28064ce', '9db75a38-c3ab-478b-8f34-fa516eaca281', '148cb8e1-9e14-4363-934d-7e04f7ae4d26', 'cbac74bf-f3b3-4206-ab6e-f02043419c29'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:54:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ccbef8e6-0efd-41e6-b9c0-eea36ffb46a0 tempest-VolumesGetTest-154484293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:54:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ccbef8e6-0efd-41e6-b9c0-eea36ffb46a0 tempest-VolumesGetTest-154484293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:54:19 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ccbef8e6-0efd-41e6-b9c0-eea36ffb46a0 tempest-VolumesGetTest-154484293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:54:19 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ccbef8e6-0efd-41e6-b9c0-eea36ffb46a0 tempest-VolumesGetTest-154484293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:54:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ccbef8e6-0efd-41e6-b9c0-eea36ffb46a0 tempest-VolumesGetTest-154484293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:54:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ccbef8e6-0efd-41e6-b9c0-eea36ffb46a0 tempest-VolumesGetTest-154484293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:19 devstack sudo[97977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:54:19 devstack sudo[97977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:19 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2b172bfe-1b35-46c9-b720-4fac8d885eed tempest-VolumesGetTest-154484293 None] Acquiring lock "cinder-79705078-8562-4675-9e55-a3ab5e022e7a-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:54:19 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2b172bfe-1b35-46c9-b720-4fac8d885eed tempest-VolumesGetTest-154484293 None] Lock "cinder-79705078-8562-4675-9e55-a3ab5e022e7a-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:54:19 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2b172bfe-1b35-46c9-b720-4fac8d885eed tempest-VolumesGetTest-154484293 None] Acquiring lock "cinder-quobyte-79705078-8562-4675-9e55-a3ab5e022e7a" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:54:19 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2b172bfe-1b35-46c9-b720-4fac8d885eed tempest-VolumesGetTest-154484293 None] Lock "cinder-quobyte-79705078-8562-4675-9e55-a3ab5e022e7a" acquired by "delete_volume" :: waited 0.017s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:54:19 devstack sudo[97977]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ccbef8e6-0efd-41e6-b9c0-eea36ffb46a0 tempest-VolumesGetTest-154484293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.405s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:19 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-ccbef8e6-0efd-41e6-b9c0-eea36ffb46a0 tempest-VolumesGetTest-154484293 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:54:19 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-ccbef8e6-0efd-41e6-b9c0-eea36ffb46a0 tempest-VolumesGetTest-154484293 None] Deleted volume successfully. Nov 06 17:54:19 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba66fe0b-2f4d-415e-a299-50b74235d1e6]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:54:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2b172bfe-1b35-46c9-b720-4fac8d885eed tempest-VolumesGetTest-154484293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-79705078-8562-4675-9e55-a3ab5e022e7a {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:19 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ccbef8e6-0efd-41e6-b9c0-eea36ffb46a0 tempest-VolumesGetTest-154484293 None] Lock "cinder-8988efc5-58df-4fe5-8fcf-5e28373dfe6b-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:54:19 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d09e352c-dee8-4424-a0aa-c91e93f4e987 tempest-VolumesTestJSON-1277705981 None] Acquiring lock "cinder-5a66919e-eebb-47a1-94c4-f6d908100615-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:54:19 devstack sudo[97980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-79705078-8562-4675-9e55-a3ab5e022e7a Nov 06 17:54:19 devstack sudo[97980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:19 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d09e352c-dee8-4424-a0aa-c91e93f4e987 tempest-VolumesTestJSON-1277705981 None] Lock "cinder-5a66919e-eebb-47a1-94c4-f6d908100615-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:54:19 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d09e352c-dee8-4424-a0aa-c91e93f4e987 tempest-VolumesTestJSON-1277705981 None] Acquiring lock "cinder-quobyte-5a66919e-eebb-47a1-94c4-f6d908100615" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:54:19 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d09e352c-dee8-4424-a0aa-c91e93f4e987 tempest-VolumesTestJSON-1277705981 None] Lock "cinder-quobyte-5a66919e-eebb-47a1-94c4-f6d908100615" acquired by "delete_volume" :: waited 0.026s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:54:19 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f694d6-0aa8-415e-891c-bd34be87d067]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:54:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d09e352c-dee8-4424-a0aa-c91e93f4e987 tempest-VolumesTestJSON-1277705981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5a66919e-eebb-47a1-94c4-f6d908100615 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:19 devstack sudo[97982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5a66919e-eebb-47a1-94c4-f6d908100615 Nov 06 17:54:19 devstack sudo[97982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:20 devstack sudo[97980]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2b172bfe-1b35-46c9-b720-4fac8d885eed tempest-VolumesGetTest-154484293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-79705078-8562-4675-9e55-a3ab5e022e7a" returned: 0 in 0.534s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2b172bfe-1b35-46c9-b720-4fac8d885eed tempest-VolumesGetTest-154484293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-79705078-8562-4675-9e55-a3ab5e022e7a {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:20 devstack sudo[97988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-79705078-8562-4675-9e55-a3ab5e022e7a Nov 06 17:54:20 devstack sudo[97988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:20 devstack sudo[97982]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d09e352c-dee8-4424-a0aa-c91e93f4e987 tempest-VolumesTestJSON-1277705981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5a66919e-eebb-47a1-94c4-f6d908100615" returned: 0 in 0.529s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d09e352c-dee8-4424-a0aa-c91e93f4e987 tempest-VolumesTestJSON-1277705981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5a66919e-eebb-47a1-94c4-f6d908100615 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:20 devstack sudo[97988]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:20 devstack sudo[97994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5a66919e-eebb-47a1-94c4-f6d908100615 Nov 06 17:54:20 devstack sudo[97994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2b172bfe-1b35-46c9-b720-4fac8d885eed tempest-VolumesGetTest-154484293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-79705078-8562-4675-9e55-a3ab5e022e7a" returned: 0 in 0.361s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:20 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2b172bfe-1b35-46c9-b720-4fac8d885eed tempest-VolumesGetTest-154484293 None] Lock "cinder-quobyte-79705078-8562-4675-9e55-a3ab5e022e7a" released by "delete_volume" :: held 1.010s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:54:20 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-2b172bfe-1b35-46c9-b720-4fac8d885eed tempest-VolumesGetTest-154484293 None] Created reservations ['53be5afb-702f-483f-b7ad-0ce0d05914c8', 'c1820691-abd0-4854-84c8-934440d8e1c2', 'b01dcecf-097c-440d-aa70-644c1fb08366', '1442c63e-0394-4bbb-a9a1-dc9ef6c37f58'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:54:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2b172bfe-1b35-46c9-b720-4fac8d885eed tempest-VolumesGetTest-154484293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:54:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2b172bfe-1b35-46c9-b720-4fac8d885eed tempest-VolumesGetTest-154484293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:54:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2b172bfe-1b35-46c9-b720-4fac8d885eed tempest-VolumesGetTest-154484293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:54:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2b172bfe-1b35-46c9-b720-4fac8d885eed tempest-VolumesGetTest-154484293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:54:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2b172bfe-1b35-46c9-b720-4fac8d885eed tempest-VolumesGetTest-154484293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:54:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2b172bfe-1b35-46c9-b720-4fac8d885eed tempest-VolumesGetTest-154484293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:20 devstack sudo[97998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:54:20 devstack sudo[97998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:20 devstack sudo[97994]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d09e352c-dee8-4424-a0aa-c91e93f4e987 tempest-VolumesTestJSON-1277705981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5a66919e-eebb-47a1-94c4-f6d908100615" returned: 0 in 0.309s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:20 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d09e352c-dee8-4424-a0aa-c91e93f4e987 tempest-VolumesTestJSON-1277705981 None] Lock "cinder-quobyte-5a66919e-eebb-47a1-94c4-f6d908100615" released by "delete_volume" :: held 0.911s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:54:20 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-d09e352c-dee8-4424-a0aa-c91e93f4e987 tempest-VolumesTestJSON-1277705981 None] Created reservations ['7876e46e-fa92-44c6-ba2a-938154cf425b', 'e7101727-198b-42cc-8b63-0771cd630d80', '393af6bd-d320-46ca-a580-52e62b066093', 'effb0846-2031-4d86-b7aa-74638fb05d0c'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:54:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d09e352c-dee8-4424-a0aa-c91e93f4e987 tempest-VolumesTestJSON-1277705981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:54:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d09e352c-dee8-4424-a0aa-c91e93f4e987 tempest-VolumesTestJSON-1277705981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:54:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d09e352c-dee8-4424-a0aa-c91e93f4e987 tempest-VolumesTestJSON-1277705981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:54:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d09e352c-dee8-4424-a0aa-c91e93f4e987 tempest-VolumesTestJSON-1277705981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:54:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d09e352c-dee8-4424-a0aa-c91e93f4e987 tempest-VolumesTestJSON-1277705981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:54:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d09e352c-dee8-4424-a0aa-c91e93f4e987 tempest-VolumesTestJSON-1277705981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:20 devstack sudo[97998]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2b172bfe-1b35-46c9-b720-4fac8d885eed tempest-VolumesGetTest-154484293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.329s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:20 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-2b172bfe-1b35-46c9-b720-4fac8d885eed tempest-VolumesGetTest-154484293 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:54:20 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-2b172bfe-1b35-46c9-b720-4fac8d885eed tempest-VolumesGetTest-154484293 None] Deleted volume successfully. Nov 06 17:54:20 devstack sudo[98001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:54:20 devstack sudo[98001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:20 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2b172bfe-1b35-46c9-b720-4fac8d885eed tempest-VolumesGetTest-154484293 None] Lock "cinder-79705078-8562-4675-9e55-a3ab5e022e7a-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:54:21 devstack sudo[98001]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d09e352c-dee8-4424-a0aa-c91e93f4e987 tempest-VolumesTestJSON-1277705981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.284s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:21 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-d09e352c-dee8-4424-a0aa-c91e93f4e987 tempest-VolumesTestJSON-1277705981 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:54:21 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-d09e352c-dee8-4424-a0aa-c91e93f4e987 tempest-VolumesTestJSON-1277705981 None] Deleted volume successfully. Nov 06 17:54:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d09e352c-dee8-4424-a0aa-c91e93f4e987 tempest-VolumesTestJSON-1277705981 None] Lock "cinder-5a66919e-eebb-47a1-94c4-f6d908100615-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:54:22 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-62f1269b-7735-43eb-960a-23d61aca3c02 tempest-VolumesTestJSON-1277705981 None] Acquiring lock "cinder-9ec7028d-7834-46a0-9d28-ee0b6772db03-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:54:22 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-62f1269b-7735-43eb-960a-23d61aca3c02 tempest-VolumesTestJSON-1277705981 None] Lock "cinder-9ec7028d-7834-46a0-9d28-ee0b6772db03-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:54:22 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-62f1269b-7735-43eb-960a-23d61aca3c02 tempest-VolumesTestJSON-1277705981 None] Acquiring lock "cinder-quobyte-9ec7028d-7834-46a0-9d28-ee0b6772db03" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:54:22 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-62f1269b-7735-43eb-960a-23d61aca3c02 tempest-VolumesTestJSON-1277705981 None] Lock "cinder-quobyte-9ec7028d-7834-46a0-9d28-ee0b6772db03" acquired by "delete_volume" :: waited 0.029s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:54:22 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4a8111-c526-4372-9ba4-52b1d8255a38]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:54:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-62f1269b-7735-43eb-960a-23d61aca3c02 tempest-VolumesTestJSON-1277705981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9ec7028d-7834-46a0-9d28-ee0b6772db03 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:22 devstack sudo[98005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9ec7028d-7834-46a0-9d28-ee0b6772db03 Nov 06 17:54:22 devstack sudo[98005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:22 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:54:22 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] Flow 'volume_create_manager' (43fd8cf6-321b-42a9-863a-140b37412dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:54:22 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1305014-b58f-470c-a769-d5a44827baa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:22 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1305014-b58f-470c-a769-d5a44827baa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:54:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1248183144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35a2cc63-7439-4402-b76d-5203c302b653,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='83b317dc0b0f4329aa3bf9863f7ddd5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:54:23Z,use_quota=True,user_id='ea09cba9a9d94ad6a595472e62d9a066',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:22 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df4d09a5-34a7-454c-ab90-3b7bce3ce535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:22 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df4d09a5-34a7-454c-ab90-3b7bce3ce535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:22 devstack sudo[98005]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:22 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c552854e-5dc4-48ed-b1bf-8d8f79b7bae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:22 devstack cinder-volume[87068]: DEBUG cinder.image.glance [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] Creating Keystone auth plugin from conf {{(pid=87068) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 17:54:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-62f1269b-7735-43eb-960a-23d61aca3c02 tempest-VolumesTestJSON-1277705981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9ec7028d-7834-46a0-9d28-ee0b6772db03" returned: 0 in 0.512s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-62f1269b-7735-43eb-960a-23d61aca3c02 tempest-VolumesTestJSON-1277705981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9ec7028d-7834-46a0-9d28-ee0b6772db03 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:22 devstack sudo[98010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9ec7028d-7834-46a0-9d28-ee0b6772db03 Nov 06 17:54:22 devstack sudo[98010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:23 devstack sudo[98010]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-62f1269b-7735-43eb-960a-23d61aca3c02 tempest-VolumesTestJSON-1277705981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9ec7028d-7834-46a0-9d28-ee0b6772db03" returned: 0 in 0.342s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:23 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-62f1269b-7735-43eb-960a-23d61aca3c02 tempest-VolumesTestJSON-1277705981 None] Lock "cinder-quobyte-9ec7028d-7834-46a0-9d28-ee0b6772db03" released by "delete_volume" :: held 0.929s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:54:23 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c552854e-5dc4-48ed-b1bf-8d8f79b7bae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '35a2cc63-7439-4402-b76d-5203c302b653', 'volume_name': 'volume-35a2cc63-7439-4402-b76d-5203c302b653', 'volume_size': 1, 'image_id': '514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '344c8ba807084eedb5afd931913d7a80', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'created_at': datetime.datetime(2026, 11, 6, 16, 39, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 16, 39, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/514846ea-e0c6-4037-8ba4-bcd35ce3fba9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:23 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4f818e8-73d1-4233-afa6-3ecfeafe5467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:23 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4f818e8-73d1-4233-afa6-3ecfeafe5467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:23 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11e07b53-2942-426d-9c9c-879cc843f553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:23 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] Volume 35a2cc63-7439-4402-b76d-5203c302b653: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-35a2cc63-7439-4402-b76d-5203c302b653', 'volume_size': 1, 'image_id': '514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '344c8ba807084eedb5afd931913d7a80', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'created_at': datetime.datetime(2026, 11, 6, 16, 39, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 16, 39, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/514846ea-e0c6-4037-8ba4-bcd35ce3fba9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 17:54:23 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] Trying to clone 35a2cc63-7439-4402-b76d-5203c302b653 from image 514846ea-e0c6-4037-8ba4-bcd35ce3fba9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'metadata': {}}]). {{(pid=87068) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 17:54:23 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-62f1269b-7735-43eb-960a-23d61aca3c02 tempest-VolumesTestJSON-1277705981 None] Created reservations ['40b8f4bc-55c5-49c4-a34f-15fcd5ba0916', '311e2fa4-0f04-4cde-8695-f55e7ec869a2', '891613f8-a327-4f38-9e55-7db53c393e10', '60b7424a-a5a8-496c-9280-1dfc1714f26c'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:54:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-62f1269b-7735-43eb-960a-23d61aca3c02 tempest-VolumesTestJSON-1277705981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:54:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-62f1269b-7735-43eb-960a-23d61aca3c02 tempest-VolumesTestJSON-1277705981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:54:23 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-62f1269b-7735-43eb-960a-23d61aca3c02 tempest-VolumesTestJSON-1277705981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:54:23 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-62f1269b-7735-43eb-960a-23d61aca3c02 tempest-VolumesTestJSON-1277705981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:54:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-62f1269b-7735-43eb-960a-23d61aca3c02 tempest-VolumesTestJSON-1277705981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:54:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-62f1269b-7735-43eb-960a-23d61aca3c02 tempest-VolumesTestJSON-1277705981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:23 devstack sudo[98013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:54:23 devstack sudo[98013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:23 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_3rx1titzdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87068) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 06 17:54:23 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] Image download 20.69 MB at 20.69 MB/s Nov 06 17:54:23 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[22da0de4-0b05-44b5-8199-50224986e5cb]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:54:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_3rx1titzdevstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:23 devstack sudo[98013]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-62f1269b-7735-43eb-960a-23d61aca3c02 tempest-VolumesTestJSON-1277705981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.430s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:23 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-62f1269b-7735-43eb-960a-23d61aca3c02 tempest-VolumesTestJSON-1277705981 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:54:23 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-62f1269b-7735-43eb-960a-23d61aca3c02 tempest-VolumesTestJSON-1277705981 None] Deleted volume successfully. Nov 06 17:54:23 devstack sudo[98017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_3rx1titzdevstack@QuobyteHD Nov 06 17:54:23 devstack sudo[98017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:23 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-62f1269b-7735-43eb-960a-23d61aca3c02 tempest-VolumesTestJSON-1277705981 None] Lock "cinder-9ec7028d-7834-46a0-9d28-ee0b6772db03-delete_volume" released by "delete_volume" :: held 1.777s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:54:24 devstack sudo[98017]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_3rx1titzdevstack@QuobyteHD" returned: 0 in 0.372s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:24 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] Temporary image 514846ea-e0c6-4037-8ba4-bcd35ce3fba9 is fetched for user ea09cba9a9d94ad6a595472e62d9a066. {{(pid=87068) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 06 17:54:24 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e556c2f4-64b6-411f-a04b-937d03982ddf]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:54:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_3rx1titzdevstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:24 devstack sudo[98023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_3rx1titzdevstack@QuobyteHD Nov 06 17:54:24 devstack sudo[98023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:24 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-7dc5b8e3-9e3c-4b4f-9e0a-a126cc4fe58e tempest-VolumesTestJSON-1277705981 None] Acquiring lock "cinder-84dad189-2de2-4ebe-b798-c77ed0e37093-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:54:24 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-7dc5b8e3-9e3c-4b4f-9e0a-a126cc4fe58e tempest-VolumesTestJSON-1277705981 None] Lock "cinder-84dad189-2de2-4ebe-b798-c77ed0e37093-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:54:24 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-7dc5b8e3-9e3c-4b4f-9e0a-a126cc4fe58e tempest-VolumesTestJSON-1277705981 None] Acquiring lock "cinder-quobyte-84dad189-2de2-4ebe-b798-c77ed0e37093" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:54:24 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-7dc5b8e3-9e3c-4b4f-9e0a-a126cc4fe58e tempest-VolumesTestJSON-1277705981 None] Lock "cinder-quobyte-84dad189-2de2-4ebe-b798-c77ed0e37093" acquired by "delete_volume" :: waited 0.017s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:54:24 devstack sudo[98023]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_3rx1titzdevstack@QuobyteHD" returned: 0 in 0.412s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:54:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:54:24 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:54:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1248183144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35a2cc63-7439-4402-b76d-5203c302b653,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='83b317dc0b0f4329aa3bf9863f7ddd5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:54:23Z,use_quota=True,user_id='ea09cba9a9d94ad6a595472e62d9a066',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:54:24 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] Creating volume 35a2cc63-7439-4402-b76d-5203c302b653 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:54:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:54:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:54:24 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:54:24 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:54:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:54:24 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:54:24 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:54:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-35a2cc63-7439-4402-b76d-5203c302b653 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:24 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed86a7d1-a551-4ea2-b94b-3cd33a787816]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:54:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7dc5b8e3-9e3c-4b4f-9e0a-a126cc4fe58e tempest-VolumesTestJSON-1277705981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-84dad189-2de2-4ebe-b798-c77ed0e37093 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:24 devstack sudo[98028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-35a2cc63-7439-4402-b76d-5203c302b653 1073741824 Nov 06 17:54:24 devstack sudo[98028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:24 devstack sudo[98029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-84dad189-2de2-4ebe-b798-c77ed0e37093 Nov 06 17:54:24 devstack sudo[98029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:25 devstack sudo[98029]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7dc5b8e3-9e3c-4b4f-9e0a-a126cc4fe58e tempest-VolumesTestJSON-1277705981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-84dad189-2de2-4ebe-b798-c77ed0e37093" returned: 0 in 0.482s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7dc5b8e3-9e3c-4b4f-9e0a-a126cc4fe58e tempest-VolumesTestJSON-1277705981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-84dad189-2de2-4ebe-b798-c77ed0e37093 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:25 devstack sudo[98040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-84dad189-2de2-4ebe-b798-c77ed0e37093 Nov 06 17:54:25 devstack sudo[98040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:25 devstack sudo[98028]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-35a2cc63-7439-4402-b76d-5203c302b653 1073741824" returned: 0 in 0.571s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-35a2cc63-7439-4402-b76d-5203c302b653 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:25 devstack sudo[98042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-35a2cc63-7439-4402-b76d-5203c302b653 Nov 06 17:54:25 devstack sudo[98042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:25 devstack sudo[98040]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7dc5b8e3-9e3c-4b4f-9e0a-a126cc4fe58e tempest-VolumesTestJSON-1277705981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-84dad189-2de2-4ebe-b798-c77ed0e37093" returned: 0 in 0.275s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:25 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-7dc5b8e3-9e3c-4b4f-9e0a-a126cc4fe58e tempest-VolumesTestJSON-1277705981 None] Lock "cinder-quobyte-84dad189-2de2-4ebe-b798-c77ed0e37093" released by "delete_volume" :: held 0.862s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:54:25 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-7dc5b8e3-9e3c-4b4f-9e0a-a126cc4fe58e tempest-VolumesTestJSON-1277705981 None] Created reservations ['8415a6a2-373f-4bb7-a7ef-4575720abdc4', '91841e53-6b3b-449e-a87a-9f31d1d361bb', 'd56a9c4f-2443-4880-a059-731658a5389b', '2231c344-d6ac-4ed6-8ec0-ad6826f349c2'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:54:25 devstack sudo[98042]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-35a2cc63-7439-4402-b76d-5203c302b653" returned: 0 in 0.304s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:25 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:54:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:54:25 devstack cinder-volume[87068]: DEBUG cinder.volume.volume_utils [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] Attempting download of 514846ea-e0c6-4037-8ba4-bcd35ce3fba9 ((None, [{'url': 'file:///opt/stack/data/glance/images/514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'metadata': {}}])) to volume 35a2cc63-7439-4402-b76d-5203c302b653. {{(pid=87068) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 17:54:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7dc5b8e3-9e3c-4b4f-9e0a-a126cc4fe58e tempest-VolumesTestJSON-1277705981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:54:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7dc5b8e3-9e3c-4b4f-9e0a-a126cc4fe58e tempest-VolumesTestJSON-1277705981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:54:25 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7dc5b8e3-9e3c-4b4f-9e0a-a126cc4fe58e tempest-VolumesTestJSON-1277705981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:54:25 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7dc5b8e3-9e3c-4b4f-9e0a-a126cc4fe58e tempest-VolumesTestJSON-1277705981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:54:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7dc5b8e3-9e3c-4b4f-9e0a-a126cc4fe58e tempest-VolumesTestJSON-1277705981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:54:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7dc5b8e3-9e3c-4b4f-9e0a-a126cc4fe58e tempest-VolumesTestJSON-1277705981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:25 devstack sudo[98046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:54:25 devstack sudo[98046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:25 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2aa04d-1d3f-4001-9147-ecd98cb23ca1]: (4, 'raw') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:54:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_9uboep2z {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:25 devstack sudo[98048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_9uboep2z Nov 06 17:54:25 devstack sudo[98048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:25 devstack sudo[98046]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7dc5b8e3-9e3c-4b4f-9e0a-a126cc4fe58e tempest-VolumesTestJSON-1277705981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.394s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:25 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-7dc5b8e3-9e3c-4b4f-9e0a-a126cc4fe58e tempest-VolumesTestJSON-1277705981 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:54:25 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-7dc5b8e3-9e3c-4b4f-9e0a-a126cc4fe58e tempest-VolumesTestJSON-1277705981 None] Deleted volume successfully. Nov 06 17:54:26 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-7dc5b8e3-9e3c-4b4f-9e0a-a126cc4fe58e tempest-VolumesTestJSON-1277705981 None] Lock "cinder-84dad189-2de2-4ebe-b798-c77ed0e37093-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:54:26 devstack sudo[98048]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_9uboep2z" returned: 0 in 0.444s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_9uboep2z {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:26 devstack sudo[98053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_9uboep2z Nov 06 17:54:26 devstack sudo[98053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:26 devstack sudo[98053]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_9uboep2z" returned: 1 in 0.355s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_9uboep2z' failed. Not Retrying. {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 17:54:26 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc2fda4-04e3-43fd-8ebb-7df26204a3a2]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:54:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_3rx1titzdevstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:26 devstack sudo[98057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_3rx1titzdevstack@QuobyteHD Nov 06 17:54:26 devstack sudo[98057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:26 devstack sudo[98057]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_3rx1titzdevstack@QuobyteHD" returned: 0 in 0.448s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:26 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] 514846ea-e0c6-4037-8ba4-bcd35ce3fba9 was qcow2, converting to qcow2 {{(pid=87068) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 06 17:54:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_3rx1titzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-35a2cc63-7439-4402-b76d-5203c302b653 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:26 devstack sudo[98062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_3rx1titzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-35a2cc63-7439-4402-b76d-5203c302b653 Nov 06 17:54:26 devstack sudo[98062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:26 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c29d81f-54ab-4054-8fec-ab2af912ea72 tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:54:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0c29d81f-54ab-4054-8fec-ab2af912ea72 tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Flow 'volume_create_manager' (52046086-131e-4e06-91f9-c1fbcff5d780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:54:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0c29d81f-54ab-4054-8fec-ab2af912ea72 tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be30995c-9f91-40f1-9da6-9f7714b57c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0c29d81f-54ab-4054-8fec-ab2af912ea72 tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be30995c-9f91-40f1-9da6-9f7714b57c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1191315111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e67c436-04da-432c-9084-8b9d2f85bebf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66e60af5f3e84d46944bfc3592ac055b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:54:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:54:27Z,use_quota=True,user_id='781b6b35ae9b47a98c1facd91dfce8ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0c29d81f-54ab-4054-8fec-ab2af912ea72 tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f21720fd-9d00-417a-8e42-7144b3e56d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0c29d81f-54ab-4054-8fec-ab2af912ea72 tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f21720fd-9d00-417a-8e42-7144b3e56d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0c29d81f-54ab-4054-8fec-ab2af912ea72 tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e13efc1-ce6d-4615-bce6-c68832edd460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0c29d81f-54ab-4054-8fec-ab2af912ea72 tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e13efc1-ce6d-4615-bce6-c68832edd460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e67c436-04da-432c-9084-8b9d2f85bebf', 'volume_name': 'volume-7e67c436-04da-432c-9084-8b9d2f85bebf', 'volume_size': 2}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0c29d81f-54ab-4054-8fec-ab2af912ea72 tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb72cb32-66cc-43cd-8e52-0f97af961827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0c29d81f-54ab-4054-8fec-ab2af912ea72 tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb72cb32-66cc-43cd-8e52-0f97af961827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0c29d81f-54ab-4054-8fec-ab2af912ea72 tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ccbc5fe-9ab8-4a28-9574-2c4d0df5d219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:27 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-0c29d81f-54ab-4054-8fec-ab2af912ea72 tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Volume 7e67c436-04da-432c-9084-8b9d2f85bebf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e67c436-04da-432c-9084-8b9d2f85bebf', 'volume_size': 2} Nov 06 17:54:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0c29d81f-54ab-4054-8fec-ab2af912ea72 tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:54:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0c29d81f-54ab-4054-8fec-ab2af912ea72 tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:54:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0c29d81f-54ab-4054-8fec-ab2af912ea72 tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1191315111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e67c436-04da-432c-9084-8b9d2f85bebf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66e60af5f3e84d46944bfc3592ac055b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:54:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:54:27Z,use_quota=True,user_id='781b6b35ae9b47a98c1facd91dfce8ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:54:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-0c29d81f-54ab-4054-8fec-ab2af912ea72 tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Creating volume 7e67c436-04da-432c-9084-8b9d2f85bebf {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:54:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0c29d81f-54ab-4054-8fec-ab2af912ea72 tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:54:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0c29d81f-54ab-4054-8fec-ab2af912ea72 tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:54:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0c29d81f-54ab-4054-8fec-ab2af912ea72 tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:54:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0c29d81f-54ab-4054-8fec-ab2af912ea72 tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:54:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0c29d81f-54ab-4054-8fec-ab2af912ea72 tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:54:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0c29d81f-54ab-4054-8fec-ab2af912ea72 tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:54:27 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-0c29d81f-54ab-4054-8fec-ab2af912ea72 tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:54:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0c29d81f-54ab-4054-8fec-ab2af912ea72 tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7e67c436-04da-432c-9084-8b9d2f85bebf 2147483648 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:27 devstack sudo[98064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7e67c436-04da-432c-9084-8b9d2f85bebf 2147483648 Nov 06 17:54:27 devstack sudo[98064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:27 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0e9cf80-da79-4b48-81e5-1aae7de97197 tempest-VolumesTransfersTest-290950831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:54:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a0e9cf80-da79-4b48-81e5-1aae7de97197 tempest-VolumesTransfersTest-290950831 None] Flow 'volume_create_manager' (1f1c36bc-e67b-45fe-9c2c-3a35ca31b252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:54:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a0e9cf80-da79-4b48-81e5-1aae7de97197 tempest-VolumesTransfersTest-290950831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (435c37d7-6bbc-4d6b-a2c6-b855e2e81f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a0e9cf80-da79-4b48-81e5-1aae7de97197 tempest-VolumesTransfersTest-290950831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (435c37d7-6bbc-4d6b-a2c6-b855e2e81f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-627272966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a53f83c6-fbea-4870-aec7-5a12cdd3ed9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cec5633ae494ef6ae2f6b2ab98578cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:54:28Z,use_quota=True,user_id='3bd2595050ac42e98584c0f0379be760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a0e9cf80-da79-4b48-81e5-1aae7de97197 tempest-VolumesTransfersTest-290950831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce8bc00c-920b-4a6f-baea-b2587e9ad7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a0e9cf80-da79-4b48-81e5-1aae7de97197 tempest-VolumesTransfersTest-290950831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce8bc00c-920b-4a6f-baea-b2587e9ad7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a0e9cf80-da79-4b48-81e5-1aae7de97197 tempest-VolumesTransfersTest-290950831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ef2c92d-4d15-4684-9ce9-3f8464893f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a0e9cf80-da79-4b48-81e5-1aae7de97197 tempest-VolumesTransfersTest-290950831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ef2c92d-4d15-4684-9ce9-3f8464893f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a53f83c6-fbea-4870-aec7-5a12cdd3ed9a', 'volume_name': 'volume-a53f83c6-fbea-4870-aec7-5a12cdd3ed9a', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a0e9cf80-da79-4b48-81e5-1aae7de97197 tempest-VolumesTransfersTest-290950831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d077e87-af4a-476d-9b37-53f5b30c462b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a0e9cf80-da79-4b48-81e5-1aae7de97197 tempest-VolumesTransfersTest-290950831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d077e87-af4a-476d-9b37-53f5b30c462b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a0e9cf80-da79-4b48-81e5-1aae7de97197 tempest-VolumesTransfersTest-290950831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cf17e87-fac1-4046-8af1-804ddfd17f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:27 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-a0e9cf80-da79-4b48-81e5-1aae7de97197 tempest-VolumesTransfersTest-290950831 None] Volume a53f83c6-fbea-4870-aec7-5a12cdd3ed9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a53f83c6-fbea-4870-aec7-5a12cdd3ed9a', 'volume_size': 1} Nov 06 17:54:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a0e9cf80-da79-4b48-81e5-1aae7de97197 tempest-VolumesTransfersTest-290950831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:54:27 devstack sudo[98064]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0c29d81f-54ab-4054-8fec-ab2af912ea72 tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7e67c436-04da-432c-9084-8b9d2f85bebf 2147483648" returned: 0 in 0.659s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0c29d81f-54ab-4054-8fec-ab2af912ea72 tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7e67c436-04da-432c-9084-8b9d2f85bebf {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:27 devstack sudo[98076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7e67c436-04da-432c-9084-8b9d2f85bebf Nov 06 17:54:27 devstack sudo[98076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:28 devstack sudo[98076]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0c29d81f-54ab-4054-8fec-ab2af912ea72 tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7e67c436-04da-432c-9084-8b9d2f85bebf" returned: 0 in 0.388s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0c29d81f-54ab-4054-8fec-ab2af912ea72 tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:54:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0c29d81f-54ab-4054-8fec-ab2af912ea72 tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:54:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a0e9cf80-da79-4b48-81e5-1aae7de97197 tempest-VolumesTransfersTest-290950831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.476s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:54:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a0e9cf80-da79-4b48-81e5-1aae7de97197 tempest-VolumesTransfersTest-290950831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-627272966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a53f83c6-fbea-4870-aec7-5a12cdd3ed9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cec5633ae494ef6ae2f6b2ab98578cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:54:28Z,use_quota=True,user_id='3bd2595050ac42e98584c0f0379be760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:54:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-a0e9cf80-da79-4b48-81e5-1aae7de97197 tempest-VolumesTransfersTest-290950831 None] Creating volume a53f83c6-fbea-4870-aec7-5a12cdd3ed9a {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:54:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a0e9cf80-da79-4b48-81e5-1aae7de97197 tempest-VolumesTransfersTest-290950831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:54:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a0e9cf80-da79-4b48-81e5-1aae7de97197 tempest-VolumesTransfersTest-290950831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:54:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a0e9cf80-da79-4b48-81e5-1aae7de97197 tempest-VolumesTransfersTest-290950831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:54:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a0e9cf80-da79-4b48-81e5-1aae7de97197 tempest-VolumesTransfersTest-290950831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:54:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a0e9cf80-da79-4b48-81e5-1aae7de97197 tempest-VolumesTransfersTest-290950831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:54:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a0e9cf80-da79-4b48-81e5-1aae7de97197 tempest-VolumesTransfersTest-290950831 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:54:28 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-a0e9cf80-da79-4b48-81e5-1aae7de97197 tempest-VolumesTransfersTest-290950831 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:54:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a0e9cf80-da79-4b48-81e5-1aae7de97197 tempest-VolumesTransfersTest-290950831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a53f83c6-fbea-4870-aec7-5a12cdd3ed9a 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0c29d81f-54ab-4054-8fec-ab2af912ea72 tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ccbc5fe-9ab8-4a28-9574-2c4d0df5d219) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e67c436-04da-432c-9084-8b9d2f85bebf', 'volume_size': 2}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0c29d81f-54ab-4054-8fec-ab2af912ea72 tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa804a94-9eb1-47e5-9d36-4a2137c0d009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:28 devstack sudo[98079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a53f83c6-fbea-4870-aec7-5a12cdd3ed9a 1073741824 Nov 06 17:54:28 devstack sudo[98079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:28 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-0c29d81f-54ab-4054-8fec-ab2af912ea72 tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Volume volume-7e67c436-04da-432c-9084-8b9d2f85bebf (7e67c436-04da-432c-9084-8b9d2f85bebf): created successfully Nov 06 17:54:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0c29d81f-54ab-4054-8fec-ab2af912ea72 tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa804a94-9eb1-47e5-9d36-4a2137c0d009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0c29d81f-54ab-4054-8fec-ab2af912ea72 tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Flow 'volume_create_manager' (52046086-131e-4e06-91f9-c1fbcff5d780) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:54:28 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-0c29d81f-54ab-4054-8fec-ab2af912ea72 tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Created volume successfully. Nov 06 17:54:28 devstack sudo[98079]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a0e9cf80-da79-4b48-81e5-1aae7de97197 tempest-VolumesTransfersTest-290950831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a53f83c6-fbea-4870-aec7-5a12cdd3ed9a 1073741824" returned: 0 in 0.577s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a0e9cf80-da79-4b48-81e5-1aae7de97197 tempest-VolumesTransfersTest-290950831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a53f83c6-fbea-4870-aec7-5a12cdd3ed9a {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:28 devstack sudo[98085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a53f83c6-fbea-4870-aec7-5a12cdd3ed9a Nov 06 17:54:28 devstack sudo[98085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:29 devstack sudo[98085]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a0e9cf80-da79-4b48-81e5-1aae7de97197 tempest-VolumesTransfersTest-290950831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a53f83c6-fbea-4870-aec7-5a12cdd3ed9a" returned: 0 in 0.302s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:29 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a0e9cf80-da79-4b48-81e5-1aae7de97197 tempest-VolumesTransfersTest-290950831 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:54:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a0e9cf80-da79-4b48-81e5-1aae7de97197 tempest-VolumesTransfersTest-290950831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:54:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a0e9cf80-da79-4b48-81e5-1aae7de97197 tempest-VolumesTransfersTest-290950831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cf17e87-fac1-4046-8af1-804ddfd17f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a53f83c6-fbea-4870-aec7-5a12cdd3ed9a', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a0e9cf80-da79-4b48-81e5-1aae7de97197 tempest-VolumesTransfersTest-290950831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2462ad7e-83ad-4585-b12c-2d6310c04c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:29 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-a0e9cf80-da79-4b48-81e5-1aae7de97197 tempest-VolumesTransfersTest-290950831 None] Volume volume-a53f83c6-fbea-4870-aec7-5a12cdd3ed9a (a53f83c6-fbea-4870-aec7-5a12cdd3ed9a): created successfully Nov 06 17:54:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a0e9cf80-da79-4b48-81e5-1aae7de97197 tempest-VolumesTransfersTest-290950831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2462ad7e-83ad-4585-b12c-2d6310c04c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a0e9cf80-da79-4b48-81e5-1aae7de97197 tempest-VolumesTransfersTest-290950831 None] Flow 'volume_create_manager' (1f1c36bc-e67b-45fe-9c2c-3a35ca31b252) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:54:29 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-a0e9cf80-da79-4b48-81e5-1aae7de97197 tempest-VolumesTransfersTest-290950831 None] Created volume successfully. Nov 06 17:54:29 devstack sudo[98062]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_3rx1titzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-35a2cc63-7439-4402-b76d-5203c302b653" returned: 0 in 2.411s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:29 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_3rx1titzdevstack@QuobyteHD, size 112.00 MB, duration 2.41 sec, destination /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-35a2cc63-7439-4402-b76d-5203c302b653 {{(pid=87068) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 17:54:29 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] Converted 112.00 MB image at 46.43 MB/s Nov 06 17:54:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-35a2cc63-7439-4402-b76d-5203c302b653 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:29 devstack sudo[98088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-35a2cc63-7439-4402-b76d-5203c302b653 1G Nov 06 17:54:29 devstack sudo[98088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6eb0776a-637e-4d2f-8200-278fdd49f08e tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:54:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6eb0776a-637e-4d2f-8200-278fdd49f08e tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:54:29 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-6eb0776a-637e-4d2f-8200-278fdd49f08e tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Creating offline snapshot 94929e76-b090-4b25-91cb-25558031241f of volume 7e67c436-04da-432c-9084-8b9d2f85bebf {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 17:54:29 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf444f7-2fb8-450c-8364-4482f2d803bb]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:54:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6eb0776a-637e-4d2f-8200-278fdd49f08e tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7e67c436-04da-432c-9084-8b9d2f85bebf {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:29 devstack sudo[98090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7e67c436-04da-432c-9084-8b9d2f85bebf Nov 06 17:54:29 devstack sudo[98090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:29 devstack sudo[98088]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-35a2cc63-7439-4402-b76d-5203c302b653 1G" returned: 0 in 0.419s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:29 devstack cinder-volume[87068]: DEBUG cinder.volume.volume_utils [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] Downloaded image 514846ea-e0c6-4037-8ba4-bcd35ce3fba9 ((None, [{'url': 'file:///opt/stack/data/glance/images/514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'metadata': {}}])) to volume 35a2cc63-7439-4402-b76d-5203c302b653 successfully. {{(pid=87068) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 17:54:29 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] Temporary image 514846ea-e0c6-4037-8ba4-bcd35ce3fba9 for user ea09cba9a9d94ad6a595472e62d9a066 is deleted. {{(pid=87068) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 06 17:54:29 devstack cinder-volume[87068]: DEBUG cinder.volume.volume_utils [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] Marking volume 35a2cc63-7439-4402-b76d-5203c302b653 as bootable. {{(pid=87068) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 17:54:29 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] Copying metadata from image 514846ea-e0c6-4037-8ba4-bcd35ce3fba9 to 35a2cc63-7439-4402-b76d-5203c302b653. {{(pid=87068) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 17:54:29 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] Creating volume glance metadata for volume 35a2cc63-7439-4402-b76d-5203c302b653 backed by image 514846ea-e0c6-4037-8ba4-bcd35ce3fba9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87068) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 17:54:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11e07b53-2942-426d-9c9c-879cc843f553) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35a2cc63-7439-4402-b76d-5203c302b653', 'volume_size': 1, 'image_id': '514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '344c8ba807084eedb5afd931913d7a80', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'created_at': datetime.datetime(2026, 11, 6, 16, 39, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 16, 39, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/514846ea-e0c6-4037-8ba4-bcd35ce3fba9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c94a0a4-d34e-4313-84a7-c630d78886cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:29 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] Volume volume-35a2cc63-7439-4402-b76d-5203c302b653 (35a2cc63-7439-4402-b76d-5203c302b653): created successfully Nov 06 17:54:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c94a0a4-d34e-4313-84a7-c630d78886cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] Flow 'volume_create_manager' (43fd8cf6-321b-42a9-863a-140b37412dca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:54:29 devstack sudo[98090]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6eb0776a-637e-4d2f-8200-278fdd49f08e tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7e67c436-04da-432c-9084-8b9d2f85bebf" returned: 0 in 0.482s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6eb0776a-637e-4d2f-8200-278fdd49f08e tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7e67c436-04da-432c-9084-8b9d2f85bebf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7e67c436-04da-432c-9084-8b9d2f85bebf.94929e76-b090-4b25-91cb-25558031241f 2G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:29 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-7287a7fc-9302-4e3b-ba3c-e241b9bb8b3e tempest-VolumesGetTest-154484293 None] Created volume successfully. Nov 06 17:54:29 devstack sudo[98098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7e67c436-04da-432c-9084-8b9d2f85bebf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7e67c436-04da-432c-9084-8b9d2f85bebf.94929e76-b090-4b25-91cb-25558031241f 2G Nov 06 17:54:29 devstack sudo[98098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:30 devstack sudo[98098]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6eb0776a-637e-4d2f-8200-278fdd49f08e tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7e67c436-04da-432c-9084-8b9d2f85bebf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7e67c436-04da-432c-9084-8b9d2f85bebf.94929e76-b090-4b25-91cb-25558031241f 2G" returned: 0 in 0.542s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6eb0776a-637e-4d2f-8200-278fdd49f08e tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e67c436-04da-432c-9084-8b9d2f85bebf -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7e67c436-04da-432c-9084-8b9d2f85bebf.94929e76-b090-4b25-91cb-25558031241f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:30 devstack sudo[98105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e67c436-04da-432c-9084-8b9d2f85bebf -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7e67c436-04da-432c-9084-8b9d2f85bebf.94929e76-b090-4b25-91cb-25558031241f Nov 06 17:54:30 devstack sudo[98105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:30 devstack sudo[98105]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6eb0776a-637e-4d2f-8200-278fdd49f08e tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e67c436-04da-432c-9084-8b9d2f85bebf -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7e67c436-04da-432c-9084-8b9d2f85bebf.94929e76-b090-4b25-91cb-25558031241f" returned: 0 in 0.389s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:30 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-6eb0776a-637e-4d2f-8200-278fdd49f08e tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7e67c436-04da-432c-9084-8b9d2f85bebf.94929e76-b090-4b25-91cb-25558031241f is being set with open permissions: ugo+rw Nov 06 17:54:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6eb0776a-637e-4d2f-8200-278fdd49f08e tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7e67c436-04da-432c-9084-8b9d2f85bebf.94929e76-b090-4b25-91cb-25558031241f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:30 devstack sudo[98110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7e67c436-04da-432c-9084-8b9d2f85bebf.94929e76-b090-4b25-91cb-25558031241f Nov 06 17:54:30 devstack sudo[98110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:30 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-09fc008f-1fa7-4d34-a0e1-7f8a7dc9abb9 tempest-VolumesGetTest-154484293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:54:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-09fc008f-1fa7-4d34-a0e1-7f8a7dc9abb9 tempest-VolumesGetTest-154484293 None] Flow 'volume_create_manager' (c86ef2d4-6e8b-47d9-bea7-80597b28291f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:54:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-09fc008f-1fa7-4d34-a0e1-7f8a7dc9abb9 tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68310fd7-0bcc-46e5-b16b-1fcf9819eb30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:31 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-243ce6aa-251d-4fb4-b50f-4137177ba791 tempest-VolumesTransfersTest-1814434741 None] Transfer volume completed successfully. Nov 06 17:54:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-09fc008f-1fa7-4d34-a0e1-7f8a7dc9abb9 tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68310fd7-0bcc-46e5-b16b-1fcf9819eb30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:54:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-491573849',display_name='tempest-VolumesGetTest-Volume-1871184781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef65054b-6cfc-42e3-841b-760c723e13a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83b317dc0b0f4329aa3bf9863f7ddd5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:54:31Z,use_quota=True,user_id='ea09cba9a9d94ad6a595472e62d9a066',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-09fc008f-1fa7-4d34-a0e1-7f8a7dc9abb9 tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d9c4897-6022-4d38-869c-dcc24b639be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-09fc008f-1fa7-4d34-a0e1-7f8a7dc9abb9 tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d9c4897-6022-4d38-869c-dcc24b639be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-09fc008f-1fa7-4d34-a0e1-7f8a7dc9abb9 tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5f358ec-bfcc-4ecb-a1f4-e7b09b88e979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-09fc008f-1fa7-4d34-a0e1-7f8a7dc9abb9 tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5f358ec-bfcc-4ecb-a1f4-e7b09b88e979) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef65054b-6cfc-42e3-841b-760c723e13a1', 'volume_name': 'volume-ef65054b-6cfc-42e3-841b-760c723e13a1', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-09fc008f-1fa7-4d34-a0e1-7f8a7dc9abb9 tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c9b090f-1672-4bca-ab17-24e7477fe988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-09fc008f-1fa7-4d34-a0e1-7f8a7dc9abb9 tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c9b090f-1672-4bca-ab17-24e7477fe988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-09fc008f-1fa7-4d34-a0e1-7f8a7dc9abb9 tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (420b0fd1-834c-4462-84ab-53f3d65cc927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:31 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-09fc008f-1fa7-4d34-a0e1-7f8a7dc9abb9 tempest-VolumesGetTest-154484293 None] Volume ef65054b-6cfc-42e3-841b-760c723e13a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef65054b-6cfc-42e3-841b-760c723e13a1', 'volume_size': 1} Nov 06 17:54:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-09fc008f-1fa7-4d34-a0e1-7f8a7dc9abb9 tempest-VolumesGetTest-154484293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:54:31 devstack sudo[98110]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6eb0776a-637e-4d2f-8200-278fdd49f08e tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7e67c436-04da-432c-9084-8b9d2f85bebf.94929e76-b090-4b25-91cb-25558031241f" returned: 0 in 0.295s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6eb0776a-637e-4d2f-8200-278fdd49f08e tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7e67c436-04da-432c-9084-8b9d2f85bebf.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:31 devstack sudo[98113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7e67c436-04da-432c-9084-8b9d2f85bebf.info Nov 06 17:54:31 devstack sudo[98113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ea6c10f5-0a29-4ad7-acb6-dde7605438c8 tempest-BackendsCapabilitiesAdminTestsJSON-339275115 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8181610107422, 'free_capacity_gb': 1773.8181610107422, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87068) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 06 17:54:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9043e5ff-14d9-4e06-92bc-7ead00304058 tempest-BackendsCapabilitiesAdminTestsJSON-339275115 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8181610107422, 'free_capacity_gb': 1773.8181610107422, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87068) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 06 17:54:31 devstack sudo[98113]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6eb0776a-637e-4d2f-8200-278fdd49f08e tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7e67c436-04da-432c-9084-8b9d2f85bebf.info" returned: 0 in 0.339s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:31 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-6eb0776a-637e-4d2f-8200-278fdd49f08e tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7e67c436-04da-432c-9084-8b9d2f85bebf.info is being set with open permissions: ugo+rw Nov 06 17:54:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6eb0776a-637e-4d2f-8200-278fdd49f08e tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7e67c436-04da-432c-9084-8b9d2f85bebf.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:31 devstack sudo[98116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7e67c436-04da-432c-9084-8b9d2f85bebf.info Nov 06 17:54:31 devstack sudo[98116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:31 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d8a6fd1f-0765-4155-80ad-7721275bdae6 tempest-VolumesTransfersTest-782442410 None] Acquiring lock "cinder-a53f83c6-fbea-4870-aec7-5a12cdd3ed9a-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:54:31 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d8a6fd1f-0765-4155-80ad-7721275bdae6 tempest-VolumesTransfersTest-782442410 None] Lock "cinder-a53f83c6-fbea-4870-aec7-5a12cdd3ed9a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:54:31 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d8a6fd1f-0765-4155-80ad-7721275bdae6 tempest-VolumesTransfersTest-782442410 None] Acquiring lock "cinder-quobyte-a53f83c6-fbea-4870-aec7-5a12cdd3ed9a" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:54:31 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d8a6fd1f-0765-4155-80ad-7721275bdae6 tempest-VolumesTransfersTest-782442410 None] Lock "cinder-quobyte-a53f83c6-fbea-4870-aec7-5a12cdd3ed9a" acquired by "delete_volume" :: waited 0.017s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:54:31 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[04381fb9-ddf0-4aa4-bdbf-f9213c32ea9c]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:54:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d8a6fd1f-0765-4155-80ad-7721275bdae6 tempest-VolumesTransfersTest-782442410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a53f83c6-fbea-4870-aec7-5a12cdd3ed9a {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:31 devstack sudo[98116]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6eb0776a-637e-4d2f-8200-278fdd49f08e tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7e67c436-04da-432c-9084-8b9d2f85bebf.info" returned: 0 in 0.321s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6eb0776a-637e-4d2f-8200-278fdd49f08e tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.492s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:54:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-09fc008f-1fa7-4d34-a0e1-7f8a7dc9abb9 tempest-VolumesGetTest-154484293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.808s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:54:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-09fc008f-1fa7-4d34-a0e1-7f8a7dc9abb9 tempest-VolumesGetTest-154484293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:54:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-491573849',display_name='tempest-VolumesGetTest-Volume-1871184781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef65054b-6cfc-42e3-841b-760c723e13a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83b317dc0b0f4329aa3bf9863f7ddd5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:54:31Z,use_quota=True,user_id='ea09cba9a9d94ad6a595472e62d9a066',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:54:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-09fc008f-1fa7-4d34-a0e1-7f8a7dc9abb9 tempest-VolumesGetTest-154484293 None] Creating volume ef65054b-6cfc-42e3-841b-760c723e13a1 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:54:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-09fc008f-1fa7-4d34-a0e1-7f8a7dc9abb9 tempest-VolumesGetTest-154484293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:54:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-09fc008f-1fa7-4d34-a0e1-7f8a7dc9abb9 tempest-VolumesGetTest-154484293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:54:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-09fc008f-1fa7-4d34-a0e1-7f8a7dc9abb9 tempest-VolumesGetTest-154484293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:54:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-09fc008f-1fa7-4d34-a0e1-7f8a7dc9abb9 tempest-VolumesGetTest-154484293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:54:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-09fc008f-1fa7-4d34-a0e1-7f8a7dc9abb9 tempest-VolumesGetTest-154484293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:54:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-09fc008f-1fa7-4d34-a0e1-7f8a7dc9abb9 tempest-VolumesGetTest-154484293 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:54:31 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-09fc008f-1fa7-4d34-a0e1-7f8a7dc9abb9 tempest-VolumesGetTest-154484293 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:54:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-09fc008f-1fa7-4d34-a0e1-7f8a7dc9abb9 tempest-VolumesGetTest-154484293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ef65054b-6cfc-42e3-841b-760c723e13a1 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:31 devstack sudo[98118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a53f83c6-fbea-4870-aec7-5a12cdd3ed9a Nov 06 17:54:31 devstack sudo[98118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:31 devstack sudo[98120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ef65054b-6cfc-42e3-841b-760c723e13a1 1073741824 Nov 06 17:54:31 devstack sudo[98120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:31 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-6eb0776a-637e-4d2f-8200-278fdd49f08e tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Create snapshot completed successfully Nov 06 17:54:32 devstack sudo[98118]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d8a6fd1f-0765-4155-80ad-7721275bdae6 tempest-VolumesTransfersTest-782442410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a53f83c6-fbea-4870-aec7-5a12cdd3ed9a" returned: 0 in 0.443s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d8a6fd1f-0765-4155-80ad-7721275bdae6 tempest-VolumesTransfersTest-782442410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a53f83c6-fbea-4870-aec7-5a12cdd3ed9a {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:32 devstack sudo[98130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a53f83c6-fbea-4870-aec7-5a12cdd3ed9a Nov 06 17:54:32 devstack sudo[98130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:32 devstack sudo[98120]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-09fc008f-1fa7-4d34-a0e1-7f8a7dc9abb9 tempest-VolumesGetTest-154484293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ef65054b-6cfc-42e3-841b-760c723e13a1 1073741824" returned: 0 in 0.497s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-09fc008f-1fa7-4d34-a0e1-7f8a7dc9abb9 tempest-VolumesGetTest-154484293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ef65054b-6cfc-42e3-841b-760c723e13a1 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:32 devstack sudo[98132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ef65054b-6cfc-42e3-841b-760c723e13a1 Nov 06 17:54:32 devstack sudo[98132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:32 devstack sudo[98130]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d8a6fd1f-0765-4155-80ad-7721275bdae6 tempest-VolumesTransfersTest-782442410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a53f83c6-fbea-4870-aec7-5a12cdd3ed9a" returned: 0 in 0.284s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d8a6fd1f-0765-4155-80ad-7721275bdae6 tempest-VolumesTransfersTest-782442410 None] Lock "cinder-quobyte-a53f83c6-fbea-4870-aec7-5a12cdd3ed9a" released by "delete_volume" :: held 0.806s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:54:32 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-d8a6fd1f-0765-4155-80ad-7721275bdae6 tempest-VolumesTransfersTest-782442410 None] Created reservations ['79b1aee4-c725-4d19-8402-8fbf4d9bcd2e', 'aabfcd1f-3e10-4a97-9ccb-de730efb94e8', 'fb5eb09a-9872-455d-9641-57b55000f3a9', 'b8d9967c-b59e-40f1-b4a8-93ee372cbe81'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:54:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d8a6fd1f-0765-4155-80ad-7721275bdae6 tempest-VolumesTransfersTest-782442410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:54:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d8a6fd1f-0765-4155-80ad-7721275bdae6 tempest-VolumesTransfersTest-782442410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:54:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d8a6fd1f-0765-4155-80ad-7721275bdae6 tempest-VolumesTransfersTest-782442410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:54:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d8a6fd1f-0765-4155-80ad-7721275bdae6 tempest-VolumesTransfersTest-782442410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:54:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d8a6fd1f-0765-4155-80ad-7721275bdae6 tempest-VolumesTransfersTest-782442410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:54:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d8a6fd1f-0765-4155-80ad-7721275bdae6 tempest-VolumesTransfersTest-782442410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:32 devstack sudo[98136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:54:32 devstack sudo[98136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:32 devstack sudo[98132]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-09fc008f-1fa7-4d34-a0e1-7f8a7dc9abb9 tempest-VolumesGetTest-154484293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ef65054b-6cfc-42e3-841b-760c723e13a1" returned: 0 in 0.278s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-09fc008f-1fa7-4d34-a0e1-7f8a7dc9abb9 tempest-VolumesGetTest-154484293 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:54:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-09fc008f-1fa7-4d34-a0e1-7f8a7dc9abb9 tempest-VolumesGetTest-154484293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:54:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-09fc008f-1fa7-4d34-a0e1-7f8a7dc9abb9 tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (420b0fd1-834c-4462-84ab-53f3d65cc927) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef65054b-6cfc-42e3-841b-760c723e13a1', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-09fc008f-1fa7-4d34-a0e1-7f8a7dc9abb9 tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c3fc1e9-3a3f-4a01-b135-4a41503249b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:32 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-09fc008f-1fa7-4d34-a0e1-7f8a7dc9abb9 tempest-VolumesGetTest-154484293 None] Volume volume-ef65054b-6cfc-42e3-841b-760c723e13a1 (ef65054b-6cfc-42e3-841b-760c723e13a1): created successfully Nov 06 17:54:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-09fc008f-1fa7-4d34-a0e1-7f8a7dc9abb9 tempest-VolumesGetTest-154484293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c3fc1e9-3a3f-4a01-b135-4a41503249b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-09fc008f-1fa7-4d34-a0e1-7f8a7dc9abb9 tempest-VolumesGetTest-154484293 None] Flow 'volume_create_manager' (c86ef2d4-6e8b-47d9-bea7-80597b28291f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:54:32 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-09fc008f-1fa7-4d34-a0e1-7f8a7dc9abb9 tempest-VolumesGetTest-154484293 None] Created volume successfully. Nov 06 17:54:33 devstack sudo[98136]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d8a6fd1f-0765-4155-80ad-7721275bdae6 tempest-VolumesTransfersTest-782442410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.348s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:33 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-d8a6fd1f-0765-4155-80ad-7721275bdae6 tempest-VolumesTransfersTest-782442410 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:54:33 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-d8a6fd1f-0765-4155-80ad-7721275bdae6 tempest-VolumesTransfersTest-782442410 None] Deleted volume successfully. Nov 06 17:54:33 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d8a6fd1f-0765-4155-80ad-7721275bdae6 tempest-VolumesTransfersTest-782442410 None] Lock "cinder-a53f83c6-fbea-4870-aec7-5a12cdd3ed9a-delete_volume" released by "delete_volume" :: held 1.400s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:54:33 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a1f0367b-f1c1-4755-b426-6932c023939c tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Acquiring lock "cinder-94929e76-b090-4b25-91cb-25558031241f-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:54:33 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a1f0367b-f1c1-4755-b426-6932c023939c tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Lock "cinder-94929e76-b090-4b25-91cb-25558031241f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:54:33 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a1f0367b-f1c1-4755-b426-6932c023939c tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Acquiring lock "cinder-quobyte-7e67c436-04da-432c-9084-8b9d2f85bebf" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:54:33 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a1f0367b-f1c1-4755-b426-6932c023939c tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Lock "cinder-quobyte-7e67c436-04da-432c-9084-8b9d2f85bebf" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:54:33 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a1f0367b-f1c1-4755-b426-6932c023939c tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Acquiring lock "cinder-quobyte-94929e76-b090-4b25-91cb-25558031241f" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:54:33 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a1f0367b-f1c1-4755-b426-6932c023939c tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Lock "cinder-quobyte-94929e76-b090-4b25-91cb-25558031241f" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:54:33 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-a1f0367b-f1c1-4755-b426-6932c023939c tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Deleting offline snapshot 94929e76-b090-4b25-91cb-25558031241f of volume 7e67c436-04da-432c-9084-8b9d2f85bebf {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 17:54:33 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-a1f0367b-f1c1-4755-b426-6932c023939c tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] snapshot_file for this snap is: volume-7e67c436-04da-432c-9084-8b9d2f85bebf.94929e76-b090-4b25-91cb-25558031241f {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 17:54:33 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[59549413-c662-4889-9b47-17e7a632594b]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:54:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a1f0367b-f1c1-4755-b426-6932c023939c tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7e67c436-04da-432c-9084-8b9d2f85bebf.94929e76-b090-4b25-91cb-25558031241f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:33 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-760d967b-f223-4499-8acf-01d8d47a4b71 tempest-VolumesGetTest-154484293 None] Acquiring lock "cinder-ef65054b-6cfc-42e3-841b-760c723e13a1-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:54:33 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-760d967b-f223-4499-8acf-01d8d47a4b71 tempest-VolumesGetTest-154484293 None] Lock "cinder-ef65054b-6cfc-42e3-841b-760c723e13a1-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:54:33 devstack sudo[98140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7e67c436-04da-432c-9084-8b9d2f85bebf.94929e76-b090-4b25-91cb-25558031241f Nov 06 17:54:33 devstack sudo[98140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:33 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-760d967b-f223-4499-8acf-01d8d47a4b71 tempest-VolumesGetTest-154484293 None] Acquiring lock "cinder-quobyte-ef65054b-6cfc-42e3-841b-760c723e13a1" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:54:33 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-760d967b-f223-4499-8acf-01d8d47a4b71 tempest-VolumesGetTest-154484293 None] Lock "cinder-quobyte-ef65054b-6cfc-42e3-841b-760c723e13a1" acquired by "delete_volume" :: waited 0.028s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:54:33 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a61a86c-1a08-40ee-981f-74dc45e7e7cb]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:54:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-760d967b-f223-4499-8acf-01d8d47a4b71 tempest-VolumesGetTest-154484293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ef65054b-6cfc-42e3-841b-760c723e13a1 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:33 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2dd236d-efc0-48b3-9e05-3440fb821426 tempest-VolumesTransfersTest-290950831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:54:33 devstack sudo[98142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ef65054b-6cfc-42e3-841b-760c723e13a1 Nov 06 17:54:33 devstack sudo[98142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c2dd236d-efc0-48b3-9e05-3440fb821426 tempest-VolumesTransfersTest-290950831 None] Flow 'volume_create_manager' (53c6bc43-9e12-4893-add0-487a5b34a505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:54:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c2dd236d-efc0-48b3-9e05-3440fb821426 tempest-VolumesTransfersTest-290950831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ac4cde5-b0fc-46b0-99da-505050eae992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c2dd236d-efc0-48b3-9e05-3440fb821426 tempest-VolumesTransfersTest-290950831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ac4cde5-b0fc-46b0-99da-505050eae992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:54:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-848776535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c99629f7-c7ed-4a5f-92e4-6c25d0b55b5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cec5633ae494ef6ae2f6b2ab98578cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:54:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:54:34Z,use_quota=True,user_id='3bd2595050ac42e98584c0f0379be760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c2dd236d-efc0-48b3-9e05-3440fb821426 tempest-VolumesTransfersTest-290950831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8df881b-3d36-4ef6-85a4-5c049ee6bd35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c2dd236d-efc0-48b3-9e05-3440fb821426 tempest-VolumesTransfersTest-290950831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8df881b-3d36-4ef6-85a4-5c049ee6bd35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c2dd236d-efc0-48b3-9e05-3440fb821426 tempest-VolumesTransfersTest-290950831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a8ee5d9-b58d-4f1c-9437-e8c2128d324d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c2dd236d-efc0-48b3-9e05-3440fb821426 tempest-VolumesTransfersTest-290950831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a8ee5d9-b58d-4f1c-9437-e8c2128d324d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c99629f7-c7ed-4a5f-92e4-6c25d0b55b5a', 'volume_name': 'volume-c99629f7-c7ed-4a5f-92e4-6c25d0b55b5a', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c2dd236d-efc0-48b3-9e05-3440fb821426 tempest-VolumesTransfersTest-290950831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abf5a503-1e23-498a-90fa-cdf41bb8e392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c2dd236d-efc0-48b3-9e05-3440fb821426 tempest-VolumesTransfersTest-290950831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abf5a503-1e23-498a-90fa-cdf41bb8e392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c2dd236d-efc0-48b3-9e05-3440fb821426 tempest-VolumesTransfersTest-290950831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed970d0f-d873-4e22-806b-2e01e8ad4356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:33 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-c2dd236d-efc0-48b3-9e05-3440fb821426 tempest-VolumesTransfersTest-290950831 None] Volume c99629f7-c7ed-4a5f-92e4-6c25d0b55b5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c99629f7-c7ed-4a5f-92e4-6c25d0b55b5a', 'volume_size': 1} Nov 06 17:54:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c2dd236d-efc0-48b3-9e05-3440fb821426 tempest-VolumesTransfersTest-290950831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:54:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c2dd236d-efc0-48b3-9e05-3440fb821426 tempest-VolumesTransfersTest-290950831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:54:33 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c2dd236d-efc0-48b3-9e05-3440fb821426 tempest-VolumesTransfersTest-290950831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:54:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-848776535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c99629f7-c7ed-4a5f-92e4-6c25d0b55b5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cec5633ae494ef6ae2f6b2ab98578cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:54:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:54:34Z,use_quota=True,user_id='3bd2595050ac42e98584c0f0379be760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:54:33 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-c2dd236d-efc0-48b3-9e05-3440fb821426 tempest-VolumesTransfersTest-290950831 None] Creating volume c99629f7-c7ed-4a5f-92e4-6c25d0b55b5a {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:54:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c2dd236d-efc0-48b3-9e05-3440fb821426 tempest-VolumesTransfersTest-290950831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:54:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c2dd236d-efc0-48b3-9e05-3440fb821426 tempest-VolumesTransfersTest-290950831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:54:33 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c2dd236d-efc0-48b3-9e05-3440fb821426 tempest-VolumesTransfersTest-290950831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:54:33 devstack sudo[98140]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:33 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c2dd236d-efc0-48b3-9e05-3440fb821426 tempest-VolumesTransfersTest-290950831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:54:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c2dd236d-efc0-48b3-9e05-3440fb821426 tempest-VolumesTransfersTest-290950831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:54:33 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c2dd236d-efc0-48b3-9e05-3440fb821426 tempest-VolumesTransfersTest-290950831 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:54:33 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-c2dd236d-efc0-48b3-9e05-3440fb821426 tempest-VolumesTransfersTest-290950831 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:54:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c2dd236d-efc0-48b3-9e05-3440fb821426 tempest-VolumesTransfersTest-290950831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c99629f7-c7ed-4a5f-92e4-6c25d0b55b5a 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a1f0367b-f1c1-4755-b426-6932c023939c tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7e67c436-04da-432c-9084-8b9d2f85bebf.94929e76-b090-4b25-91cb-25558031241f" returned: 0 in 0.601s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:33 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-a1f0367b-f1c1-4755-b426-6932c023939c tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e67c436-04da-432c-9084-8b9d2f85bebf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 17:54:33 devstack sudo[98147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c99629f7-c7ed-4a5f-92e4-6c25d0b55b5a 1073741824 Nov 06 17:54:33 devstack sudo[98147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:33 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[523b1d7f-64a0-4913-bf1f-2cfda5ebb040]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:54:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a1f0367b-f1c1-4755-b426-6932c023939c tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7e67c436-04da-432c-9084-8b9d2f85bebf {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:34 devstack sudo[98142]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-760d967b-f223-4499-8acf-01d8d47a4b71 tempest-VolumesGetTest-154484293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ef65054b-6cfc-42e3-841b-760c723e13a1" returned: 0 in 0.532s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-760d967b-f223-4499-8acf-01d8d47a4b71 tempest-VolumesGetTest-154484293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ef65054b-6cfc-42e3-841b-760c723e13a1 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:34 devstack sudo[98149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7e67c436-04da-432c-9084-8b9d2f85bebf Nov 06 17:54:34 devstack sudo[98149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:34 devstack sudo[98155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ef65054b-6cfc-42e3-841b-760c723e13a1 Nov 06 17:54:34 devstack sudo[98155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:34 devstack sudo[98155]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-760d967b-f223-4499-8acf-01d8d47a4b71 tempest-VolumesGetTest-154484293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ef65054b-6cfc-42e3-841b-760c723e13a1" returned: 0 in 0.313s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-760d967b-f223-4499-8acf-01d8d47a4b71 tempest-VolumesGetTest-154484293 None] Lock "cinder-quobyte-ef65054b-6cfc-42e3-841b-760c723e13a1" released by "delete_volume" :: held 0.912s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:54:34 devstack sudo[98149]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a1f0367b-f1c1-4755-b426-6932c023939c tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7e67c436-04da-432c-9084-8b9d2f85bebf" returned: 0 in 0.529s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a1f0367b-f1c1-4755-b426-6932c023939c tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7e67c436-04da-432c-9084-8b9d2f85bebf.94929e76-b090-4b25-91cb-25558031241f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:34 devstack sudo[98147]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c2dd236d-efc0-48b3-9e05-3440fb821426 tempest-VolumesTransfersTest-290950831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c99629f7-c7ed-4a5f-92e4-6c25d0b55b5a 1073741824" returned: 0 in 0.658s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:34 devstack sudo[98164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7e67c436-04da-432c-9084-8b9d2f85bebf.94929e76-b090-4b25-91cb-25558031241f Nov 06 17:54:34 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-760d967b-f223-4499-8acf-01d8d47a4b71 tempest-VolumesGetTest-154484293 None] Created reservations ['5bec419d-b517-4ee8-87f5-0699f5490f89', '4908450b-bb8b-4f67-8189-a844f5fbde9f', '8404c913-2653-4baa-a48b-6a53e6b6755e', 'ed9436e0-b312-4873-b30c-ff52edf3394e'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:54:34 devstack sudo[98164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c2dd236d-efc0-48b3-9e05-3440fb821426 tempest-VolumesTransfersTest-290950831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c99629f7-c7ed-4a5f-92e4-6c25d0b55b5a {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:34 devstack sudo[98166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c99629f7-c7ed-4a5f-92e4-6c25d0b55b5a Nov 06 17:54:34 devstack sudo[98166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-760d967b-f223-4499-8acf-01d8d47a4b71 tempest-VolumesGetTest-154484293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:54:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-760d967b-f223-4499-8acf-01d8d47a4b71 tempest-VolumesGetTest-154484293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:54:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-760d967b-f223-4499-8acf-01d8d47a4b71 tempest-VolumesGetTest-154484293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:54:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-760d967b-f223-4499-8acf-01d8d47a4b71 tempest-VolumesGetTest-154484293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:54:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-760d967b-f223-4499-8acf-01d8d47a4b71 tempest-VolumesGetTest-154484293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:54:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-760d967b-f223-4499-8acf-01d8d47a4b71 tempest-VolumesGetTest-154484293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:34 devstack sudo[98168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:54:34 devstack sudo[98168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:34 devstack sudo[98166]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c2dd236d-efc0-48b3-9e05-3440fb821426 tempest-VolumesTransfersTest-290950831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c99629f7-c7ed-4a5f-92e4-6c25d0b55b5a" returned: 0 in 0.298s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c2dd236d-efc0-48b3-9e05-3440fb821426 tempest-VolumesTransfersTest-290950831 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:54:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c2dd236d-efc0-48b3-9e05-3440fb821426 tempest-VolumesTransfersTest-290950831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:54:35 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c2dd236d-efc0-48b3-9e05-3440fb821426 tempest-VolumesTransfersTest-290950831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed970d0f-d873-4e22-806b-2e01e8ad4356) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c99629f7-c7ed-4a5f-92e4-6c25d0b55b5a', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:35 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c2dd236d-efc0-48b3-9e05-3440fb821426 tempest-VolumesTransfersTest-290950831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35d420a6-7426-495e-bbd6-c4e385a4f745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:35 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-c2dd236d-efc0-48b3-9e05-3440fb821426 tempest-VolumesTransfersTest-290950831 None] Volume volume-c99629f7-c7ed-4a5f-92e4-6c25d0b55b5a (c99629f7-c7ed-4a5f-92e4-6c25d0b55b5a): created successfully Nov 06 17:54:35 devstack sudo[98164]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:35 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c2dd236d-efc0-48b3-9e05-3440fb821426 tempest-VolumesTransfersTest-290950831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35d420a6-7426-495e-bbd6-c4e385a4f745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:35 devstack sudo[98168]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:35 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c2dd236d-efc0-48b3-9e05-3440fb821426 tempest-VolumesTransfersTest-290950831 None] Flow 'volume_create_manager' (53c6bc43-9e12-4893-add0-487a5b34a505) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:54:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-760d967b-f223-4499-8acf-01d8d47a4b71 tempest-VolumesGetTest-154484293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.303s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a1f0367b-f1c1-4755-b426-6932c023939c tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7e67c436-04da-432c-9084-8b9d2f85bebf.94929e76-b090-4b25-91cb-25558031241f" returned: 0 in 0.533s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:35 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-760d967b-f223-4499-8acf-01d8d47a4b71 tempest-VolumesGetTest-154484293 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:54:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a1f0367b-f1c1-4755-b426-6932c023939c tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7e67c436-04da-432c-9084-8b9d2f85bebf.94929e76-b090-4b25-91cb-25558031241f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:35 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-760d967b-f223-4499-8acf-01d8d47a4b71 tempest-VolumesGetTest-154484293 None] Deleted volume successfully. Nov 06 17:54:35 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-c2dd236d-efc0-48b3-9e05-3440fb821426 tempest-VolumesTransfersTest-290950831 None] Created volume successfully. Nov 06 17:54:35 devstack sudo[98175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7e67c436-04da-432c-9084-8b9d2f85bebf.94929e76-b090-4b25-91cb-25558031241f Nov 06 17:54:35 devstack sudo[98175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-760d967b-f223-4499-8acf-01d8d47a4b71 tempest-VolumesGetTest-154484293 None] Lock "cinder-ef65054b-6cfc-42e3-841b-760c723e13a1-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:54:35 devstack sudo[98175]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a1f0367b-f1c1-4755-b426-6932c023939c tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7e67c436-04da-432c-9084-8b9d2f85bebf.94929e76-b090-4b25-91cb-25558031241f" returned: 0 in 0.283s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a1f0367b-f1c1-4755-b426-6932c023939c tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Lock "cinder-quobyte-94929e76-b090-4b25-91cb-25558031241f" released by "_delete_snapshot" :: held 2.155s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:54:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a1f0367b-f1c1-4755-b426-6932c023939c tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Lock "cinder-quobyte-7e67c436-04da-432c-9084-8b9d2f85bebf" released by "delete_snapshot" :: held 2.206s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:54:35 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-a1f0367b-f1c1-4755-b426-6932c023939c tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Created reservations ['18378ad6-398b-4935-b1a4-aa6b8ea018e1', '6af21877-eadb-43c2-a3f1-0232e93f2315', '432e17e1-43c1-43ce-9f27-7cf2f44a33b0', 'f7d6081b-56ff-4ff3-a9f0-7c55f9b8df03'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:54:35 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-a1f0367b-f1c1-4755-b426-6932c023939c tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Delete snapshot completed successfully. Nov 06 17:54:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a1f0367b-f1c1-4755-b426-6932c023939c tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Lock "cinder-94929e76-b090-4b25-91cb-25558031241f-delete_snapshot" released by "delete_snapshot" :: held 2.358s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:54:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-7c3e36a9-c442-4190-959e-b80937b285b5 tempest-VolumesGetTest-154484293 None] Acquiring lock "cinder-35a2cc63-7439-4402-b76d-5203c302b653-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:54:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-7c3e36a9-c442-4190-959e-b80937b285b5 tempest-VolumesGetTest-154484293 None] Lock "cinder-35a2cc63-7439-4402-b76d-5203c302b653-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:54:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-7c3e36a9-c442-4190-959e-b80937b285b5 tempest-VolumesGetTest-154484293 None] Acquiring lock "cinder-quobyte-35a2cc63-7439-4402-b76d-5203c302b653" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:54:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-7c3e36a9-c442-4190-959e-b80937b285b5 tempest-VolumesGetTest-154484293 None] Lock "cinder-quobyte-35a2cc63-7439-4402-b76d-5203c302b653" acquired by "delete_volume" :: waited 0.019s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:54:35 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab81f89-d942-4329-9764-af42c9c6caaf]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:54:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7c3e36a9-c442-4190-959e-b80937b285b5 tempest-VolumesGetTest-154484293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-35a2cc63-7439-4402-b76d-5203c302b653 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:36 devstack sudo[98178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-35a2cc63-7439-4402-b76d-5203c302b653 Nov 06 17:54:36 devstack sudo[98178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-3086f9c7-a44c-405c-b244-f2c2bb0b53c5 tempest-VolumesTransfersTest-782442410 None] Acquiring lock "cinder-c99629f7-c7ed-4a5f-92e4-6c25d0b55b5a-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:54:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-3086f9c7-a44c-405c-b244-f2c2bb0b53c5 tempest-VolumesTransfersTest-782442410 None] Lock "cinder-c99629f7-c7ed-4a5f-92e4-6c25d0b55b5a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:54:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-3086f9c7-a44c-405c-b244-f2c2bb0b53c5 tempest-VolumesTransfersTest-782442410 None] Acquiring lock "cinder-quobyte-c99629f7-c7ed-4a5f-92e4-6c25d0b55b5a" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:54:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-3086f9c7-a44c-405c-b244-f2c2bb0b53c5 tempest-VolumesTransfersTest-782442410 None] Lock "cinder-quobyte-c99629f7-c7ed-4a5f-92e4-6c25d0b55b5a" acquired by "delete_volume" :: waited 0.031s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:54:36 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ec17b7-6a5e-4156-b4f0-3b551006893a]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:54:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3086f9c7-a44c-405c-b244-f2c2bb0b53c5 tempest-VolumesTransfersTest-782442410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c99629f7-c7ed-4a5f-92e4-6c25d0b55b5a {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:36 devstack sudo[98178]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7c3e36a9-c442-4190-959e-b80937b285b5 tempest-VolumesGetTest-154484293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-35a2cc63-7439-4402-b76d-5203c302b653" returned: 0 in 0.457s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7c3e36a9-c442-4190-959e-b80937b285b5 tempest-VolumesGetTest-154484293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-35a2cc63-7439-4402-b76d-5203c302b653 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:36 devstack sudo[98181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c99629f7-c7ed-4a5f-92e4-6c25d0b55b5a Nov 06 17:54:36 devstack sudo[98181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:36 devstack sudo[98184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-35a2cc63-7439-4402-b76d-5203c302b653 Nov 06 17:54:36 devstack sudo[98184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1e073ca3-bf10-4972-a0b5-bb1baf264720 tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Acquiring lock "cinder-7e67c436-04da-432c-9084-8b9d2f85bebf-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:54:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1e073ca3-bf10-4972-a0b5-bb1baf264720 tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Lock "cinder-7e67c436-04da-432c-9084-8b9d2f85bebf-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:54:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1e073ca3-bf10-4972-a0b5-bb1baf264720 tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Acquiring lock "cinder-quobyte-7e67c436-04da-432c-9084-8b9d2f85bebf" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:54:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1e073ca3-bf10-4972-a0b5-bb1baf264720 tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Lock "cinder-quobyte-7e67c436-04da-432c-9084-8b9d2f85bebf" acquired by "delete_volume" :: waited 0.020s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:54:36 devstack sudo[98184]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7c3e36a9-c442-4190-959e-b80937b285b5 tempest-VolumesGetTest-154484293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-35a2cc63-7439-4402-b76d-5203c302b653" returned: 0 in 0.373s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:36 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48a5232-8150-46de-814e-43273f6bdffa]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:54:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1e073ca3-bf10-4972-a0b5-bb1baf264720 tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7e67c436-04da-432c-9084-8b9d2f85bebf {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-7c3e36a9-c442-4190-959e-b80937b285b5 tempest-VolumesGetTest-154484293 None] Lock "cinder-quobyte-35a2cc63-7439-4402-b76d-5203c302b653" released by "delete_volume" :: held 0.907s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:54:36 devstack sudo[98181]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:36 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:UPDATE=142,cinder:SELECT=116,cinder:DELETE=18,cinder:INSERT=45 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 17:54:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3086f9c7-a44c-405c-b244-f2c2bb0b53c5 tempest-VolumesTransfersTest-782442410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c99629f7-c7ed-4a5f-92e4-6c25d0b55b5a" returned: 0 in 0.518s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3086f9c7-a44c-405c-b244-f2c2bb0b53c5 tempest-VolumesTransfersTest-782442410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c99629f7-c7ed-4a5f-92e4-6c25d0b55b5a {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:36 devstack sudo[98192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c99629f7-c7ed-4a5f-92e4-6c25d0b55b5a Nov 06 17:54:36 devstack sudo[98192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:36 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-7c3e36a9-c442-4190-959e-b80937b285b5 tempest-VolumesGetTest-154484293 None] Created reservations ['46d70cf5-4e21-4183-a840-32e65fe9557d', 'bc3ed20a-c3d8-4ae4-be89-c2ad4e12b560', 'dcfbcada-6ed6-401d-b53d-89793f9b94ec', 'd2fd1845-4072-48b3-a0a2-7cdafc22c324'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:54:36 devstack sudo[98191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7e67c436-04da-432c-9084-8b9d2f85bebf Nov 06 17:54:36 devstack sudo[98191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7c3e36a9-c442-4190-959e-b80937b285b5 tempest-VolumesGetTest-154484293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:54:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7c3e36a9-c442-4190-959e-b80937b285b5 tempest-VolumesGetTest-154484293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:54:37 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7c3e36a9-c442-4190-959e-b80937b285b5 tempest-VolumesGetTest-154484293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:54:37 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7c3e36a9-c442-4190-959e-b80937b285b5 tempest-VolumesGetTest-154484293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:54:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7c3e36a9-c442-4190-959e-b80937b285b5 tempest-VolumesGetTest-154484293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:54:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7c3e36a9-c442-4190-959e-b80937b285b5 tempest-VolumesGetTest-154484293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:37 devstack sudo[98195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:54:37 devstack sudo[98195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:37 devstack sudo[98192]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3086f9c7-a44c-405c-b244-f2c2bb0b53c5 tempest-VolumesTransfersTest-782442410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c99629f7-c7ed-4a5f-92e4-6c25d0b55b5a" returned: 0 in 0.341s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-3086f9c7-a44c-405c-b244-f2c2bb0b53c5 tempest-VolumesTransfersTest-782442410 None] Lock "cinder-quobyte-c99629f7-c7ed-4a5f-92e4-6c25d0b55b5a" released by "delete_volume" :: held 0.914s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:54:37 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-3086f9c7-a44c-405c-b244-f2c2bb0b53c5 tempest-VolumesTransfersTest-782442410 None] Created reservations ['14c19b3d-1108-46d3-9fd4-e110b0168986', '5230f6ea-05b1-403b-80f4-8192f111d582', '2f3ce42f-9838-4a7f-89d4-49b05b7a1c8d', 'c7b90e6c-2dad-444f-8056-8684c2d56090'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:54:37 devstack sudo[98191]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:37 devstack sudo[98195]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1e073ca3-bf10-4972-a0b5-bb1baf264720 tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7e67c436-04da-432c-9084-8b9d2f85bebf" returned: 0 in 0.537s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1e073ca3-bf10-4972-a0b5-bb1baf264720 tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7e67c436-04da-432c-9084-8b9d2f85bebf {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7c3e36a9-c442-4190-959e-b80937b285b5 tempest-VolumesGetTest-154484293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.340s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:37 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-7c3e36a9-c442-4190-959e-b80937b285b5 tempest-VolumesGetTest-154484293 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:54:37 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-7c3e36a9-c442-4190-959e-b80937b285b5 tempest-VolumesGetTest-154484293 None] Deleted volume successfully. Nov 06 17:54:37 devstack sudo[98202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7e67c436-04da-432c-9084-8b9d2f85bebf Nov 06 17:54:37 devstack sudo[98202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-7c3e36a9-c442-4190-959e-b80937b285b5 tempest-VolumesGetTest-154484293 None] Lock "cinder-35a2cc63-7439-4402-b76d-5203c302b653-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:54:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3086f9c7-a44c-405c-b244-f2c2bb0b53c5 tempest-VolumesTransfersTest-782442410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:54:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3086f9c7-a44c-405c-b244-f2c2bb0b53c5 tempest-VolumesTransfersTest-782442410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:54:37 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3086f9c7-a44c-405c-b244-f2c2bb0b53c5 tempest-VolumesTransfersTest-782442410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:54:37 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3086f9c7-a44c-405c-b244-f2c2bb0b53c5 tempest-VolumesTransfersTest-782442410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:54:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3086f9c7-a44c-405c-b244-f2c2bb0b53c5 tempest-VolumesTransfersTest-782442410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:54:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3086f9c7-a44c-405c-b244-f2c2bb0b53c5 tempest-VolumesTransfersTest-782442410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:37 devstack sudo[98204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:54:37 devstack sudo[98204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:37 devstack sudo[98202]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1e073ca3-bf10-4972-a0b5-bb1baf264720 tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7e67c436-04da-432c-9084-8b9d2f85bebf" returned: 0 in 0.306s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1e073ca3-bf10-4972-a0b5-bb1baf264720 tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Lock "cinder-quobyte-7e67c436-04da-432c-9084-8b9d2f85bebf" released by "delete_volume" :: held 0.982s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:54:37 devstack sudo[98204]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3086f9c7-a44c-405c-b244-f2c2bb0b53c5 tempest-VolumesTransfersTest-782442410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.351s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:37 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-3086f9c7-a44c-405c-b244-f2c2bb0b53c5 tempest-VolumesTransfersTest-782442410 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:54:37 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-3086f9c7-a44c-405c-b244-f2c2bb0b53c5 tempest-VolumesTransfersTest-782442410 None] Deleted volume successfully. Nov 06 17:54:37 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-1e073ca3-bf10-4972-a0b5-bb1baf264720 tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Created reservations ['b71f226c-af32-4f17-a069-2cd508073069', 'cc4c8ddb-2f4f-497b-b7f1-c6cc3c9c8042', '110cdb48-b397-4af1-ba65-64529f7f1c31', '00728c2e-fd0a-41a6-9949-24fb3d4ce0f0'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:54:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-3086f9c7-a44c-405c-b244-f2c2bb0b53c5 tempest-VolumesTransfersTest-782442410 None] Lock "cinder-c99629f7-c7ed-4a5f-92e4-6c25d0b55b5a-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:54:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1e073ca3-bf10-4972-a0b5-bb1baf264720 tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:54:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1e073ca3-bf10-4972-a0b5-bb1baf264720 tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:54:37 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1e073ca3-bf10-4972-a0b5-bb1baf264720 tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:54:37 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1e073ca3-bf10-4972-a0b5-bb1baf264720 tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:54:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1e073ca3-bf10-4972-a0b5-bb1baf264720 tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:54:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1e073ca3-bf10-4972-a0b5-bb1baf264720 tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:37 devstack sudo[98208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:54:37 devstack sudo[98208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:38 devstack sudo[98208]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1e073ca3-bf10-4972-a0b5-bb1baf264720 tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.302s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:38 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-1e073ca3-bf10-4972-a0b5-bb1baf264720 tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:54:38 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-1e073ca3-bf10-4972-a0b5-bb1baf264720 tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Deleted volume successfully. Nov 06 17:54:38 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1e073ca3-bf10-4972-a0b5-bb1baf264720 tempest-VolumesSnapshotNegativeTestJSON-1234699110 None] Lock "cinder-7e67c436-04da-432c-9084-8b9d2f85bebf-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:54:39 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=122,cinder:INSERT=51,cinder:UPDATE=167,cinder:DELETE=8 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 17:54:39 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-4af9a77a-ea7b-4467-8d32-d12ea12bc638 tempest-GroupsV314Test-2068083799 None] Group tempest-GroupsV314Test-Group-946838468: creating Nov 06 17:54:39 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-4af9a77a-ea7b-4467-8d32-d12ea12bc638 tempest-GroupsV314Test-2068083799 None] Group tempest-GroupsV314Test-Group-946838468: created successfully Nov 06 17:54:39 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-4af9a77a-ea7b-4467-8d32-d12ea12bc638 tempest-GroupsV314Test-2068083799 None] Create group completed successfully. Nov 06 17:54:41 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-045cc66d-0118-47fb-958b-448f36b76d6f tempest-GroupsV314Test-2068083799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:54:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-045cc66d-0118-47fb-958b-448f36b76d6f tempest-GroupsV314Test-2068083799 None] Flow 'volume_create_manager' (2d5d5239-986c-4b6c-81a4-fb19e5d4eaf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:54:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-045cc66d-0118-47fb-958b-448f36b76d6f tempest-GroupsV314Test-2068083799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ce395c7-d1f7-4a10-9ae4-f5314e135407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-045cc66d-0118-47fb-958b-448f36b76d6f tempest-GroupsV314Test-2068083799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ce395c7-d1f7-4a10-9ae4-f5314e135407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:54:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-583470052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=548eace4-42dc-4252-8cec-e2696b190d15,host='devstack@QuobyteHD#QuobyteHD',id=7d4405c8-5d51-4485-9f50-bfc87a1c80ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42e5aa37aa8d4eb6a30ad1a49a5007b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:54:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:54:41Z,use_quota=True,user_id='9f5cda092c1c42948ed1b2e42709d183',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd4f3572-e348-4140-a7d9-acc673377655),volume_type_id=dd4f3572-e348-4140-a7d9-acc673377655)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-045cc66d-0118-47fb-958b-448f36b76d6f tempest-GroupsV314Test-2068083799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbca7d72-6327-4a8b-ba42-47a4a93da05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-045cc66d-0118-47fb-958b-448f36b76d6f tempest-GroupsV314Test-2068083799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbca7d72-6327-4a8b-ba42-47a4a93da05c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-045cc66d-0118-47fb-958b-448f36b76d6f tempest-GroupsV314Test-2068083799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ca98115-ce3a-4c41-afee-810ff7ec7dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-045cc66d-0118-47fb-958b-448f36b76d6f tempest-GroupsV314Test-2068083799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ca98115-ce3a-4c41-afee-810ff7ec7dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d4405c8-5d51-4485-9f50-bfc87a1c80ae', 'volume_name': 'volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-045cc66d-0118-47fb-958b-448f36b76d6f tempest-GroupsV314Test-2068083799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7fe2a62-25bd-44fd-a0d8-7e23f7930121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-045cc66d-0118-47fb-958b-448f36b76d6f tempest-GroupsV314Test-2068083799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7fe2a62-25bd-44fd-a0d8-7e23f7930121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-045cc66d-0118-47fb-958b-448f36b76d6f tempest-GroupsV314Test-2068083799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e14785d-06e4-4f18-8f06-41d4b1ec4187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:41 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-045cc66d-0118-47fb-958b-448f36b76d6f tempest-GroupsV314Test-2068083799 None] Volume 7d4405c8-5d51-4485-9f50-bfc87a1c80ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae', 'volume_size': 1} Nov 06 17:54:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-045cc66d-0118-47fb-958b-448f36b76d6f tempest-GroupsV314Test-2068083799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:54:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-045cc66d-0118-47fb-958b-448f36b76d6f tempest-GroupsV314Test-2068083799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:54:41 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-045cc66d-0118-47fb-958b-448f36b76d6f tempest-GroupsV314Test-2068083799 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=548eace4-42dc-4252-8cec-e2696b190d15,created_at=2026-11-06T16:54:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-583470052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=548eace4-42dc-4252-8cec-e2696b190d15,host='devstack@QuobyteHD#QuobyteHD',id=7d4405c8-5d51-4485-9f50-bfc87a1c80ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42e5aa37aa8d4eb6a30ad1a49a5007b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:54:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:54:41Z,use_quota=True,user_id='9f5cda092c1c42948ed1b2e42709d183',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd4f3572-e348-4140-a7d9-acc673377655),volume_type_id=dd4f3572-e348-4140-a7d9-acc673377655)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:54:41 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-045cc66d-0118-47fb-958b-448f36b76d6f tempest-GroupsV314Test-2068083799 None] Creating volume 7d4405c8-5d51-4485-9f50-bfc87a1c80ae {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:54:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-045cc66d-0118-47fb-958b-448f36b76d6f tempest-GroupsV314Test-2068083799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:54:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-045cc66d-0118-47fb-958b-448f36b76d6f tempest-GroupsV314Test-2068083799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:54:41 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-045cc66d-0118-47fb-958b-448f36b76d6f tempest-GroupsV314Test-2068083799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:54:41 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-045cc66d-0118-47fb-958b-448f36b76d6f tempest-GroupsV314Test-2068083799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:54:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-045cc66d-0118-47fb-958b-448f36b76d6f tempest-GroupsV314Test-2068083799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:54:41 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-045cc66d-0118-47fb-958b-448f36b76d6f tempest-GroupsV314Test-2068083799 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:54:41 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-045cc66d-0118-47fb-958b-448f36b76d6f tempest-GroupsV314Test-2068083799 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:54:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-045cc66d-0118-47fb-958b-448f36b76d6f tempest-GroupsV314Test-2068083799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:41 devstack sudo[98212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae 1073741824 Nov 06 17:54:41 devstack sudo[98212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:41 devstack sudo[98212]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-045cc66d-0118-47fb-958b-448f36b76d6f tempest-GroupsV314Test-2068083799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae 1073741824" returned: 0 in 0.574s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-045cc66d-0118-47fb-958b-448f36b76d6f tempest-GroupsV314Test-2068083799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:42 devstack sudo[98218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae Nov 06 17:54:42 devstack sudo[98218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:42 devstack sudo[98218]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-045cc66d-0118-47fb-958b-448f36b76d6f tempest-GroupsV314Test-2068083799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae" returned: 0 in 0.315s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:42 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-045cc66d-0118-47fb-958b-448f36b76d6f tempest-GroupsV314Test-2068083799 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:54:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-045cc66d-0118-47fb-958b-448f36b76d6f tempest-GroupsV314Test-2068083799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:54:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-045cc66d-0118-47fb-958b-448f36b76d6f tempest-GroupsV314Test-2068083799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e14785d-06e4-4f18-8f06-41d4b1ec4187) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-045cc66d-0118-47fb-958b-448f36b76d6f tempest-GroupsV314Test-2068083799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b671c989-8b6b-4628-b8e9-61e3bcb563c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:42 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-045cc66d-0118-47fb-958b-448f36b76d6f tempest-GroupsV314Test-2068083799 None] Volume volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae (7d4405c8-5d51-4485-9f50-bfc87a1c80ae): created successfully Nov 06 17:54:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-045cc66d-0118-47fb-958b-448f36b76d6f tempest-GroupsV314Test-2068083799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b671c989-8b6b-4628-b8e9-61e3bcb563c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-045cc66d-0118-47fb-958b-448f36b76d6f tempest-GroupsV314Test-2068083799 None] Flow 'volume_create_manager' (2d5d5239-986c-4b6c-81a4-fb19e5d4eaf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:54:42 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-045cc66d-0118-47fb-958b-448f36b76d6f tempest-GroupsV314Test-2068083799 None] Created volume successfully. Nov 06 17:54:44 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ddc2d34-347b-4c4d-8761-cfb03f7f00a1 tempest-VolumesListTestJSON-64306112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:54:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7ddc2d34-347b-4c4d-8761-cfb03f7f00a1 tempest-VolumesListTestJSON-64306112 None] Flow 'volume_create_manager' (52a1126b-b2eb-4a74-9b8b-a5c9c1efbc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:54:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7ddc2d34-347b-4c4d-8761-cfb03f7f00a1 tempest-VolumesListTestJSON-64306112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49dbe761-8b48-4cc1-9684-718e24a83ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7ddc2d34-347b-4c4d-8761-cfb03f7f00a1 tempest-VolumesListTestJSON-64306112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49dbe761-8b48-4cc1-9684-718e24a83ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:54:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1028099563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d84efb5-9a18-48ea-81b2-e9dce5176d3d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='673368b979b745df89ed705382690139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:54:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:54:44Z,use_quota=True,user_id='bab9bcb3d2fa4bef919dca979140385e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7ddc2d34-347b-4c4d-8761-cfb03f7f00a1 tempest-VolumesListTestJSON-64306112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03c94866-2fdf-4e7e-a7b4-3887372ccc56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7ddc2d34-347b-4c4d-8761-cfb03f7f00a1 tempest-VolumesListTestJSON-64306112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03c94866-2fdf-4e7e-a7b4-3887372ccc56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7ddc2d34-347b-4c4d-8761-cfb03f7f00a1 tempest-VolumesListTestJSON-64306112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b9db1b8-d5da-4f45-8665-fa8f95c31ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7ddc2d34-347b-4c4d-8761-cfb03f7f00a1 tempest-VolumesListTestJSON-64306112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b9db1b8-d5da-4f45-8665-fa8f95c31ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d84efb5-9a18-48ea-81b2-e9dce5176d3d', 'volume_name': 'volume-1d84efb5-9a18-48ea-81b2-e9dce5176d3d', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7ddc2d34-347b-4c4d-8761-cfb03f7f00a1 tempest-VolumesListTestJSON-64306112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18cc65d1-0b6e-49f4-9e16-04c0b3b14ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7ddc2d34-347b-4c4d-8761-cfb03f7f00a1 tempest-VolumesListTestJSON-64306112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18cc65d1-0b6e-49f4-9e16-04c0b3b14ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7ddc2d34-347b-4c4d-8761-cfb03f7f00a1 tempest-VolumesListTestJSON-64306112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42653eb3-2bdc-44c9-af17-d1221b290d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:44 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-7ddc2d34-347b-4c4d-8761-cfb03f7f00a1 tempest-VolumesListTestJSON-64306112 None] Volume 1d84efb5-9a18-48ea-81b2-e9dce5176d3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d84efb5-9a18-48ea-81b2-e9dce5176d3d', 'volume_size': 1} Nov 06 17:54:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7ddc2d34-347b-4c4d-8761-cfb03f7f00a1 tempest-VolumesListTestJSON-64306112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:54:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7ddc2d34-347b-4c4d-8761-cfb03f7f00a1 tempest-VolumesListTestJSON-64306112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:54:44 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7ddc2d34-347b-4c4d-8761-cfb03f7f00a1 tempest-VolumesListTestJSON-64306112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:54:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1028099563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d84efb5-9a18-48ea-81b2-e9dce5176d3d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='673368b979b745df89ed705382690139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:54:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:54:44Z,use_quota=True,user_id='bab9bcb3d2fa4bef919dca979140385e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:54:44 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-7ddc2d34-347b-4c4d-8761-cfb03f7f00a1 tempest-VolumesListTestJSON-64306112 None] Creating volume 1d84efb5-9a18-48ea-81b2-e9dce5176d3d {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:54:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7ddc2d34-347b-4c4d-8761-cfb03f7f00a1 tempest-VolumesListTestJSON-64306112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:54:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7ddc2d34-347b-4c4d-8761-cfb03f7f00a1 tempest-VolumesListTestJSON-64306112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:54:44 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7ddc2d34-347b-4c4d-8761-cfb03f7f00a1 tempest-VolumesListTestJSON-64306112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:54:44 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7ddc2d34-347b-4c4d-8761-cfb03f7f00a1 tempest-VolumesListTestJSON-64306112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:54:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7ddc2d34-347b-4c4d-8761-cfb03f7f00a1 tempest-VolumesListTestJSON-64306112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:54:44 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7ddc2d34-347b-4c4d-8761-cfb03f7f00a1 tempest-VolumesListTestJSON-64306112 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:54:44 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-7ddc2d34-347b-4c4d-8761-cfb03f7f00a1 tempest-VolumesListTestJSON-64306112 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:54:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7ddc2d34-347b-4c4d-8761-cfb03f7f00a1 tempest-VolumesListTestJSON-64306112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1d84efb5-9a18-48ea-81b2-e9dce5176d3d 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:44 devstack sudo[98221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1d84efb5-9a18-48ea-81b2-e9dce5176d3d 1073741824 Nov 06 17:54:44 devstack sudo[98221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cc0f1691-840c-46d0-9cc0-edb419a24120 tempest-GroupsV314Test-2068083799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:54:44 devstack sudo[98221]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7ddc2d34-347b-4c4d-8761-cfb03f7f00a1 tempest-VolumesListTestJSON-64306112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1d84efb5-9a18-48ea-81b2-e9dce5176d3d 1073741824" returned: 0 in 0.634s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7ddc2d34-347b-4c4d-8761-cfb03f7f00a1 tempest-VolumesListTestJSON-64306112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1d84efb5-9a18-48ea-81b2-e9dce5176d3d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:45 devstack sudo[98228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1d84efb5-9a18-48ea-81b2-e9dce5176d3d Nov 06 17:54:45 devstack sudo[98228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:45 devstack sudo[98228]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7ddc2d34-347b-4c4d-8761-cfb03f7f00a1 tempest-VolumesListTestJSON-64306112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1d84efb5-9a18-48ea-81b2-e9dce5176d3d" returned: 0 in 0.300s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:45 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7ddc2d34-347b-4c4d-8761-cfb03f7f00a1 tempest-VolumesListTestJSON-64306112 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:54:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7ddc2d34-347b-4c4d-8761-cfb03f7f00a1 tempest-VolumesListTestJSON-64306112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:54:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cc0f1691-840c-46d0-9cc0-edb419a24120 tempest-GroupsV314Test-2068083799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.909s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:54:45 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-cc0f1691-840c-46d0-9cc0-edb419a24120 tempest-GroupsV314Test-2068083799 None] Cloning volume 7d4405c8-5d51-4485-9f50-bfc87a1c80ae to volume 520bfdc5-778d-4f84-a5f0-c4268660435c Nov 06 17:54:45 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7ddc2d34-347b-4c4d-8761-cfb03f7f00a1 tempest-VolumesListTestJSON-64306112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42653eb3-2bdc-44c9-af17-d1221b290d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d84efb5-9a18-48ea-81b2-e9dce5176d3d', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:45 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7ddc2d34-347b-4c4d-8761-cfb03f7f00a1 tempest-VolumesListTestJSON-64306112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f04e697-7f6a-40c9-8027-99c528fcad96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:45 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-7ddc2d34-347b-4c4d-8761-cfb03f7f00a1 tempest-VolumesListTestJSON-64306112 None] Volume volume-1d84efb5-9a18-48ea-81b2-e9dce5176d3d (1d84efb5-9a18-48ea-81b2-e9dce5176d3d): created successfully Nov 06 17:54:45 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7ddc2d34-347b-4c4d-8761-cfb03f7f00a1 tempest-VolumesListTestJSON-64306112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f04e697-7f6a-40c9-8027-99c528fcad96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:45 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7ddc2d34-347b-4c4d-8761-cfb03f7f00a1 tempest-VolumesListTestJSON-64306112 None] Flow 'volume_create_manager' (52a1126b-b2eb-4a74-9b8b-a5c9c1efbc52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:54:45 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-cc0f1691-840c-46d0-9cc0-edb419a24120 tempest-GroupsV314Test-2068083799 None] Creating offline snapshot b770d35d-30a4-4385-8c0a-bb0f878c68f7 of volume 7d4405c8-5d51-4485-9f50-bfc87a1c80ae {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 17:54:45 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-7ddc2d34-347b-4c4d-8761-cfb03f7f00a1 tempest-VolumesListTestJSON-64306112 None] Created volume successfully. Nov 06 17:54:45 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[690eea1d-d667-454b-9c85-4071f39f2371]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:54:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cc0f1691-840c-46d0-9cc0-edb419a24120 tempest-GroupsV314Test-2068083799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:45 devstack sudo[98231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae Nov 06 17:54:45 devstack sudo[98231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:45 devstack sudo[98231]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cc0f1691-840c-46d0-9cc0-edb419a24120 tempest-GroupsV314Test-2068083799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae" returned: 0 in 0.407s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cc0f1691-840c-46d0-9cc0-edb419a24120 tempest-GroupsV314Test-2068083799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae.b770d35d-30a4-4385-8c0a-bb0f878c68f7 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:45 devstack sudo[98236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae.b770d35d-30a4-4385-8c0a-bb0f878c68f7 1G Nov 06 17:54:45 devstack sudo[98236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:46 devstack sudo[98236]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cc0f1691-840c-46d0-9cc0-edb419a24120 tempest-GroupsV314Test-2068083799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae.b770d35d-30a4-4385-8c0a-bb0f878c68f7 1G" returned: 0 in 0.575s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cc0f1691-840c-46d0-9cc0-edb419a24120 tempest-GroupsV314Test-2068083799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae.b770d35d-30a4-4385-8c0a-bb0f878c68f7 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:46 devstack sudo[98241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae.b770d35d-30a4-4385-8c0a-bb0f878c68f7 Nov 06 17:54:46 devstack sudo[98241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:46 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e6c3c00-0880-48be-b622-328a7818678d tempest-VolumesCloneTest-458462499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:54:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2e6c3c00-0880-48be-b622-328a7818678d tempest-VolumesCloneTest-458462499 None] Flow 'volume_create_manager' (5d4aca6a-b0a8-4a8f-9dc4-e35495ed2487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:54:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2e6c3c00-0880-48be-b622-328a7818678d tempest-VolumesCloneTest-458462499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3c28851-a227-47ec-826f-c21e57834fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2e6c3c00-0880-48be-b622-328a7818678d tempest-VolumesCloneTest-458462499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3c28851-a227-47ec-826f-c21e57834fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1631196117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc346ae0-61f9-44b5-aab2-ce79d931f8c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a37a939d26084875befd3a6642e7114a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:54:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:54:47Z,use_quota=True,user_id='2de44e96beca4f5bb4f595d1724f2462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2e6c3c00-0880-48be-b622-328a7818678d tempest-VolumesCloneTest-458462499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abe4f615-ed87-4ac4-8b35-096303a741ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2e6c3c00-0880-48be-b622-328a7818678d tempest-VolumesCloneTest-458462499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abe4f615-ed87-4ac4-8b35-096303a741ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2e6c3c00-0880-48be-b622-328a7818678d tempest-VolumesCloneTest-458462499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4dde2dc-6571-4fa9-a0dc-a88bef17e059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2e6c3c00-0880-48be-b622-328a7818678d tempest-VolumesCloneTest-458462499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4dde2dc-6571-4fa9-a0dc-a88bef17e059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc346ae0-61f9-44b5-aab2-ce79d931f8c8', 'volume_name': 'volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2e6c3c00-0880-48be-b622-328a7818678d tempest-VolumesCloneTest-458462499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee79725c-7cbd-45a9-80d3-ece9ce916fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2e6c3c00-0880-48be-b622-328a7818678d tempest-VolumesCloneTest-458462499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee79725c-7cbd-45a9-80d3-ece9ce916fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2e6c3c00-0880-48be-b622-328a7818678d tempest-VolumesCloneTest-458462499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (303a1da5-451c-4446-b16b-db736f921e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:46 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-2e6c3c00-0880-48be-b622-328a7818678d tempest-VolumesCloneTest-458462499 None] Volume bc346ae0-61f9-44b5-aab2-ce79d931f8c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8', 'volume_size': 1} Nov 06 17:54:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2e6c3c00-0880-48be-b622-328a7818678d tempest-VolumesCloneTest-458462499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:54:46 devstack sudo[98241]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cc0f1691-840c-46d0-9cc0-edb419a24120 tempest-GroupsV314Test-2068083799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae.b770d35d-30a4-4385-8c0a-bb0f878c68f7" returned: 0 in 0.418s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:46 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-cc0f1691-840c-46d0-9cc0-edb419a24120 tempest-GroupsV314Test-2068083799 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae.b770d35d-30a4-4385-8c0a-bb0f878c68f7 is being set with open permissions: ugo+rw: NotImplementedError Nov 06 17:54:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cc0f1691-840c-46d0-9cc0-edb419a24120 tempest-GroupsV314Test-2068083799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae.b770d35d-30a4-4385-8c0a-bb0f878c68f7 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:46 devstack sudo[98248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae.b770d35d-30a4-4385-8c0a-bb0f878c68f7 Nov 06 17:54:46 devstack sudo[98248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:47 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-32a59337-22ee-494f-8a49-ccc8bbfa28a8 tempest-VolumesListTestJSON-64306112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:54:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-32a59337-22ee-494f-8a49-ccc8bbfa28a8 tempest-VolumesListTestJSON-64306112 None] Flow 'volume_create_manager' (594840bc-bade-4223-b6a1-cecb05da8e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:54:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-32a59337-22ee-494f-8a49-ccc8bbfa28a8 tempest-VolumesListTestJSON-64306112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e90c46e6-310f-4323-83e4-614539ea7c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-32a59337-22ee-494f-8a49-ccc8bbfa28a8 tempest-VolumesListTestJSON-64306112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e90c46e6-310f-4323-83e4-614539ea7c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:54:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-208955627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc0ae474-ee6d-4388-80bb-61debd767ce8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='673368b979b745df89ed705382690139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:54:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:54:47Z,use_quota=True,user_id='bab9bcb3d2fa4bef919dca979140385e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-32a59337-22ee-494f-8a49-ccc8bbfa28a8 tempest-VolumesListTestJSON-64306112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4f58716-f8e9-41ae-a416-8f978929da69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:47 devstack sudo[98248]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-32a59337-22ee-494f-8a49-ccc8bbfa28a8 tempest-VolumesListTestJSON-64306112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4f58716-f8e9-41ae-a416-8f978929da69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-32a59337-22ee-494f-8a49-ccc8bbfa28a8 tempest-VolumesListTestJSON-64306112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6b8ed40-e4e6-4f0e-b1ff-08dd24c9d461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-32a59337-22ee-494f-8a49-ccc8bbfa28a8 tempest-VolumesListTestJSON-64306112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6b8ed40-e4e6-4f0e-b1ff-08dd24c9d461) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc0ae474-ee6d-4388-80bb-61debd767ce8', 'volume_name': 'volume-dc0ae474-ee6d-4388-80bb-61debd767ce8', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-32a59337-22ee-494f-8a49-ccc8bbfa28a8 tempest-VolumesListTestJSON-64306112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6576f045-25b2-4cd6-a3ed-919313948b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-32a59337-22ee-494f-8a49-ccc8bbfa28a8 tempest-VolumesListTestJSON-64306112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6576f045-25b2-4cd6-a3ed-919313948b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:54:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-32a59337-22ee-494f-8a49-ccc8bbfa28a8 tempest-VolumesListTestJSON-64306112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (906a5264-3110-42b2-9a0d-3e7083a07eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:54:47 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-32a59337-22ee-494f-8a49-ccc8bbfa28a8 tempest-VolumesListTestJSON-64306112 None] Volume dc0ae474-ee6d-4388-80bb-61debd767ce8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc0ae474-ee6d-4388-80bb-61debd767ce8', 'volume_size': 1} Nov 06 17:54:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-32a59337-22ee-494f-8a49-ccc8bbfa28a8 tempest-VolumesListTestJSON-64306112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:54:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cc0f1691-840c-46d0-9cc0-edb419a24120 tempest-GroupsV314Test-2068083799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae.b770d35d-30a4-4385-8c0a-bb0f878c68f7" returned: 0 in 0.302s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cc0f1691-840c-46d0-9cc0-edb419a24120 tempest-GroupsV314Test-2068083799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:47 devstack sudo[98251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae.info Nov 06 17:54:47 devstack sudo[98251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:47 devstack sudo[98251]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cc0f1691-840c-46d0-9cc0-edb419a24120 tempest-GroupsV314Test-2068083799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae.info" returned: 0 in 0.323s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:47 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-cc0f1691-840c-46d0-9cc0-edb419a24120 tempest-GroupsV314Test-2068083799 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 17:54:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cc0f1691-840c-46d0-9cc0-edb419a24120 tempest-GroupsV314Test-2068083799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:47 devstack sudo[98254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae.info Nov 06 17:54:47 devstack sudo[98254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:47 devstack sudo[98254]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cc0f1691-840c-46d0-9cc0-edb419a24120 tempest-GroupsV314Test-2068083799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae.info" returned: 0 in 0.279s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cc0f1691-840c-46d0-9cc0-edb419a24120 tempest-GroupsV314Test-2068083799 None] Acquiring lock "cinder-quobyte-520bfdc5-778d-4f84-a5f0-c4268660435c" by "_copy_volume_from_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:54:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cc0f1691-840c-46d0-9cc0-edb419a24120 tempest-GroupsV314Test-2068083799 None] Lock "cinder-quobyte-520bfdc5-778d-4f84-a5f0-c4268660435c" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:54:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-cc0f1691-840c-46d0-9cc0-edb419a24120 tempest-GroupsV314Test-2068083799 None] snapshot: b770d35d-30a4-4385-8c0a-bb0f878c68f7, volume: 520bfdc5-778d-4f84-a5f0-c4268660435c, {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 17:54:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cc0f1691-840c-46d0-9cc0-edb419a24120 tempest-GroupsV314Test-2068083799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:54:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cc0f1691-840c-46d0-9cc0-edb419a24120 tempest-GroupsV314Test-2068083799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:54:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-cc0f1691-840c-46d0-9cc0-edb419a24120 tempest-GroupsV314Test-2068083799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:54:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-cc0f1691-840c-46d0-9cc0-edb419a24120 tempest-GroupsV314Test-2068083799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:54:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cc0f1691-840c-46d0-9cc0-edb419a24120 tempest-GroupsV314Test-2068083799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:54:47 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27abf9a-e8b8-4fdc-8687-336f7adb71a0]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:54:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cc0f1691-840c-46d0-9cc0-edb419a24120 tempest-GroupsV314Test-2068083799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae.b770d35d-30a4-4385-8c0a-bb0f878c68f7 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:48 devstack sudo[98257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae.b770d35d-30a4-4385-8c0a-bb0f878c68f7 Nov 06 17:54:48 devstack sudo[98257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:48 devstack sudo[98257]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cc0f1691-840c-46d0-9cc0-edb419a24120 tempest-GroupsV314Test-2068083799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae.b770d35d-30a4-4385-8c0a-bb0f878c68f7" returned: 0 in 0.408s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:48 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-cc0f1691-840c-46d0-9cc0-edb419a24120 tempest-GroupsV314Test-2068083799 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 17:54:48 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f80623-794b-4867-bb72-6fd2a6e209f0]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:54:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cc0f1691-840c-46d0-9cc0-edb419a24120 tempest-GroupsV314Test-2068083799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:48 devstack sudo[98298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae Nov 06 17:54:48 devstack sudo[98298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:48 devstack sudo[98298]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cc0f1691-840c-46d0-9cc0-edb419a24120 tempest-GroupsV314Test-2068083799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae" returned: 0 in 0.496s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:48 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-cc0f1691-840c-46d0-9cc0-edb419a24120 tempest-GroupsV314Test-2068083799 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 17:54:48 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-cc0f1691-840c-46d0-9cc0-edb419a24120 tempest-GroupsV314Test-2068083799 None] Creating direct copy from snapshot {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 17:54:48 devstack cinder-volume[87068]: DEBUG cinder.utils [None req-cc0f1691-840c-46d0-9cc0-edb419a24120 tempest-GroupsV314Test-2068083799 None] Path /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-520bfdc5-778d-4f84-a5f0-c4268660435c not found in is_blk_device check {{(pid=87068) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 17:54:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cc0f1691-840c-46d0-9cc0-edb419a24120 tempest-GroupsV314Test-2068083799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-520bfdc5-778d-4f84-a5f0-c4268660435c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:48 devstack sudo[98305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-520bfdc5-778d-4f84-a5f0-c4268660435c Nov 06 17:54:48 devstack sudo[98305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:54 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 17:54:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:54:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:54:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:54:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:54:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:54:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:54 devstack sudo[98327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:54:54 devstack sudo[98327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:54 devstack sudo[98327]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.468s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:54 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:54:54 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running periodic task VolumeManager._thread_info {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 17:54:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] thread count: 28 {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 17:54:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] thread info: [<_MainThread(MainThread, started 133940619505792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 17:54:56 devstack sudo[98305]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cc0f1691-840c-46d0-9cc0-edb419a24120 tempest-GroupsV314Test-2068083799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-520bfdc5-778d-4f84-a5f0-c4268660435c" returned: 0 in 7.947s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:56 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-cc0f1691-840c-46d0-9cc0-edb419a24120 tempest-GroupsV314Test-2068083799 None] Image conversion details: src /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae, size 1024.00 MB, duration 7.95 sec, destination /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-520bfdc5-778d-4f84-a5f0-c4268660435c {{(pid=87068) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 17:54:56 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-cc0f1691-840c-46d0-9cc0-edb419a24120 tempest-GroupsV314Test-2068083799 None] Converted 1024.00 MB image at 128.84 MB/s Nov 06 17:54:56 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-cc0f1691-840c-46d0-9cc0-edb419a24120 tempest-GroupsV314Test-2068083799 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-520bfdc5-778d-4f84-a5f0-c4268660435c is being set with open permissions: ugo+rw: NotImplementedError Nov 06 17:54:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cc0f1691-840c-46d0-9cc0-edb419a24120 tempest-GroupsV314Test-2068083799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-520bfdc5-778d-4f84-a5f0-c4268660435c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:56 devstack sudo[98330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-520bfdc5-778d-4f84-a5f0-c4268660435c Nov 06 17:54:56 devstack sudo[98330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:57 devstack sudo[98330]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cc0f1691-840c-46d0-9cc0-edb419a24120 tempest-GroupsV314Test-2068083799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-520bfdc5-778d-4f84-a5f0-c4268660435c" returned: 0 in 0.248s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cc0f1691-840c-46d0-9cc0-edb419a24120 tempest-GroupsV314Test-2068083799 None] Lock "cinder-quobyte-520bfdc5-778d-4f84-a5f0-c4268660435c" released by "_copy_volume_from_snapshot" :: held 9.196s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:54:57 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=13,cinder:UPDATE=5,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 17:54:59 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cc0f1691-840c-46d0-9cc0-edb419a24120 tempest-GroupsV314Test-2068083799 None] Acquiring lock "cinder-quobyte-b770d35d-30a4-4385-8c0a-bb0f878c68f7" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:54:59 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cc0f1691-840c-46d0-9cc0-edb419a24120 tempest-GroupsV314Test-2068083799 None] Lock "cinder-quobyte-b770d35d-30a4-4385-8c0a-bb0f878c68f7" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:54:59 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-cc0f1691-840c-46d0-9cc0-edb419a24120 tempest-GroupsV314Test-2068083799 None] Deleting offline snapshot b770d35d-30a4-4385-8c0a-bb0f878c68f7 of volume 7d4405c8-5d51-4485-9f50-bfc87a1c80ae {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 17:54:59 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-cc0f1691-840c-46d0-9cc0-edb419a24120 tempest-GroupsV314Test-2068083799 None] snapshot_file for this snap is: volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae.b770d35d-30a4-4385-8c0a-bb0f878c68f7 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 17:54:59 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c09841-54ec-463a-80b6-c2051828c668]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:54:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cc0f1691-840c-46d0-9cc0-edb419a24120 tempest-GroupsV314Test-2068083799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae.b770d35d-30a4-4385-8c0a-bb0f878c68f7 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:59 devstack sudo[98334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae.b770d35d-30a4-4385-8c0a-bb0f878c68f7 Nov 06 17:54:59 devstack sudo[98334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:54:59 devstack sudo[98334]: pam_unix(sudo:session): session closed for user root Nov 06 17:54:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cc0f1691-840c-46d0-9cc0-edb419a24120 tempest-GroupsV314Test-2068083799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae.b770d35d-30a4-4385-8c0a-bb0f878c68f7" returned: 0 in 0.379s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:54:59 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-cc0f1691-840c-46d0-9cc0-edb419a24120 tempest-GroupsV314Test-2068083799 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 17:54:59 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6b29e4-ca35-4f07-89dd-48c8f8663ef4]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:54:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cc0f1691-840c-46d0-9cc0-edb419a24120 tempest-GroupsV314Test-2068083799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:54:59 devstack sudo[98339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae Nov 06 17:54:59 devstack sudo[98339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:00 devstack sudo[98339]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cc0f1691-840c-46d0-9cc0-edb419a24120 tempest-GroupsV314Test-2068083799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae" returned: 0 in 0.605s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cc0f1691-840c-46d0-9cc0-edb419a24120 tempest-GroupsV314Test-2068083799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae.b770d35d-30a4-4385-8c0a-bb0f878c68f7 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:00 devstack sudo[98344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae.b770d35d-30a4-4385-8c0a-bb0f878c68f7 Nov 06 17:55:00 devstack sudo[98344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:00 devstack sudo[98344]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cc0f1691-840c-46d0-9cc0-edb419a24120 tempest-GroupsV314Test-2068083799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae.b770d35d-30a4-4385-8c0a-bb0f878c68f7" returned: 0 in 0.367s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cc0f1691-840c-46d0-9cc0-edb419a24120 tempest-GroupsV314Test-2068083799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae.b770d35d-30a4-4385-8c0a-bb0f878c68f7 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:00 devstack sudo[98351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae.b770d35d-30a4-4385-8c0a-bb0f878c68f7 Nov 06 17:55:00 devstack sudo[98351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:00 devstack sudo[98351]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cc0f1691-840c-46d0-9cc0-edb419a24120 tempest-GroupsV314Test-2068083799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae.b770d35d-30a4-4385-8c0a-bb0f878c68f7" returned: 0 in 0.280s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:00 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cc0f1691-840c-46d0-9cc0-edb419a24120 tempest-GroupsV314Test-2068083799 None] Lock "cinder-quobyte-b770d35d-30a4-4385-8c0a-bb0f878c68f7" released by "_delete_snapshot" :: held 1.736s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:55:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cc0f1691-840c-46d0-9cc0-edb419a24120 tempest-GroupsV314Test-2068083799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.570s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:55:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2e6c3c00-0880-48be-b622-328a7818678d tempest-VolumesCloneTest-458462499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.257s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:55:00 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2e6c3c00-0880-48be-b622-328a7818678d tempest-VolumesCloneTest-458462499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1631196117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc346ae0-61f9-44b5-aab2-ce79d931f8c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a37a939d26084875befd3a6642e7114a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:54:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:54:47Z,use_quota=True,user_id='2de44e96beca4f5bb4f595d1724f2462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:55:00 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-2e6c3c00-0880-48be-b622-328a7818678d tempest-VolumesCloneTest-458462499 None] Creating volume bc346ae0-61f9-44b5-aab2-ce79d931f8c8 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:55:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2e6c3c00-0880-48be-b622-328a7818678d tempest-VolumesCloneTest-458462499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:55:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2e6c3c00-0880-48be-b622-328a7818678d tempest-VolumesCloneTest-458462499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:55:00 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2e6c3c00-0880-48be-b622-328a7818678d tempest-VolumesCloneTest-458462499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:55:00 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2e6c3c00-0880-48be-b622-328a7818678d tempest-VolumesCloneTest-458462499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:55:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2e6c3c00-0880-48be-b622-328a7818678d tempest-VolumesCloneTest-458462499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:55:00 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2e6c3c00-0880-48be-b622-328a7818678d tempest-VolumesCloneTest-458462499 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:55:00 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-2e6c3c00-0880-48be-b622-328a7818678d tempest-VolumesCloneTest-458462499 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:55:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2e6c3c00-0880-48be-b622-328a7818678d tempest-VolumesCloneTest-458462499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:00 devstack sudo[98354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8 1073741824 Nov 06 17:55:00 devstack sudo[98354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:01 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-cc0f1691-840c-46d0-9cc0-edb419a24120 tempest-GroupsV314Test-2068083799 None] Create group from source-group-548eace4-42dc-4252-8cec-e2696b190d15 completed successfully. Nov 06 17:55:01 devstack sudo[98354]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2e6c3c00-0880-48be-b622-328a7818678d tempest-VolumesCloneTest-458462499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8 1073741824" returned: 0 in 0.523s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2e6c3c00-0880-48be-b622-328a7818678d tempest-VolumesCloneTest-458462499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:01 devstack sudo[98364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8 Nov 06 17:55:01 devstack sudo[98364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:01 devstack sudo[98364]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2e6c3c00-0880-48be-b622-328a7818678d tempest-VolumesCloneTest-458462499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8" returned: 0 in 0.293s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2e6c3c00-0880-48be-b622-328a7818678d tempest-VolumesCloneTest-458462499 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:55:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2e6c3c00-0880-48be-b622-328a7818678d tempest-VolumesCloneTest-458462499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:55:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-32a59337-22ee-494f-8a49-ccc8bbfa28a8 tempest-VolumesListTestJSON-64306112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.660s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:55:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-32a59337-22ee-494f-8a49-ccc8bbfa28a8 tempest-VolumesListTestJSON-64306112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:54:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-208955627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc0ae474-ee6d-4388-80bb-61debd767ce8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='673368b979b745df89ed705382690139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:54:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:54:47Z,use_quota=True,user_id='bab9bcb3d2fa4bef919dca979140385e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:55:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-32a59337-22ee-494f-8a49-ccc8bbfa28a8 tempest-VolumesListTestJSON-64306112 None] Creating volume dc0ae474-ee6d-4388-80bb-61debd767ce8 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:55:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-32a59337-22ee-494f-8a49-ccc8bbfa28a8 tempest-VolumesListTestJSON-64306112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:55:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-32a59337-22ee-494f-8a49-ccc8bbfa28a8 tempest-VolumesListTestJSON-64306112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:55:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-32a59337-22ee-494f-8a49-ccc8bbfa28a8 tempest-VolumesListTestJSON-64306112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:55:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-32a59337-22ee-494f-8a49-ccc8bbfa28a8 tempest-VolumesListTestJSON-64306112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:55:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-32a59337-22ee-494f-8a49-ccc8bbfa28a8 tempest-VolumesListTestJSON-64306112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:55:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-32a59337-22ee-494f-8a49-ccc8bbfa28a8 tempest-VolumesListTestJSON-64306112 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:55:01 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-32a59337-22ee-494f-8a49-ccc8bbfa28a8 tempest-VolumesListTestJSON-64306112 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:55:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-32a59337-22ee-494f-8a49-ccc8bbfa28a8 tempest-VolumesListTestJSON-64306112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-dc0ae474-ee6d-4388-80bb-61debd767ce8 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2e6c3c00-0880-48be-b622-328a7818678d tempest-VolumesCloneTest-458462499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (303a1da5-451c-4446-b16b-db736f921e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:55:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2e6c3c00-0880-48be-b622-328a7818678d tempest-VolumesCloneTest-458462499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2286d66-634b-4b4b-802c-44c83296149b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:55:01 devstack sudo[98367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-dc0ae474-ee6d-4388-80bb-61debd767ce8 1073741824 Nov 06 17:55:01 devstack sudo[98367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:01 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-2e6c3c00-0880-48be-b622-328a7818678d tempest-VolumesCloneTest-458462499 None] Volume volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8 (bc346ae0-61f9-44b5-aab2-ce79d931f8c8): created successfully Nov 06 17:55:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2e6c3c00-0880-48be-b622-328a7818678d tempest-VolumesCloneTest-458462499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2286d66-634b-4b4b-802c-44c83296149b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:55:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2e6c3c00-0880-48be-b622-328a7818678d tempest-VolumesCloneTest-458462499 None] Flow 'volume_create_manager' (5d4aca6a-b0a8-4a8f-9dc4-e35495ed2487) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:55:01 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-2e6c3c00-0880-48be-b622-328a7818678d tempest-VolumesCloneTest-458462499 None] Created volume successfully. Nov 06 17:55:01 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-362715b0-ed96-4f51-be23-a22cf6f6fe19 tempest-GroupsV314Test-2068083799 None] Acquiring lock "cinder-quobyte-520bfdc5-778d-4f84-a5f0-c4268660435c" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:55:01 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-362715b0-ed96-4f51-be23-a22cf6f6fe19 tempest-GroupsV314Test-2068083799 None] Lock "cinder-quobyte-520bfdc5-778d-4f84-a5f0-c4268660435c" acquired by "delete_volume" :: waited 0.017s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:55:02 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[034eb339-6dee-4df8-8ac5-094efdb3a6c5]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:55:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-362715b0-ed96-4f51-be23-a22cf6f6fe19 tempest-GroupsV314Test-2068083799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-520bfdc5-778d-4f84-a5f0-c4268660435c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:02 devstack sudo[98369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-520bfdc5-778d-4f84-a5f0-c4268660435c Nov 06 17:55:02 devstack sudo[98369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:02 devstack sudo[98367]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-32a59337-22ee-494f-8a49-ccc8bbfa28a8 tempest-VolumesListTestJSON-64306112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-dc0ae474-ee6d-4388-80bb-61debd767ce8 1073741824" returned: 0 in 0.539s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-32a59337-22ee-494f-8a49-ccc8bbfa28a8 tempest-VolumesListTestJSON-64306112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-dc0ae474-ee6d-4388-80bb-61debd767ce8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:02 devstack sudo[98369]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:02 devstack sudo[98379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-dc0ae474-ee6d-4388-80bb-61debd767ce8 Nov 06 17:55:02 devstack sudo[98379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-362715b0-ed96-4f51-be23-a22cf6f6fe19 tempest-GroupsV314Test-2068083799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-520bfdc5-778d-4f84-a5f0-c4268660435c" returned: 0 in 0.418s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-362715b0-ed96-4f51-be23-a22cf6f6fe19 tempest-GroupsV314Test-2068083799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-520bfdc5-778d-4f84-a5f0-c4268660435c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:02 devstack sudo[98381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-520bfdc5-778d-4f84-a5f0-c4268660435c Nov 06 17:55:02 devstack sudo[98381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:02 devstack sudo[98379]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-32a59337-22ee-494f-8a49-ccc8bbfa28a8 tempest-VolumesListTestJSON-64306112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-dc0ae474-ee6d-4388-80bb-61debd767ce8" returned: 0 in 0.274s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:02 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-32a59337-22ee-494f-8a49-ccc8bbfa28a8 tempest-VolumesListTestJSON-64306112 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:55:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-32a59337-22ee-494f-8a49-ccc8bbfa28a8 tempest-VolumesListTestJSON-64306112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:55:02 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-32a59337-22ee-494f-8a49-ccc8bbfa28a8 tempest-VolumesListTestJSON-64306112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (906a5264-3110-42b2-9a0d-3e7083a07eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc0ae474-ee6d-4388-80bb-61debd767ce8', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:55:02 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-32a59337-22ee-494f-8a49-ccc8bbfa28a8 tempest-VolumesListTestJSON-64306112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97c5c359-a6cb-4b6a-abfd-8b672bfb92be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:55:02 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-32a59337-22ee-494f-8a49-ccc8bbfa28a8 tempest-VolumesListTestJSON-64306112 None] Volume volume-dc0ae474-ee6d-4388-80bb-61debd767ce8 (dc0ae474-ee6d-4388-80bb-61debd767ce8): created successfully Nov 06 17:55:02 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-32a59337-22ee-494f-8a49-ccc8bbfa28a8 tempest-VolumesListTestJSON-64306112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97c5c359-a6cb-4b6a-abfd-8b672bfb92be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:55:02 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-32a59337-22ee-494f-8a49-ccc8bbfa28a8 tempest-VolumesListTestJSON-64306112 None] Flow 'volume_create_manager' (594840bc-bade-4223-b6a1-cecb05da8e2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:55:02 devstack sudo[98381]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-362715b0-ed96-4f51-be23-a22cf6f6fe19 tempest-GroupsV314Test-2068083799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-520bfdc5-778d-4f84-a5f0-c4268660435c" returned: 0 in 0.311s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:02 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-32a59337-22ee-494f-8a49-ccc8bbfa28a8 tempest-VolumesListTestJSON-64306112 None] Created volume successfully. Nov 06 17:55:02 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-362715b0-ed96-4f51-be23-a22cf6f6fe19 tempest-GroupsV314Test-2068083799 None] Lock "cinder-quobyte-520bfdc5-778d-4f84-a5f0-c4268660435c" released by "delete_volume" :: held 0.792s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:55:02 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-362715b0-ed96-4f51-be23-a22cf6f6fe19 tempest-GroupsV314Test-2068083799 None] Created reservations ['8083de4b-f75b-422e-b3da-12ad57aaa788'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:55:02 devstack cinder-volume[87068]: WARNING cinder.quota [None req-362715b0-ed96-4f51-be23-a22cf6f6fe19 tempest-GroupsV314Test-2068083799 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1098177014 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1098177014, it is now deprecated. Please use the default quota class for default quota. Nov 06 17:55:02 devstack cinder-volume[87068]: WARNING cinder.quota [None req-362715b0-ed96-4f51-be23-a22cf6f6fe19 tempest-GroupsV314Test-2068083799 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1098177014 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1098177014, it is now deprecated. Please use the default quota class for default quota. Nov 06 17:55:02 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-362715b0-ed96-4f51-be23-a22cf6f6fe19 tempest-GroupsV314Test-2068083799 None] Created reservations ['4916e81c-8ebb-4d79-b391-e2feaf59897f', '4ccb91f7-f88b-4dab-970f-b4f15c50e2bf', 'ba2ca21a-5744-4f3f-8df9-835c31d732b9', 'b8d4c463-d094-4ba5-8fb1-179a1b22d0e7'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:55:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-362715b0-ed96-4f51-be23-a22cf6f6fe19 tempest-GroupsV314Test-2068083799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:55:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-362715b0-ed96-4f51-be23-a22cf6f6fe19 tempest-GroupsV314Test-2068083799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:55:03 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-362715b0-ed96-4f51-be23-a22cf6f6fe19 tempest-GroupsV314Test-2068083799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:55:03 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-362715b0-ed96-4f51-be23-a22cf6f6fe19 tempest-GroupsV314Test-2068083799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:55:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-362715b0-ed96-4f51-be23-a22cf6f6fe19 tempest-GroupsV314Test-2068083799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:55:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-362715b0-ed96-4f51-be23-a22cf6f6fe19 tempest-GroupsV314Test-2068083799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:03 devstack sudo[98385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:55:03 devstack sudo[98385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:03 devstack sudo[98385]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-362715b0-ed96-4f51-be23-a22cf6f6fe19 tempest-GroupsV314Test-2068083799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.274s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:03 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-362715b0-ed96-4f51-be23-a22cf6f6fe19 tempest-GroupsV314Test-2068083799 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:55:03 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-362715b0-ed96-4f51-be23-a22cf6f6fe19 tempest-GroupsV314Test-2068083799 None] Delete group completed successfully. Nov 06 17:55:03 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-936e7413-19bb-4549-9bba-7322080d8b79 tempest-GroupsV314Test-2068083799 None] Acquiring lock "cinder-quobyte-7d4405c8-5d51-4485-9f50-bfc87a1c80ae" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:55:03 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-936e7413-19bb-4549-9bba-7322080d8b79 tempest-GroupsV314Test-2068083799 None] Lock "cinder-quobyte-7d4405c8-5d51-4485-9f50-bfc87a1c80ae" acquired by "delete_volume" :: waited 0.021s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:55:03 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d243c219-9672-4de7-b34e-9dcb7b182b76]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:55:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-936e7413-19bb-4549-9bba-7322080d8b79 tempest-GroupsV314Test-2068083799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:03 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:55:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] Flow 'volume_create_manager' (8eb5081f-8b5e-4a4a-964b-7235a4f8d77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:55:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e69b1ca-117f-4653-94c4-79324606bbec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:55:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e69b1ca-117f-4653-94c4-79324606bbec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:55:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1199511149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3187a1b-4029-4ebe-ac49-4e767a0a38cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a37a939d26084875befd3a6642e7114a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:55:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=bc346ae0-61f9-44b5-aab2-ce79d931f8c8,status='creating',terminated_at=None,updated_at=2026-11-06T16:55:04Z,use_quota=True,user_id='2de44e96beca4f5bb4f595d1724f2462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:55:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3af94b4a-3ed3-49d7-9e79-17500cc652c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:55:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3af94b4a-3ed3-49d7-9e79-17500cc652c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:55:03 devstack sudo[98388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae Nov 06 17:55:03 devstack sudo[98388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (329137d2-05eb-4f57-a0e8-d271e5d91dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:55:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (329137d2-05eb-4f57-a0e8-d271e5d91dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e3187a1b-4029-4ebe-ac49-4e767a0a38cd', 'volume_name': 'volume-e3187a1b-4029-4ebe-ac49-4e767a0a38cd', 'volume_size': 2, 'source_volid': 'bc346ae0-61f9-44b5-aab2-ce79d931f8c8', 'source_volstatus': 'available'}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:55:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e699cdb8-01be-4be5-b1b9-c7e44318f110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:55:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e699cdb8-01be-4be5-b1b9-c7e44318f110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:55:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5aa4e2d-1fca-4683-80f8-6e194ce6fefa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:55:03 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] Volume e3187a1b-4029-4ebe-ac49-4e767a0a38cd: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e3187a1b-4029-4ebe-ac49-4e767a0a38cd', 'volume_size': 2, 'source_volid': 'bc346ae0-61f9-44b5-aab2-ce79d931f8c8', 'source_volstatus': 'available'} Nov 06 17:55:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:55:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:55:03 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] Cloning volume bc346ae0-61f9-44b5-aab2-ce79d931f8c8 to volume e3187a1b-4029-4ebe-ac49-4e767a0a38cd Nov 06 17:55:04 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] Creating offline snapshot d2ac0b2f-586b-4366-8e4d-155aa779fa70 of volume bc346ae0-61f9-44b5-aab2-ce79d931f8c8 {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 17:55:04 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a60cfa-e60e-4b9f-b07e-830e0223cf1e]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:55:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:04 devstack sudo[98390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8 Nov 06 17:55:04 devstack sudo[98390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:04 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-393bf27d-1604-4fa4-93d2-ccd6ccb746de tempest-VolumesListTestJSON-64306112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:55:04 devstack sudo[98388]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-393bf27d-1604-4fa4-93d2-ccd6ccb746de tempest-VolumesListTestJSON-64306112 None] Flow 'volume_create_manager' (622de638-2cb2-4da1-a17b-d240e17e3834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:55:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-393bf27d-1604-4fa4-93d2-ccd6ccb746de tempest-VolumesListTestJSON-64306112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6dc9bed-adfd-4eb5-aff0-bd2ec8079d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:55:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-936e7413-19bb-4549-9bba-7322080d8b79 tempest-GroupsV314Test-2068083799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae" returned: 0 in 0.675s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-936e7413-19bb-4549-9bba-7322080d8b79 tempest-GroupsV314Test-2068083799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-393bf27d-1604-4fa4-93d2-ccd6ccb746de tempest-VolumesListTestJSON-64306112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6dc9bed-adfd-4eb5-aff0-bd2ec8079d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-690906841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91a4a618-2274-4c81-af52-d5e2dfc2ebf9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='673368b979b745df89ed705382690139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:55:04Z,use_quota=True,user_id='bab9bcb3d2fa4bef919dca979140385e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:55:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-393bf27d-1604-4fa4-93d2-ccd6ccb746de tempest-VolumesListTestJSON-64306112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (025755d7-8828-4001-9a98-0e2ce52312aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:55:04 devstack sudo[98395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae Nov 06 17:55:04 devstack sudo[98395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-393bf27d-1604-4fa4-93d2-ccd6ccb746de tempest-VolumesListTestJSON-64306112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (025755d7-8828-4001-9a98-0e2ce52312aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:55:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-393bf27d-1604-4fa4-93d2-ccd6ccb746de tempest-VolumesListTestJSON-64306112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (311e6d44-43e1-4a5d-9643-dd6c5e36b51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:55:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-393bf27d-1604-4fa4-93d2-ccd6ccb746de tempest-VolumesListTestJSON-64306112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (311e6d44-43e1-4a5d-9643-dd6c5e36b51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91a4a618-2274-4c81-af52-d5e2dfc2ebf9', 'volume_name': 'volume-91a4a618-2274-4c81-af52-d5e2dfc2ebf9', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:55:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-393bf27d-1604-4fa4-93d2-ccd6ccb746de tempest-VolumesListTestJSON-64306112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1ed7db1-a9a3-4584-aedc-32bb15d7c0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:55:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-393bf27d-1604-4fa4-93d2-ccd6ccb746de tempest-VolumesListTestJSON-64306112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1ed7db1-a9a3-4584-aedc-32bb15d7c0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:55:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-393bf27d-1604-4fa4-93d2-ccd6ccb746de tempest-VolumesListTestJSON-64306112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7318dd3-f598-4123-8712-327ade96e569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:55:04 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-393bf27d-1604-4fa4-93d2-ccd6ccb746de tempest-VolumesListTestJSON-64306112 None] Volume 91a4a618-2274-4c81-af52-d5e2dfc2ebf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91a4a618-2274-4c81-af52-d5e2dfc2ebf9', 'volume_size': 1} Nov 06 17:55:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-393bf27d-1604-4fa4-93d2-ccd6ccb746de tempest-VolumesListTestJSON-64306112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:55:04 devstack sudo[98390]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8" returned: 0 in 0.474s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8.d2ac0b2f-586b-4366-8e4d-155aa779fa70 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:04 devstack sudo[98401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8.d2ac0b2f-586b-4366-8e4d-155aa779fa70 1G Nov 06 17:55:04 devstack sudo[98401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:04 devstack sudo[98395]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-936e7413-19bb-4549-9bba-7322080d8b79 tempest-GroupsV314Test-2068083799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7d4405c8-5d51-4485-9f50-bfc87a1c80ae" returned: 0 in 0.310s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:04 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-936e7413-19bb-4549-9bba-7322080d8b79 tempest-GroupsV314Test-2068083799 None] Lock "cinder-quobyte-7d4405c8-5d51-4485-9f50-bfc87a1c80ae" released by "delete_volume" :: held 1.092s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:55:04 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-936e7413-19bb-4549-9bba-7322080d8b79 tempest-GroupsV314Test-2068083799 None] Created reservations ['d0854697-7475-4b51-b158-1c70fc8ba71d'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:55:04 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-936e7413-19bb-4549-9bba-7322080d8b79 tempest-GroupsV314Test-2068083799 None] Created reservations ['0a701490-e0ff-4531-ac3f-cd795eaebd0f', '016c0f3a-2f32-4d26-8318-6b4cde8a1e05', '3c0bb446-6ae1-4081-986f-6196a37bea06', 'e3390a81-e9d3-4365-a808-034fe0059c2f'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:55:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-936e7413-19bb-4549-9bba-7322080d8b79 tempest-GroupsV314Test-2068083799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:55:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-936e7413-19bb-4549-9bba-7322080d8b79 tempest-GroupsV314Test-2068083799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:55:04 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-936e7413-19bb-4549-9bba-7322080d8b79 tempest-GroupsV314Test-2068083799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:55:04 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-936e7413-19bb-4549-9bba-7322080d8b79 tempest-GroupsV314Test-2068083799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:55:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-936e7413-19bb-4549-9bba-7322080d8b79 tempest-GroupsV314Test-2068083799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:55:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-936e7413-19bb-4549-9bba-7322080d8b79 tempest-GroupsV314Test-2068083799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:04 devstack sudo[98407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:55:04 devstack sudo[98407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:05 devstack sudo[98401]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8.d2ac0b2f-586b-4366-8e4d-155aa779fa70 1G" returned: 0 in 0.548s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8.d2ac0b2f-586b-4366-8e4d-155aa779fa70 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:05 devstack sudo[98409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8.d2ac0b2f-586b-4366-8e4d-155aa779fa70 Nov 06 17:55:05 devstack sudo[98409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:05 devstack sudo[98407]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-936e7413-19bb-4549-9bba-7322080d8b79 tempest-GroupsV314Test-2068083799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.297s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:05 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-936e7413-19bb-4549-9bba-7322080d8b79 tempest-GroupsV314Test-2068083799 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:55:05 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-936e7413-19bb-4549-9bba-7322080d8b79 tempest-GroupsV314Test-2068083799 None] Delete group completed successfully. Nov 06 17:55:05 devstack sudo[98409]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8.d2ac0b2f-586b-4366-8e4d-155aa779fa70" returned: 0 in 0.371s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:05 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8.d2ac0b2f-586b-4366-8e4d-155aa779fa70 is being set with open permissions: ugo+rw Nov 06 17:55:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8.d2ac0b2f-586b-4366-8e4d-155aa779fa70 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:05 devstack sudo[98415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8.d2ac0b2f-586b-4366-8e4d-155aa779fa70 Nov 06 17:55:05 devstack sudo[98415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:05 devstack sudo[98415]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8.d2ac0b2f-586b-4366-8e4d-155aa779fa70" returned: 0 in 0.282s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:05 devstack sudo[98418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8.info Nov 06 17:55:05 devstack sudo[98418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:06 devstack sudo[98418]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8.info" returned: 0 in 0.275s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:06 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8.info is being set with open permissions: ugo+rw Nov 06 17:55:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:06 devstack sudo[98421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8.info Nov 06 17:55:06 devstack sudo[98421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:06 devstack sudo[98421]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8.info" returned: 0 in 0.312s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:06 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] Acquiring lock "cinder-quobyte-e3187a1b-4029-4ebe-ac49-4e767a0a38cd" by "_copy_volume_from_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:55:06 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] Lock "cinder-quobyte-e3187a1b-4029-4ebe-ac49-4e767a0a38cd" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:55:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] snapshot: d2ac0b2f-586b-4366-8e4d-155aa779fa70, volume: e3187a1b-4029-4ebe-ac49-4e767a0a38cd, {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 17:55:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:55:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:55:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:55:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:55:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:55:06 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7eb493-5d31-4877-824e-5586450c1639]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:55:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8.d2ac0b2f-586b-4366-8e4d-155aa779fa70 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:06 devstack sudo[98424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8.d2ac0b2f-586b-4366-8e4d-155aa779fa70 Nov 06 17:55:06 devstack sudo[98424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:06 devstack sudo[98424]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8.d2ac0b2f-586b-4366-8e4d-155aa779fa70" returned: 0 in 0.452s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 17:55:06 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[9165f2f8-7637-4325-9005-6319dcb04149]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:55:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:07 devstack sudo[98429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8 Nov 06 17:55:07 devstack sudo[98429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:07 devstack sudo[98429]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8" returned: 0 in 0.522s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:07 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8 {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 17:55:07 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] Creating direct copy from snapshot {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 17:55:07 devstack cinder-volume[87068]: DEBUG cinder.utils [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] Path /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3187a1b-4029-4ebe-ac49-4e767a0a38cd not found in is_blk_device check {{(pid=87068) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 17:55:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3187a1b-4029-4ebe-ac49-4e767a0a38cd {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:07 devstack sudo[98435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3187a1b-4029-4ebe-ac49-4e767a0a38cd Nov 06 17:55:07 devstack sudo[98435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:15 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:UPDATE=28,cinder:SELECT=31,cinder:DELETE=1,cinder:INSERT=5 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 17:55:15 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:INSERT=17,cinder:UPDATE=63,cinder:SELECT=43,cinder:DELETE=4 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 17:55:16 devstack sudo[98435]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3187a1b-4029-4ebe-ac49-4e767a0a38cd" returned: 0 in 9.127s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:16 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] Image conversion details: src /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8, size 1024.00 MB, duration 9.13 sec, destination /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3187a1b-4029-4ebe-ac49-4e767a0a38cd {{(pid=87068) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 17:55:16 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] Converted 1024.00 MB image at 112.18 MB/s Nov 06 17:55:16 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3187a1b-4029-4ebe-ac49-4e767a0a38cd is being set with open permissions: ugo+rw Nov 06 17:55:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3187a1b-4029-4ebe-ac49-4e767a0a38cd {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:16 devstack sudo[98865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3187a1b-4029-4ebe-ac49-4e767a0a38cd Nov 06 17:55:16 devstack sudo[98865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:16 devstack sudo[98865]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3187a1b-4029-4ebe-ac49-4e767a0a38cd" returned: 0 in 0.288s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:16 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] Lock "cinder-quobyte-e3187a1b-4029-4ebe-ac49-4e767a0a38cd" released by "_copy_volume_from_snapshot" :: held 10.507s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:55:16 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] Acquiring lock "cinder-quobyte-d2ac0b2f-586b-4366-8e4d-155aa779fa70" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:55:16 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] Lock "cinder-quobyte-d2ac0b2f-586b-4366-8e4d-155aa779fa70" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:55:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] Deleting offline snapshot d2ac0b2f-586b-4366-8e4d-155aa779fa70 of volume bc346ae0-61f9-44b5-aab2-ce79d931f8c8 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 17:55:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] snapshot_file for this snap is: volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8.d2ac0b2f-586b-4366-8e4d-155aa779fa70 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 17:55:17 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b5d74a-2eca-4976-811b-e39f79fd70dd]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:55:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8.d2ac0b2f-586b-4366-8e4d-155aa779fa70 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:17 devstack sudo[98868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8.d2ac0b2f-586b-4366-8e4d-155aa779fa70 Nov 06 17:55:17 devstack sudo[98868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:17 devstack sudo[98868]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8.d2ac0b2f-586b-4366-8e4d-155aa779fa70" returned: 0 in 0.441s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 17:55:17 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c33178-faf9-428b-ac6b-ac603e71ae92]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:55:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:17 devstack sudo[98873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8 Nov 06 17:55:17 devstack sudo[98873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:18 devstack sudo[98873]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8" returned: 0 in 0.618s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8.d2ac0b2f-586b-4366-8e4d-155aa779fa70 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:18 devstack sudo[98878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8.d2ac0b2f-586b-4366-8e4d-155aa779fa70 Nov 06 17:55:18 devstack sudo[98878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:18 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-84d109f6-4103-4797-af24-7a88d1e85e2f tempest-TestInstancesWithCinderVolumes-1921145433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:55:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-84d109f6-4103-4797-af24-7a88d1e85e2f tempest-TestInstancesWithCinderVolumes-1921145433 None] Flow 'volume_create_manager' (f6768d4f-db63-47c8-ab20-bc470020b89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:55:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-84d109f6-4103-4797-af24-7a88d1e85e2f tempest-TestInstancesWithCinderVolumes-1921145433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ccc7583-044b-4d84-8897-f539fa708254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:55:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-84d109f6-4103-4797-af24-7a88d1e85e2f tempest-TestInstancesWithCinderVolumes-1921145433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ccc7583-044b-4d84-8897-f539fa708254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:55:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1598161752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=629b05cd-98a5-4d26-a9e1-64b94c3e9a69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc6bed60bc7f4146a54ebab32ac68cff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:55:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:55:18Z,use_quota=True,user_id='d3f2aaa3c75d42bb8597109df3f5e4dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8d16145-0e44-400c-9edc-e7415965505f),volume_type_id=e8d16145-0e44-400c-9edc-e7415965505f)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:55:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-84d109f6-4103-4797-af24-7a88d1e85e2f tempest-TestInstancesWithCinderVolumes-1921145433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f38bc662-dc07-4957-897b-be6d99444efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:55:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-84d109f6-4103-4797-af24-7a88d1e85e2f tempest-TestInstancesWithCinderVolumes-1921145433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f38bc662-dc07-4957-897b-be6d99444efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:55:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-84d109f6-4103-4797-af24-7a88d1e85e2f tempest-TestInstancesWithCinderVolumes-1921145433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da2b19ec-1b67-4cad-9f38-1b5971f8323e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:55:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-84d109f6-4103-4797-af24-7a88d1e85e2f tempest-TestInstancesWithCinderVolumes-1921145433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da2b19ec-1b67-4cad-9f38-1b5971f8323e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '629b05cd-98a5-4d26-a9e1-64b94c3e9a69', 'volume_name': 'volume-629b05cd-98a5-4d26-a9e1-64b94c3e9a69', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:55:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-84d109f6-4103-4797-af24-7a88d1e85e2f tempest-TestInstancesWithCinderVolumes-1921145433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c6d581b-f7c3-45a8-88e8-fecef4062341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:55:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-84d109f6-4103-4797-af24-7a88d1e85e2f tempest-TestInstancesWithCinderVolumes-1921145433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c6d581b-f7c3-45a8-88e8-fecef4062341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:55:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-84d109f6-4103-4797-af24-7a88d1e85e2f tempest-TestInstancesWithCinderVolumes-1921145433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d04e525-afa4-4164-96e1-c71be241d33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:55:18 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-84d109f6-4103-4797-af24-7a88d1e85e2f tempest-TestInstancesWithCinderVolumes-1921145433 None] Volume 629b05cd-98a5-4d26-a9e1-64b94c3e9a69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-629b05cd-98a5-4d26-a9e1-64b94c3e9a69', 'volume_size': 1} Nov 06 17:55:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-84d109f6-4103-4797-af24-7a88d1e85e2f tempest-TestInstancesWithCinderVolumes-1921145433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:55:18 devstack sudo[98878]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8.d2ac0b2f-586b-4366-8e4d-155aa779fa70" returned: 0 in 0.465s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8.d2ac0b2f-586b-4366-8e4d-155aa779fa70 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:18 devstack sudo[98883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8.d2ac0b2f-586b-4366-8e4d-155aa779fa70 Nov 06 17:55:18 devstack sudo[98883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:18 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a93b11d-bd0a-4801-9407-160fac790b3e tempest-TestInstancesWithCinderVolumes-1921145433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:55:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5a93b11d-bd0a-4801-9407-160fac790b3e tempest-TestInstancesWithCinderVolumes-1921145433 None] Flow 'volume_create_manager' (122aaec8-55d8-4b31-b0ec-294f96632e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:55:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5a93b11d-bd0a-4801-9407-160fac790b3e tempest-TestInstancesWithCinderVolumes-1921145433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c22e258c-2fa5-4509-8d0a-2e6343b6dce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:55:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5a93b11d-bd0a-4801-9407-160fac790b3e tempest-TestInstancesWithCinderVolumes-1921145433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c22e258c-2fa5-4509-8d0a-2e6343b6dce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:55:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-882963231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7b1b28a-23b2-4790-a6d8-ed28e51c5c00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc6bed60bc7f4146a54ebab32ac68cff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:55:19Z,use_quota=True,user_id='d3f2aaa3c75d42bb8597109df3f5e4dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54bc238b-5f01-41c9-b44f-19a185b861bf),volume_type_id=54bc238b-5f01-41c9-b44f-19a185b861bf)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:55:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5a93b11d-bd0a-4801-9407-160fac790b3e tempest-TestInstancesWithCinderVolumes-1921145433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7472b13b-2400-4976-aedf-0cc04fd09a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:55:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5a93b11d-bd0a-4801-9407-160fac790b3e tempest-TestInstancesWithCinderVolumes-1921145433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7472b13b-2400-4976-aedf-0cc04fd09a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:55:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5a93b11d-bd0a-4801-9407-160fac790b3e tempest-TestInstancesWithCinderVolumes-1921145433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbf52796-4242-4c70-92f7-f3e66b54009f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:55:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5a93b11d-bd0a-4801-9407-160fac790b3e tempest-TestInstancesWithCinderVolumes-1921145433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbf52796-4242-4c70-92f7-f3e66b54009f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7b1b28a-23b2-4790-a6d8-ed28e51c5c00', 'volume_name': 'volume-f7b1b28a-23b2-4790-a6d8-ed28e51c5c00', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:55:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5a93b11d-bd0a-4801-9407-160fac790b3e tempest-TestInstancesWithCinderVolumes-1921145433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c8f683a-5056-43d7-8921-d672cdb1994e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:55:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5a93b11d-bd0a-4801-9407-160fac790b3e tempest-TestInstancesWithCinderVolumes-1921145433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c8f683a-5056-43d7-8921-d672cdb1994e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:55:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5a93b11d-bd0a-4801-9407-160fac790b3e tempest-TestInstancesWithCinderVolumes-1921145433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e809dae0-cac2-45bf-a825-ebc558b134f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:55:18 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-5a93b11d-bd0a-4801-9407-160fac790b3e tempest-TestInstancesWithCinderVolumes-1921145433 None] Volume f7b1b28a-23b2-4790-a6d8-ed28e51c5c00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7b1b28a-23b2-4790-a6d8-ed28e51c5c00', 'volume_size': 1} Nov 06 17:55:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5a93b11d-bd0a-4801-9407-160fac790b3e tempest-TestInstancesWithCinderVolumes-1921145433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:55:18 devstack sudo[98883]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8.d2ac0b2f-586b-4366-8e4d-155aa779fa70" returned: 0 in 0.286s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:18 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] Lock "cinder-quobyte-d2ac0b2f-586b-4366-8e4d-155aa779fa70" released by "_delete_snapshot" :: held 1.964s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:55:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.028s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:55:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-393bf27d-1604-4fa4-93d2-ccd6ccb746de tempest-VolumesListTestJSON-64306112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.589s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:55:19 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-393bf27d-1604-4fa4-93d2-ccd6ccb746de tempest-VolumesListTestJSON-64306112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-690906841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91a4a618-2274-4c81-af52-d5e2dfc2ebf9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='673368b979b745df89ed705382690139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:55:04Z,use_quota=True,user_id='bab9bcb3d2fa4bef919dca979140385e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:55:19 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-393bf27d-1604-4fa4-93d2-ccd6ccb746de tempest-VolumesListTestJSON-64306112 None] Creating volume 91a4a618-2274-4c81-af52-d5e2dfc2ebf9 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:55:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-393bf27d-1604-4fa4-93d2-ccd6ccb746de tempest-VolumesListTestJSON-64306112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:55:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-393bf27d-1604-4fa4-93d2-ccd6ccb746de tempest-VolumesListTestJSON-64306112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:55:19 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-393bf27d-1604-4fa4-93d2-ccd6ccb746de tempest-VolumesListTestJSON-64306112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:55:19 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-393bf27d-1604-4fa4-93d2-ccd6ccb746de tempest-VolumesListTestJSON-64306112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:55:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-393bf27d-1604-4fa4-93d2-ccd6ccb746de tempest-VolumesListTestJSON-64306112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:55:19 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-393bf27d-1604-4fa4-93d2-ccd6ccb746de tempest-VolumesListTestJSON-64306112 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:55:19 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-393bf27d-1604-4fa4-93d2-ccd6ccb746de tempest-VolumesListTestJSON-64306112 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:55:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-393bf27d-1604-4fa4-93d2-ccd6ccb746de tempest-VolumesListTestJSON-64306112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-91a4a618-2274-4c81-af52-d5e2dfc2ebf9 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:19 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-0e4a1385-3fff-4163-b7e2-314ddb10cfca tempest-GroupsV320Test-341948875 None] Group tempest-GroupsV320Test-Group-249247078: creating Nov 06 17:55:19 devstack sudo[98886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-91a4a618-2274-4c81-af52-d5e2dfc2ebf9 1073741824 Nov 06 17:55:19 devstack sudo[98886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:19 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5aa4e2d-1fca-4683-80f8-6e194ce6fefa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3187a1b-4029-4ebe-ac49-4e767a0a38cd', 'volume_size': 2, 'source_volid': 'bc346ae0-61f9-44b5-aab2-ce79d931f8c8', 'source_volstatus': 'available'}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:55:19 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e68508b7-4ced-4f9e-9ded-d9592ee4797e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:55:19 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] Volume volume-e3187a1b-4029-4ebe-ac49-4e767a0a38cd (e3187a1b-4029-4ebe-ac49-4e767a0a38cd): created successfully Nov 06 17:55:19 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e68508b7-4ced-4f9e-9ded-d9592ee4797e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:55:19 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] Flow 'volume_create_manager' (8eb5081f-8b5e-4a4a-964b-7235a4f8d77b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:55:19 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-0e4a1385-3fff-4163-b7e2-314ddb10cfca tempest-GroupsV320Test-341948875 None] Group tempest-GroupsV320Test-Group-249247078: created successfully Nov 06 17:55:19 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-0e4a1385-3fff-4163-b7e2-314ddb10cfca tempest-GroupsV320Test-341948875 None] Create group completed successfully. Nov 06 17:55:19 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-c834e2e7-c473-44a2-b9cb-ef1557445c44 tempest-VolumesCloneTest-458462499 None] Created volume successfully. Nov 06 17:55:19 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:55:19 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] Flow 'volume_create_manager' (20e519ce-ad12-4a7f-95da-a9d43c5ec3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:55:19 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed957812-7c27-40a5-b7b8-c8529c12fa4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:55:19 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed957812-7c27-40a5-b7b8-c8529c12fa4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1350701315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb615f18-3857-432d-9177-ff47aa9eb95f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc6bed60bc7f4146a54ebab32ac68cff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:55:19Z,use_quota=True,user_id='d3f2aaa3c75d42bb8597109df3f5e4dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d239727-6829-40d2-971c-9899c9140613),volume_type_id=2d239727-6829-40d2-971c-9899c9140613)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:55:19 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bded1d70-0ead-46a8-9082-fde43bce3370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:55:19 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bded1d70-0ead-46a8-9082-fde43bce3370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:55:19 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfb922e2-1db6-4034-821a-64d40b188172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:55:19 devstack cinder-volume[87068]: DEBUG cinder.image.glance [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] Creating Keystone auth plugin from conf {{(pid=87068) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 17:55:19 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-06517cce-726c-4159-8b1f-b7ddb4abf439 tempest-VolumesCloneTest-458462499 None] Acquiring lock "cinder-e3187a1b-4029-4ebe-ac49-4e767a0a38cd-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:55:19 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-06517cce-726c-4159-8b1f-b7ddb4abf439 tempest-VolumesCloneTest-458462499 None] Lock "cinder-e3187a1b-4029-4ebe-ac49-4e767a0a38cd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:55:19 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-06517cce-726c-4159-8b1f-b7ddb4abf439 tempest-VolumesCloneTest-458462499 None] Acquiring lock "cinder-quobyte-e3187a1b-4029-4ebe-ac49-4e767a0a38cd" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:55:19 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-06517cce-726c-4159-8b1f-b7ddb4abf439 tempest-VolumesCloneTest-458462499 None] Lock "cinder-quobyte-e3187a1b-4029-4ebe-ac49-4e767a0a38cd" acquired by "delete_volume" :: waited 0.024s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:55:19 devstack sudo[98886]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-393bf27d-1604-4fa4-93d2-ccd6ccb746de tempest-VolumesListTestJSON-64306112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-91a4a618-2274-4c81-af52-d5e2dfc2ebf9 1073741824" returned: 0 in 0.657s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:19 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2403e395-83b4-4d24-b9ec-dee748718f4b]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:55:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-06517cce-726c-4159-8b1f-b7ddb4abf439 tempest-VolumesCloneTest-458462499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3187a1b-4029-4ebe-ac49-4e767a0a38cd {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-393bf27d-1604-4fa4-93d2-ccd6ccb746de tempest-VolumesListTestJSON-64306112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-91a4a618-2274-4c81-af52-d5e2dfc2ebf9 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:19 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfb922e2-1db6-4034-821a-64d40b188172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cb615f18-3857-432d-9177-ff47aa9eb95f', 'volume_name': 'volume-cb615f18-3857-432d-9177-ff47aa9eb95f', 'volume_size': 1, 'image_id': '986aa466-ec7c-4cde-9722-0e2c7ffc1908', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/986aa466-ec7c-4cde-9722-0e2c7ffc1908', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--569701219', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bc6bed60bc7f4146a54ebab32ac68cff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '986aa466-ec7c-4cde-9722-0e2c7ffc1908', 'created_at': datetime.datetime(2026, 11, 6, 16, 55, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 16, 55, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/986aa466-ec7c-4cde-9722-0e2c7ffc1908/file', 'properties': {}}, 'image_service': }' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:55:19 devstack sudo[98893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-91a4a618-2274-4c81-af52-d5e2dfc2ebf9 Nov 06 17:55:19 devstack sudo[98893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:19 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6eae04a-953c-45e7-8418-65e11f91b489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:55:19 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6eae04a-953c-45e7-8418-65e11f91b489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:55:19 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c2f0306-6df8-4371-ae49-09bc8e917046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:55:19 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] Volume cb615f18-3857-432d-9177-ff47aa9eb95f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cb615f18-3857-432d-9177-ff47aa9eb95f', 'volume_size': 1, 'image_id': '986aa466-ec7c-4cde-9722-0e2c7ffc1908', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/986aa466-ec7c-4cde-9722-0e2c7ffc1908', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--569701219', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bc6bed60bc7f4146a54ebab32ac68cff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '986aa466-ec7c-4cde-9722-0e2c7ffc1908', 'created_at': datetime.datetime(2026, 11, 6, 16, 55, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 16, 55, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/986aa466-ec7c-4cde-9722-0e2c7ffc1908/file', 'properties': {}}, 'image_service': } Nov 06 17:55:19 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] Trying to clone cb615f18-3857-432d-9177-ff47aa9eb95f from image 986aa466-ec7c-4cde-9722-0e2c7ffc1908 at location (None, [{'url': 'file:///opt/stack/data/glance/images/986aa466-ec7c-4cde-9722-0e2c7ffc1908', 'metadata': {}}]). {{(pid=87068) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 17:55:19 devstack sudo[98892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3187a1b-4029-4ebe-ac49-4e767a0a38cd Nov 06 17:55:19 devstack sudo[98892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:20 devstack sudo[98893]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-393bf27d-1604-4fa4-93d2-ccd6ccb746de tempest-VolumesListTestJSON-64306112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-91a4a618-2274-4c81-af52-d5e2dfc2ebf9" returned: 0 in 0.270s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-393bf27d-1604-4fa4-93d2-ccd6ccb746de tempest-VolumesListTestJSON-64306112 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:55:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-393bf27d-1604-4fa4-93d2-ccd6ccb746de tempest-VolumesListTestJSON-64306112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:55:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-84d109f6-4103-4797-af24-7a88d1e85e2f tempest-TestInstancesWithCinderVolumes-1921145433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.618s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:55:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-84d109f6-4103-4797-af24-7a88d1e85e2f tempest-TestInstancesWithCinderVolumes-1921145433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:55:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1598161752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=629b05cd-98a5-4d26-a9e1-64b94c3e9a69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc6bed60bc7f4146a54ebab32ac68cff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:55:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:55:18Z,use_quota=True,user_id='d3f2aaa3c75d42bb8597109df3f5e4dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8d16145-0e44-400c-9edc-e7415965505f),volume_type_id=e8d16145-0e44-400c-9edc-e7415965505f)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:55:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-84d109f6-4103-4797-af24-7a88d1e85e2f tempest-TestInstancesWithCinderVolumes-1921145433 None] Creating volume 629b05cd-98a5-4d26-a9e1-64b94c3e9a69 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:55:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-84d109f6-4103-4797-af24-7a88d1e85e2f tempest-TestInstancesWithCinderVolumes-1921145433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:55:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-84d109f6-4103-4797-af24-7a88d1e85e2f tempest-TestInstancesWithCinderVolumes-1921145433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:55:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-84d109f6-4103-4797-af24-7a88d1e85e2f tempest-TestInstancesWithCinderVolumes-1921145433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:55:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-84d109f6-4103-4797-af24-7a88d1e85e2f tempest-TestInstancesWithCinderVolumes-1921145433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:55:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-84d109f6-4103-4797-af24-7a88d1e85e2f tempest-TestInstancesWithCinderVolumes-1921145433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:55:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-84d109f6-4103-4797-af24-7a88d1e85e2f tempest-TestInstancesWithCinderVolumes-1921145433 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:55:20 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-84d109f6-4103-4797-af24-7a88d1e85e2f tempest-TestInstancesWithCinderVolumes-1921145433 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:55:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-84d109f6-4103-4797-af24-7a88d1e85e2f tempest-TestInstancesWithCinderVolumes-1921145433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-629b05cd-98a5-4d26-a9e1-64b94c3e9a69 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:20 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-393bf27d-1604-4fa4-93d2-ccd6ccb746de tempest-VolumesListTestJSON-64306112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7318dd3-f598-4123-8712-327ade96e569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91a4a618-2274-4c81-af52-d5e2dfc2ebf9', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:55:20 devstack sudo[98899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-629b05cd-98a5-4d26-a9e1-64b94c3e9a69 1073741824 Nov 06 17:55:20 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-393bf27d-1604-4fa4-93d2-ccd6ccb746de tempest-VolumesListTestJSON-64306112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5e3ceb4-fcbc-4656-9c37-9fbcda52ffc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:55:20 devstack sudo[98899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:20 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-393bf27d-1604-4fa4-93d2-ccd6ccb746de tempest-VolumesListTestJSON-64306112 None] Volume volume-91a4a618-2274-4c81-af52-d5e2dfc2ebf9 (91a4a618-2274-4c81-af52-d5e2dfc2ebf9): created successfully Nov 06 17:55:20 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-393bf27d-1604-4fa4-93d2-ccd6ccb746de tempest-VolumesListTestJSON-64306112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5e3ceb4-fcbc-4656-9c37-9fbcda52ffc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:55:20 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-393bf27d-1604-4fa4-93d2-ccd6ccb746de tempest-VolumesListTestJSON-64306112 None] Flow 'volume_create_manager' (622de638-2cb2-4da1-a17b-d240e17e3834) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:55:20 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-393bf27d-1604-4fa4-93d2-ccd6ccb746de tempest-VolumesListTestJSON-64306112 None] Created volume successfully. Nov 06 17:55:20 devstack sudo[98892]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-06517cce-726c-4159-8b1f-b7ddb4abf439 tempest-VolumesCloneTest-458462499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3187a1b-4029-4ebe-ac49-4e767a0a38cd" returned: 0 in 0.442s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-06517cce-726c-4159-8b1f-b7ddb4abf439 tempest-VolumesCloneTest-458462499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3187a1b-4029-4ebe-ac49-4e767a0a38cd {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:20 devstack sudo[98902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3187a1b-4029-4ebe-ac49-4e767a0a38cd Nov 06 17:55:20 devstack sudo[98902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:20 devstack sudo[98902]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-06517cce-726c-4159-8b1f-b7ddb4abf439 tempest-VolumesCloneTest-458462499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3187a1b-4029-4ebe-ac49-4e767a0a38cd" returned: 0 in 0.303s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:20 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-06517cce-726c-4159-8b1f-b7ddb4abf439 tempest-VolumesCloneTest-458462499 None] Lock "cinder-quobyte-e3187a1b-4029-4ebe-ac49-4e767a0a38cd" released by "delete_volume" :: held 0.799s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:55:20 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-06517cce-726c-4159-8b1f-b7ddb4abf439 tempest-VolumesCloneTest-458462499 None] Created reservations ['055f1f4e-7727-4b8d-9837-2e6c8453ae11', 'c77773ef-e6e5-4abd-a832-324f38f5d8e0', '9ef5a8ac-048f-4385-bc76-4a0d0e7c86f6', 'ae6f3d21-61bf-47c0-9ae0-b5e1bba58963'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:55:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-06517cce-726c-4159-8b1f-b7ddb4abf439 tempest-VolumesCloneTest-458462499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:55:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-06517cce-726c-4159-8b1f-b7ddb4abf439 tempest-VolumesCloneTest-458462499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:55:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-06517cce-726c-4159-8b1f-b7ddb4abf439 tempest-VolumesCloneTest-458462499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:55:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-06517cce-726c-4159-8b1f-b7ddb4abf439 tempest-VolumesCloneTest-458462499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:55:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-06517cce-726c-4159-8b1f-b7ddb4abf439 tempest-VolumesCloneTest-458462499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:55:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-06517cce-726c-4159-8b1f-b7ddb4abf439 tempest-VolumesCloneTest-458462499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:20 devstack sudo[98899]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-84d109f6-4103-4797-af24-7a88d1e85e2f tempest-TestInstancesWithCinderVolumes-1921145433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-629b05cd-98a5-4d26-a9e1-64b94c3e9a69 1073741824" returned: 0 in 0.631s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:20 devstack sudo[98911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:55:20 devstack sudo[98911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-84d109f6-4103-4797-af24-7a88d1e85e2f tempest-TestInstancesWithCinderVolumes-1921145433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-629b05cd-98a5-4d26-a9e1-64b94c3e9a69 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:20 devstack sudo[98913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-629b05cd-98a5-4d26-a9e1-64b94c3e9a69 Nov 06 17:55:20 devstack sudo[98913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:20 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-fe492c57-90bb-4a2d-acc0-91a479e508e8 tempest-GroupsV320Test-341948875 None] Created reservations ['be41ed6d-c3eb-4250-a04a-e0793c4f3298'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:55:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fe492c57-90bb-4a2d-acc0-91a479e508e8 tempest-GroupsV320Test-341948875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:55:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fe492c57-90bb-4a2d-acc0-91a479e508e8 tempest-GroupsV320Test-341948875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:55:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fe492c57-90bb-4a2d-acc0-91a479e508e8 tempest-GroupsV320Test-341948875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:55:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fe492c57-90bb-4a2d-acc0-91a479e508e8 tempest-GroupsV320Test-341948875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:55:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fe492c57-90bb-4a2d-acc0-91a479e508e8 tempest-GroupsV320Test-341948875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:55:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fe492c57-90bb-4a2d-acc0-91a479e508e8 tempest-GroupsV320Test-341948875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:20 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1ca4920a-15d0-445a-bb05-c4c5536ca7f8 tempest-VolumesCloneTest-458462499 None] Acquiring lock "cinder-bc346ae0-61f9-44b5-aab2-ce79d931f8c8-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:55:20 devstack sudo[98915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:55:20 devstack sudo[98915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:20 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1ca4920a-15d0-445a-bb05-c4c5536ca7f8 tempest-VolumesCloneTest-458462499 None] Lock "cinder-bc346ae0-61f9-44b5-aab2-ce79d931f8c8-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:55:21 devstack sudo[98911]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1ca4920a-15d0-445a-bb05-c4c5536ca7f8 tempest-VolumesCloneTest-458462499 None] Acquiring lock "cinder-quobyte-bc346ae0-61f9-44b5-aab2-ce79d931f8c8" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:55:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-06517cce-726c-4159-8b1f-b7ddb4abf439 tempest-VolumesCloneTest-458462499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.372s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:21 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-06517cce-726c-4159-8b1f-b7ddb4abf439 tempest-VolumesCloneTest-458462499 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:55:21 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-06517cce-726c-4159-8b1f-b7ddb4abf439 tempest-VolumesCloneTest-458462499 None] Deleted volume successfully. Nov 06 17:55:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1ca4920a-15d0-445a-bb05-c4c5536ca7f8 tempest-VolumesCloneTest-458462499 None] Lock "cinder-quobyte-bc346ae0-61f9-44b5-aab2-ce79d931f8c8" acquired by "delete_volume" :: waited 0.030s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:55:21 devstack sudo[98913]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-06517cce-726c-4159-8b1f-b7ddb4abf439 tempest-VolumesCloneTest-458462499 None] Lock "cinder-e3187a1b-4029-4ebe-ac49-4e767a0a38cd-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:55:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-84d109f6-4103-4797-af24-7a88d1e85e2f tempest-TestInstancesWithCinderVolumes-1921145433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-629b05cd-98a5-4d26-a9e1-64b94c3e9a69" returned: 0 in 0.349s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:21 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-84d109f6-4103-4797-af24-7a88d1e85e2f tempest-TestInstancesWithCinderVolumes-1921145433 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:55:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-84d109f6-4103-4797-af24-7a88d1e85e2f tempest-TestInstancesWithCinderVolumes-1921145433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:55:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5a93b11d-bd0a-4801-9407-160fac790b3e tempest-TestInstancesWithCinderVolumes-1921145433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.326s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:55:21 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5a93b11d-bd0a-4801-9407-160fac790b3e tempest-TestInstancesWithCinderVolumes-1921145433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:55:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-882963231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7b1b28a-23b2-4790-a6d8-ed28e51c5c00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc6bed60bc7f4146a54ebab32ac68cff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:55:19Z,use_quota=True,user_id='d3f2aaa3c75d42bb8597109df3f5e4dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54bc238b-5f01-41c9-b44f-19a185b861bf),volume_type_id=54bc238b-5f01-41c9-b44f-19a185b861bf)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:55:21 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-5a93b11d-bd0a-4801-9407-160fac790b3e tempest-TestInstancesWithCinderVolumes-1921145433 None] Creating volume f7b1b28a-23b2-4790-a6d8-ed28e51c5c00 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:55:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5a93b11d-bd0a-4801-9407-160fac790b3e tempest-TestInstancesWithCinderVolumes-1921145433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:55:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5a93b11d-bd0a-4801-9407-160fac790b3e tempest-TestInstancesWithCinderVolumes-1921145433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:55:21 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5a93b11d-bd0a-4801-9407-160fac790b3e tempest-TestInstancesWithCinderVolumes-1921145433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:55:21 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5a93b11d-bd0a-4801-9407-160fac790b3e tempest-TestInstancesWithCinderVolumes-1921145433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:55:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5a93b11d-bd0a-4801-9407-160fac790b3e tempest-TestInstancesWithCinderVolumes-1921145433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:55:21 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5a93b11d-bd0a-4801-9407-160fac790b3e tempest-TestInstancesWithCinderVolumes-1921145433 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:55:21 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-5a93b11d-bd0a-4801-9407-160fac790b3e tempest-TestInstancesWithCinderVolumes-1921145433 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:55:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5a93b11d-bd0a-4801-9407-160fac790b3e tempest-TestInstancesWithCinderVolumes-1921145433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f7b1b28a-23b2-4790-a6d8-ed28e51c5c00 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:21 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9c739b-7859-453b-9dcf-b579c6eb7b2d]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:55:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1ca4920a-15d0-445a-bb05-c4c5536ca7f8 tempest-VolumesCloneTest-458462499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:21 devstack sudo[98919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f7b1b28a-23b2-4790-a6d8-ed28e51c5c00 1073741824 Nov 06 17:55:21 devstack sudo[98919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:21 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-84d109f6-4103-4797-af24-7a88d1e85e2f tempest-TestInstancesWithCinderVolumes-1921145433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d04e525-afa4-4164-96e1-c71be241d33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-629b05cd-98a5-4d26-a9e1-64b94c3e9a69', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:55:21 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-84d109f6-4103-4797-af24-7a88d1e85e2f tempest-TestInstancesWithCinderVolumes-1921145433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e76936a-3368-4fc8-bc6c-20ac8660d0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:55:21 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-84d109f6-4103-4797-af24-7a88d1e85e2f tempest-TestInstancesWithCinderVolumes-1921145433 None] Volume volume-629b05cd-98a5-4d26-a9e1-64b94c3e9a69 (629b05cd-98a5-4d26-a9e1-64b94c3e9a69): created successfully Nov 06 17:55:21 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-84d109f6-4103-4797-af24-7a88d1e85e2f tempest-TestInstancesWithCinderVolumes-1921145433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e76936a-3368-4fc8-bc6c-20ac8660d0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:55:21 devstack sudo[98915]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:21 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-84d109f6-4103-4797-af24-7a88d1e85e2f tempest-TestInstancesWithCinderVolumes-1921145433 None] Flow 'volume_create_manager' (f6768d4f-db63-47c8-ab20-bc470020b89f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:55:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fe492c57-90bb-4a2d-acc0-91a479e508e8 tempest-GroupsV320Test-341948875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.339s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:21 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-fe492c57-90bb-4a2d-acc0-91a479e508e8 tempest-GroupsV320Test-341948875 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:55:21 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-fe492c57-90bb-4a2d-acc0-91a479e508e8 tempest-GroupsV320Test-341948875 None] Delete group completed successfully. Nov 06 17:55:21 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-84d109f6-4103-4797-af24-7a88d1e85e2f tempest-TestInstancesWithCinderVolumes-1921145433 None] Created volume successfully. Nov 06 17:55:21 devstack sudo[98920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8 Nov 06 17:55:21 devstack sudo[98920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:21 devstack sudo[98919]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5a93b11d-bd0a-4801-9407-160fac790b3e tempest-TestInstancesWithCinderVolumes-1921145433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f7b1b28a-23b2-4790-a6d8-ed28e51c5c00 1073741824" returned: 0 in 0.565s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:21 devstack sudo[98920]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1ca4920a-15d0-445a-bb05-c4c5536ca7f8 tempest-VolumesCloneTest-458462499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8" returned: 0 in 0.552s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1ca4920a-15d0-445a-bb05-c4c5536ca7f8 tempest-VolumesCloneTest-458462499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:21 devstack sudo[98931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8 Nov 06 17:55:21 devstack sudo[98931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5a93b11d-bd0a-4801-9407-160fac790b3e tempest-TestInstancesWithCinderVolumes-1921145433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f7b1b28a-23b2-4790-a6d8-ed28e51c5c00 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:21 devstack sudo[98933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f7b1b28a-23b2-4790-a6d8-ed28e51c5c00 Nov 06 17:55:21 devstack sudo[98933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:22 devstack sudo[98931]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1ca4920a-15d0-445a-bb05-c4c5536ca7f8 tempest-VolumesCloneTest-458462499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-bc346ae0-61f9-44b5-aab2-ce79d931f8c8" returned: 0 in 0.402s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:22 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1ca4920a-15d0-445a-bb05-c4c5536ca7f8 tempest-VolumesCloneTest-458462499 None] Lock "cinder-quobyte-bc346ae0-61f9-44b5-aab2-ce79d931f8c8" released by "delete_volume" :: held 1.088s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:55:22 devstack sudo[98933]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5a93b11d-bd0a-4801-9407-160fac790b3e tempest-TestInstancesWithCinderVolumes-1921145433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f7b1b28a-23b2-4790-a6d8-ed28e51c5c00" returned: 0 in 0.390s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:22 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5a93b11d-bd0a-4801-9407-160fac790b3e tempest-TestInstancesWithCinderVolumes-1921145433 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:55:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5a93b11d-bd0a-4801-9407-160fac790b3e tempest-TestInstancesWithCinderVolumes-1921145433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:55:22 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5a93b11d-bd0a-4801-9407-160fac790b3e tempest-TestInstancesWithCinderVolumes-1921145433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e809dae0-cac2-45bf-a825-ebc558b134f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7b1b28a-23b2-4790-a6d8-ed28e51c5c00', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:55:22 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5a93b11d-bd0a-4801-9407-160fac790b3e tempest-TestInstancesWithCinderVolumes-1921145433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7192108-994f-4774-b1bf-d3d02bffb616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:55:22 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-5a93b11d-bd0a-4801-9407-160fac790b3e tempest-TestInstancesWithCinderVolumes-1921145433 None] Volume volume-f7b1b28a-23b2-4790-a6d8-ed28e51c5c00 (f7b1b28a-23b2-4790-a6d8-ed28e51c5c00): created successfully Nov 06 17:55:22 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5a93b11d-bd0a-4801-9407-160fac790b3e tempest-TestInstancesWithCinderVolumes-1921145433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7192108-994f-4774-b1bf-d3d02bffb616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:55:22 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5a93b11d-bd0a-4801-9407-160fac790b3e tempest-TestInstancesWithCinderVolumes-1921145433 None] Flow 'volume_create_manager' (122aaec8-55d8-4b31-b0ec-294f96632e0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:55:22 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-1ca4920a-15d0-445a-bb05-c4c5536ca7f8 tempest-VolumesCloneTest-458462499 None] Created reservations ['db2287d7-e180-4518-9a88-2ed8bedf65bb', 'dd94778e-a9c5-4467-ba57-76ea9ceb586f', '135654de-8013-499f-9993-d78d144a33a3', '5d639fb4-424e-49c6-abac-eacbf73832e6'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:55:22 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-5a93b11d-bd0a-4801-9407-160fac790b3e tempest-TestInstancesWithCinderVolumes-1921145433 None] Created volume successfully. Nov 06 17:55:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1ca4920a-15d0-445a-bb05-c4c5536ca7f8 tempest-VolumesCloneTest-458462499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:55:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1ca4920a-15d0-445a-bb05-c4c5536ca7f8 tempest-VolumesCloneTest-458462499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:55:22 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1ca4920a-15d0-445a-bb05-c4c5536ca7f8 tempest-VolumesCloneTest-458462499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:55:22 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1ca4920a-15d0-445a-bb05-c4c5536ca7f8 tempest-VolumesCloneTest-458462499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:55:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1ca4920a-15d0-445a-bb05-c4c5536ca7f8 tempest-VolumesCloneTest-458462499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:55:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1ca4920a-15d0-445a-bb05-c4c5536ca7f8 tempest-VolumesCloneTest-458462499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:22 devstack sudo[98937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:55:22 devstack sudo[98937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:22 devstack sudo[98937]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1ca4920a-15d0-445a-bb05-c4c5536ca7f8 tempest-VolumesCloneTest-458462499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.291s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:22 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-1ca4920a-15d0-445a-bb05-c4c5536ca7f8 tempest-VolumesCloneTest-458462499 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:55:22 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-1ca4920a-15d0-445a-bb05-c4c5536ca7f8 tempest-VolumesCloneTest-458462499 None] Deleted volume successfully. Nov 06 17:55:22 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1ca4920a-15d0-445a-bb05-c4c5536ca7f8 tempest-VolumesCloneTest-458462499 None] Lock "cinder-bc346ae0-61f9-44b5-aab2-ce79d931f8c8-delete_volume" released by "delete_volume" :: held 1.757s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:55:24 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-83784ca0-9ea3-44dc-b81c-f89263525be3 tempest-VolumesListTestJSON-64306112 None] Acquiring lock "cinder-91a4a618-2274-4c81-af52-d5e2dfc2ebf9-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:55:24 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-83784ca0-9ea3-44dc-b81c-f89263525be3 tempest-VolumesListTestJSON-64306112 None] Lock "cinder-91a4a618-2274-4c81-af52-d5e2dfc2ebf9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:55:24 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-83784ca0-9ea3-44dc-b81c-f89263525be3 tempest-VolumesListTestJSON-64306112 None] Acquiring lock "cinder-quobyte-91a4a618-2274-4c81-af52-d5e2dfc2ebf9" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:55:24 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-83784ca0-9ea3-44dc-b81c-f89263525be3 tempest-VolumesListTestJSON-64306112 None] Lock "cinder-quobyte-91a4a618-2274-4c81-af52-d5e2dfc2ebf9" acquired by "delete_volume" :: waited 0.018s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:55:24 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[9517ac34-c1aa-4ffa-a902-6fbb6192a5d8]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:55:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-83784ca0-9ea3-44dc-b81c-f89263525be3 tempest-VolumesListTestJSON-64306112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-91a4a618-2274-4c81-af52-d5e2dfc2ebf9 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:24 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_986aa466-ec7c-4cde-9722-0e2c7ffc1908_r25rrvzadevstack@QuobyteHD, size 20.69 MB, duration 5.04 sec {{(pid=87068) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 06 17:55:24 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] Image download 20.69 MB at 4.11 MB/s Nov 06 17:55:24 devstack sudo[98940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-91a4a618-2274-4c81-af52-d5e2dfc2ebf9 Nov 06 17:55:24 devstack sudo[98940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:24 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4376cd-3f6f-452f-a723-1fdf4eaf28e2]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:55:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_986aa466-ec7c-4cde-9722-0e2c7ffc1908_r25rrvzadevstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:25 devstack sudo[98942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_986aa466-ec7c-4cde-9722-0e2c7ffc1908_r25rrvzadevstack@QuobyteHD Nov 06 17:55:25 devstack sudo[98942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:25 devstack sudo[98940]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-83784ca0-9ea3-44dc-b81c-f89263525be3 tempest-VolumesListTestJSON-64306112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-91a4a618-2274-4c81-af52-d5e2dfc2ebf9" returned: 0 in 0.485s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-83784ca0-9ea3-44dc-b81c-f89263525be3 tempest-VolumesListTestJSON-64306112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-91a4a618-2274-4c81-af52-d5e2dfc2ebf9 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:25 devstack sudo[98947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-91a4a618-2274-4c81-af52-d5e2dfc2ebf9 Nov 06 17:55:25 devstack sudo[98947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:25 devstack sudo[98942]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_986aa466-ec7c-4cde-9722-0e2c7ffc1908_r25rrvzadevstack@QuobyteHD" returned: 0 in 0.413s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:25 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] Temporary image 986aa466-ec7c-4cde-9722-0e2c7ffc1908 is fetched for user d3f2aaa3c75d42bb8597109df3f5e4dc. {{(pid=87068) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 06 17:55:25 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[040ecab7-b494-4d78-98ef-eb5edea455d3]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:55:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_986aa466-ec7c-4cde-9722-0e2c7ffc1908_r25rrvzadevstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:25 devstack sudo[98947]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-83784ca0-9ea3-44dc-b81c-f89263525be3 tempest-VolumesListTestJSON-64306112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-91a4a618-2274-4c81-af52-d5e2dfc2ebf9" returned: 0 in 0.330s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:25 devstack sudo[98952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_986aa466-ec7c-4cde-9722-0e2c7ffc1908_r25rrvzadevstack@QuobyteHD Nov 06 17:55:25 devstack sudo[98952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:25 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-83784ca0-9ea3-44dc-b81c-f89263525be3 tempest-VolumesListTestJSON-64306112 None] Lock "cinder-quobyte-91a4a618-2274-4c81-af52-d5e2dfc2ebf9" released by "delete_volume" :: held 0.896s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:55:25 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-83784ca0-9ea3-44dc-b81c-f89263525be3 tempest-VolumesListTestJSON-64306112 None] Created reservations ['84e6fde9-4e13-479f-bc94-d07c796eb836', 'dec11687-7bc2-43fb-8154-b4f839f69e8e', '14a8ae04-a678-434e-a87d-0a854767fb84', '214dbe67-c1b2-43d5-813f-3337c3194466'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:55:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-83784ca0-9ea3-44dc-b81c-f89263525be3 tempest-VolumesListTestJSON-64306112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:55:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-83784ca0-9ea3-44dc-b81c-f89263525be3 tempest-VolumesListTestJSON-64306112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:55:25 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-83784ca0-9ea3-44dc-b81c-f89263525be3 tempest-VolumesListTestJSON-64306112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:55:25 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-83784ca0-9ea3-44dc-b81c-f89263525be3 tempest-VolumesListTestJSON-64306112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:55:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-83784ca0-9ea3-44dc-b81c-f89263525be3 tempest-VolumesListTestJSON-64306112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:55:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-83784ca0-9ea3-44dc-b81c-f89263525be3 tempest-VolumesListTestJSON-64306112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:25 devstack sudo[98955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:55:25 devstack sudo[98955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:25 devstack sudo[98952]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_986aa466-ec7c-4cde-9722-0e2c7ffc1908_r25rrvzadevstack@QuobyteHD" returned: 0 in 0.427s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:55:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:55:25 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1350701315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb615f18-3857-432d-9177-ff47aa9eb95f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc6bed60bc7f4146a54ebab32ac68cff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:55:19Z,use_quota=True,user_id='d3f2aaa3c75d42bb8597109df3f5e4dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d239727-6829-40d2-971c-9899c9140613),volume_type_id=2d239727-6829-40d2-971c-9899c9140613)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:55:25 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] Creating volume cb615f18-3857-432d-9177-ff47aa9eb95f {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:55:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:55:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:55:25 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:55:25 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:55:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:55:25 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:55:25 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:55:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-cb615f18-3857-432d-9177-ff47aa9eb95f 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:25 devstack sudo[98960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-cb615f18-3857-432d-9177-ff47aa9eb95f 1073741824 Nov 06 17:55:25 devstack sudo[98960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:25 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ec201d2f-4476-43ca-baa8-f38184f70a6f tempest-VolumesListTestJSON-64306112 None] Acquiring lock "cinder-dc0ae474-ee6d-4388-80bb-61debd767ce8-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:55:26 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ec201d2f-4476-43ca-baa8-f38184f70a6f tempest-VolumesListTestJSON-64306112 None] Lock "cinder-dc0ae474-ee6d-4388-80bb-61debd767ce8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:55:26 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ec201d2f-4476-43ca-baa8-f38184f70a6f tempest-VolumesListTestJSON-64306112 None] Acquiring lock "cinder-quobyte-dc0ae474-ee6d-4388-80bb-61debd767ce8" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:55:26 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ec201d2f-4476-43ca-baa8-f38184f70a6f tempest-VolumesListTestJSON-64306112 None] Lock "cinder-quobyte-dc0ae474-ee6d-4388-80bb-61debd767ce8" acquired by "delete_volume" :: waited 0.025s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:55:26 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb379113-d9d3-4075-bc31-1fcca73f8d1c]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:55:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ec201d2f-4476-43ca-baa8-f38184f70a6f tempest-VolumesListTestJSON-64306112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-dc0ae474-ee6d-4388-80bb-61debd767ce8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:26 devstack sudo[98955]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-83784ca0-9ea3-44dc-b81c-f89263525be3 tempest-VolumesListTestJSON-64306112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.401s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:26 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-83784ca0-9ea3-44dc-b81c-f89263525be3 tempest-VolumesListTestJSON-64306112 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:55:26 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-83784ca0-9ea3-44dc-b81c-f89263525be3 tempest-VolumesListTestJSON-64306112 None] Deleted volume successfully. Nov 06 17:55:26 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-83784ca0-9ea3-44dc-b81c-f89263525be3 tempest-VolumesListTestJSON-64306112 None] Lock "cinder-91a4a618-2274-4c81-af52-d5e2dfc2ebf9-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:55:26 devstack sudo[98963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-dc0ae474-ee6d-4388-80bb-61debd767ce8 Nov 06 17:55:26 devstack sudo[98963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:26 devstack sudo[98960]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-cb615f18-3857-432d-9177-ff47aa9eb95f 1073741824" returned: 0 in 0.629s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-cb615f18-3857-432d-9177-ff47aa9eb95f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:26 devstack sudo[98972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-cb615f18-3857-432d-9177-ff47aa9eb95f Nov 06 17:55:26 devstack sudo[98972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:26 devstack sudo[98963]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ec201d2f-4476-43ca-baa8-f38184f70a6f tempest-VolumesListTestJSON-64306112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-dc0ae474-ee6d-4388-80bb-61debd767ce8" returned: 0 in 0.474s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ec201d2f-4476-43ca-baa8-f38184f70a6f tempest-VolumesListTestJSON-64306112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-dc0ae474-ee6d-4388-80bb-61debd767ce8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:26 devstack sudo[98974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-dc0ae474-ee6d-4388-80bb-61debd767ce8 Nov 06 17:55:26 devstack sudo[98974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:26 devstack sudo[98972]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-cb615f18-3857-432d-9177-ff47aa9eb95f" returned: 0 in 0.340s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:26 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:55:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:55:26 devstack sudo[98974]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ec201d2f-4476-43ca-baa8-f38184f70a6f tempest-VolumesListTestJSON-64306112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-dc0ae474-ee6d-4388-80bb-61debd767ce8" returned: 0 in 0.310s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:26 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ec201d2f-4476-43ca-baa8-f38184f70a6f tempest-VolumesListTestJSON-64306112 None] Lock "cinder-quobyte-dc0ae474-ee6d-4388-80bb-61debd767ce8" released by "delete_volume" :: held 0.869s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:55:26 devstack cinder-volume[87068]: DEBUG cinder.volume.volume_utils [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] Attempting download of 986aa466-ec7c-4cde-9722-0e2c7ffc1908 ((None, [{'url': 'file:///opt/stack/data/glance/images/986aa466-ec7c-4cde-9722-0e2c7ffc1908', 'metadata': {}}])) to volume cb615f18-3857-432d-9177-ff47aa9eb95f. {{(pid=87068) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 17:55:27 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[666c0bc5-5716-4911-a6bb-124485db7191]: (4, 'raw') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:55:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_986aa466-ec7c-4cde-9722-0e2c7ffc1908_bfa19cgf {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:27 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-ec201d2f-4476-43ca-baa8-f38184f70a6f tempest-VolumesListTestJSON-64306112 None] Created reservations ['df834955-5a49-42d7-8e23-c334bb7552f8', 'b554638d-a31c-4dda-9630-fb06834a2e1f', 'a3e2442f-81a5-4cf6-afe7-53e330b1d938', 'e56aadce-32f2-4a55-ac6d-167619135b7d'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:55:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ec201d2f-4476-43ca-baa8-f38184f70a6f tempest-VolumesListTestJSON-64306112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:55:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ec201d2f-4476-43ca-baa8-f38184f70a6f tempest-VolumesListTestJSON-64306112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:55:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ec201d2f-4476-43ca-baa8-f38184f70a6f tempest-VolumesListTestJSON-64306112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:55:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ec201d2f-4476-43ca-baa8-f38184f70a6f tempest-VolumesListTestJSON-64306112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:55:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ec201d2f-4476-43ca-baa8-f38184f70a6f tempest-VolumesListTestJSON-64306112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:55:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ec201d2f-4476-43ca-baa8-f38184f70a6f tempest-VolumesListTestJSON-64306112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:27 devstack sudo[98979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:55:27 devstack sudo[98979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:27 devstack sudo[98978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_986aa466-ec7c-4cde-9722-0e2c7ffc1908_bfa19cgf Nov 06 17:55:27 devstack sudo[98978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:27 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-462e9405-f734-401c-bdb9-64c0c468e547 tempest-VolumesListTestJSON-64306112 None] Acquiring lock "cinder-1d84efb5-9a18-48ea-81b2-e9dce5176d3d-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:55:27 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-462e9405-f734-401c-bdb9-64c0c468e547 tempest-VolumesListTestJSON-64306112 None] Lock "cinder-1d84efb5-9a18-48ea-81b2-e9dce5176d3d-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:55:27 devstack sudo[98979]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ec201d2f-4476-43ca-baa8-f38184f70a6f tempest-VolumesListTestJSON-64306112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.400s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:27 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-462e9405-f734-401c-bdb9-64c0c468e547 tempest-VolumesListTestJSON-64306112 None] Acquiring lock "cinder-quobyte-1d84efb5-9a18-48ea-81b2-e9dce5176d3d" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:55:27 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-ec201d2f-4476-43ca-baa8-f38184f70a6f tempest-VolumesListTestJSON-64306112 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:55:27 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-ec201d2f-4476-43ca-baa8-f38184f70a6f tempest-VolumesListTestJSON-64306112 None] Deleted volume successfully. Nov 06 17:55:27 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-462e9405-f734-401c-bdb9-64c0c468e547 tempest-VolumesListTestJSON-64306112 None] Lock "cinder-quobyte-1d84efb5-9a18-48ea-81b2-e9dce5176d3d" acquired by "delete_volume" :: waited 0.038s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:55:27 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ec201d2f-4476-43ca-baa8-f38184f70a6f tempest-VolumesListTestJSON-64306112 None] Lock "cinder-dc0ae474-ee6d-4388-80bb-61debd767ce8-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:55:27 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d802449-fe17-4330-ac4a-4d6a31aa40f9]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:55:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-462e9405-f734-401c-bdb9-64c0c468e547 tempest-VolumesListTestJSON-64306112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1d84efb5-9a18-48ea-81b2-e9dce5176d3d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:27 devstack sudo[98978]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_986aa466-ec7c-4cde-9722-0e2c7ffc1908_bfa19cgf" returned: 0 in 0.617s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_986aa466-ec7c-4cde-9722-0e2c7ffc1908_bfa19cgf {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:27 devstack sudo[98985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1d84efb5-9a18-48ea-81b2-e9dce5176d3d Nov 06 17:55:27 devstack sudo[98985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:27 devstack sudo[98986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_986aa466-ec7c-4cde-9722-0e2c7ffc1908_bfa19cgf Nov 06 17:55:27 devstack sudo[98986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:28 devstack sudo[98986]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_986aa466-ec7c-4cde-9722-0e2c7ffc1908_bfa19cgf" returned: 1 in 0.461s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_986aa466-ec7c-4cde-9722-0e2c7ffc1908_bfa19cgf' failed. Not Retrying. {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 17:55:28 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb2090e-44e0-46ed-91d0-f89ba9faab61]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:55:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_986aa466-ec7c-4cde-9722-0e2c7ffc1908_r25rrvzadevstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:28 devstack sudo[98985]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-462e9405-f734-401c-bdb9-64c0c468e547 tempest-VolumesListTestJSON-64306112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1d84efb5-9a18-48ea-81b2-e9dce5176d3d" returned: 0 in 0.539s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-462e9405-f734-401c-bdb9-64c0c468e547 tempest-VolumesListTestJSON-64306112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1d84efb5-9a18-48ea-81b2-e9dce5176d3d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:28 devstack sudo[98995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1d84efb5-9a18-48ea-81b2-e9dce5176d3d Nov 06 17:55:28 devstack sudo[98995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:28 devstack sudo[98994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_986aa466-ec7c-4cde-9722-0e2c7ffc1908_r25rrvzadevstack@QuobyteHD Nov 06 17:55:28 devstack sudo[98994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:28 devstack sudo[98995]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-462e9405-f734-401c-bdb9-64c0c468e547 tempest-VolumesListTestJSON-64306112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1d84efb5-9a18-48ea-81b2-e9dce5176d3d" returned: 0 in 0.272s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:28 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-462e9405-f734-401c-bdb9-64c0c468e547 tempest-VolumesListTestJSON-64306112 None] Lock "cinder-quobyte-1d84efb5-9a18-48ea-81b2-e9dce5176d3d" released by "delete_volume" :: held 0.883s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:55:28 devstack sudo[98994]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_986aa466-ec7c-4cde-9722-0e2c7ffc1908_r25rrvzadevstack@QuobyteHD" returned: 0 in 0.396s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:28 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] 986aa466-ec7c-4cde-9722-0e2c7ffc1908 was qcow2, converting to qcow2 {{(pid=87068) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 06 17:55:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_986aa466-ec7c-4cde-9722-0e2c7ffc1908_r25rrvzadevstack@QuobyteHD /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-cb615f18-3857-432d-9177-ff47aa9eb95f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:28 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-462e9405-f734-401c-bdb9-64c0c468e547 tempest-VolumesListTestJSON-64306112 None] Created reservations ['db1af12b-78cc-4dce-875d-bbd5900d92b3', '8ed4fd5e-243e-4080-afc0-54a38a30f7dc', 'd3e0dc3a-319f-4f83-8214-4cd6191322aa', '9ac0abb2-795e-42dc-b524-036a11e74116'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:55:28 devstack sudo[99003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_986aa466-ec7c-4cde-9722-0e2c7ffc1908_r25rrvzadevstack@QuobyteHD /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-cb615f18-3857-432d-9177-ff47aa9eb95f Nov 06 17:55:28 devstack sudo[99003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-462e9405-f734-401c-bdb9-64c0c468e547 tempest-VolumesListTestJSON-64306112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:55:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-462e9405-f734-401c-bdb9-64c0c468e547 tempest-VolumesListTestJSON-64306112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:55:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-462e9405-f734-401c-bdb9-64c0c468e547 tempest-VolumesListTestJSON-64306112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:55:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-462e9405-f734-401c-bdb9-64c0c468e547 tempest-VolumesListTestJSON-64306112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:55:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-462e9405-f734-401c-bdb9-64c0c468e547 tempest-VolumesListTestJSON-64306112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:55:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-462e9405-f734-401c-bdb9-64c0c468e547 tempest-VolumesListTestJSON-64306112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:28 devstack sudo[99005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:55:28 devstack sudo[99005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:29 devstack sudo[99005]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-462e9405-f734-401c-bdb9-64c0c468e547 tempest-VolumesListTestJSON-64306112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.347s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:29 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-462e9405-f734-401c-bdb9-64c0c468e547 tempest-VolumesListTestJSON-64306112 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:55:29 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-462e9405-f734-401c-bdb9-64c0c468e547 tempest-VolumesListTestJSON-64306112 None] Deleted volume successfully. Nov 06 17:55:29 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-462e9405-f734-401c-bdb9-64c0c468e547 tempest-VolumesListTestJSON-64306112 None] Lock "cinder-1d84efb5-9a18-48ea-81b2-e9dce5176d3d-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:55:31 devstack sudo[99003]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_986aa466-ec7c-4cde-9722-0e2c7ffc1908_r25rrvzadevstack@QuobyteHD /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-cb615f18-3857-432d-9177-ff47aa9eb95f" returned: 0 in 2.674s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:31 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_986aa466-ec7c-4cde-9722-0e2c7ffc1908_r25rrvzadevstack@QuobyteHD, size 112.00 MB, duration 2.67 sec, destination /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-cb615f18-3857-432d-9177-ff47aa9eb95f {{(pid=87068) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 17:55:31 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] Converted 112.00 MB image at 41.87 MB/s Nov 06 17:55:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-cb615f18-3857-432d-9177-ff47aa9eb95f 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:31 devstack sudo[99015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-cb615f18-3857-432d-9177-ff47aa9eb95f 1G Nov 06 17:55:31 devstack sudo[99015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:31 devstack sudo[99015]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-cb615f18-3857-432d-9177-ff47aa9eb95f 1G" returned: 0 in 0.472s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:31 devstack cinder-volume[87068]: DEBUG cinder.volume.volume_utils [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] Downloaded image 986aa466-ec7c-4cde-9722-0e2c7ffc1908 ((None, [{'url': 'file:///opt/stack/data/glance/images/986aa466-ec7c-4cde-9722-0e2c7ffc1908', 'metadata': {}}])) to volume cb615f18-3857-432d-9177-ff47aa9eb95f successfully. {{(pid=87068) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 17:55:31 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] Temporary image 986aa466-ec7c-4cde-9722-0e2c7ffc1908 for user d3f2aaa3c75d42bb8597109df3f5e4dc is deleted. {{(pid=87068) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 06 17:55:31 devstack cinder-volume[87068]: DEBUG cinder.volume.volume_utils [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] Marking volume cb615f18-3857-432d-9177-ff47aa9eb95f as bootable. {{(pid=87068) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 17:55:31 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] Copying metadata from image 986aa466-ec7c-4cde-9722-0e2c7ffc1908 to cb615f18-3857-432d-9177-ff47aa9eb95f. {{(pid=87068) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 17:55:31 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] Creating volume glance metadata for volume cb615f18-3857-432d-9177-ff47aa9eb95f backed by image 986aa466-ec7c-4cde-9722-0e2c7ffc1908 with: {'image_id': '986aa466-ec7c-4cde-9722-0e2c7ffc1908', 'image_name': 'tempest-scenario-img--569701219', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87068) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 17:55:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c2f0306-6df8-4371-ae49-09bc8e917046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb615f18-3857-432d-9177-ff47aa9eb95f', 'volume_size': 1, 'image_id': '986aa466-ec7c-4cde-9722-0e2c7ffc1908', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/986aa466-ec7c-4cde-9722-0e2c7ffc1908', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--569701219', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bc6bed60bc7f4146a54ebab32ac68cff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '986aa466-ec7c-4cde-9722-0e2c7ffc1908', 'created_at': datetime.datetime(2026, 11, 6, 16, 55, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 16, 55, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/986aa466-ec7c-4cde-9722-0e2c7ffc1908/file', 'properties': {}}, 'image_service': }' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:55:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed03dbc8-f289-4c49-a8ec-d85540a5c76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:55:31 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] Volume volume-cb615f18-3857-432d-9177-ff47aa9eb95f (cb615f18-3857-432d-9177-ff47aa9eb95f): created successfully Nov 06 17:55:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed03dbc8-f289-4c49-a8ec-d85540a5c76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:55:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] Flow 'volume_create_manager' (20e519ce-ad12-4a7f-95da-a9d43c5ec3dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:55:31 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-36fc1d06-c469-42cb-96e7-86c65542d26e tempest-TestInstancesWithCinderVolumes-1921145433 None] Created volume successfully. Nov 06 17:55:34 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3877da5-5785-472f-a957-4a8a7a11faee tempest-VolumesNegativeTest-249218523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:55:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a3877da5-5785-472f-a957-4a8a7a11faee tempest-VolumesNegativeTest-249218523 None] Flow 'volume_create_manager' (10b66fe6-5c8f-45d3-8689-4eaf340accf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:55:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a3877da5-5785-472f-a957-4a8a7a11faee tempest-VolumesNegativeTest-249218523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7664ca70-484b-41ee-8def-4462aec1b047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:55:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a3877da5-5785-472f-a957-4a8a7a11faee tempest-VolumesNegativeTest-249218523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7664ca70-484b-41ee-8def-4462aec1b047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-501712451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=052cd28f-1f4a-4e1b-ad8d-e539320c6002,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e026dcbc02b34f67b6d8738b10153d95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:55:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:55:35Z,use_quota=True,user_id='435faefbda1f43c2b9575e1ce0a81e5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:55:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a3877da5-5785-472f-a957-4a8a7a11faee tempest-VolumesNegativeTest-249218523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e8868d5-3555-493c-9806-10b7dfbc699c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:55:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a3877da5-5785-472f-a957-4a8a7a11faee tempest-VolumesNegativeTest-249218523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e8868d5-3555-493c-9806-10b7dfbc699c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:55:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a3877da5-5785-472f-a957-4a8a7a11faee tempest-VolumesNegativeTest-249218523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (889eefeb-99b0-408a-8dbf-6e038957ea42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:55:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a3877da5-5785-472f-a957-4a8a7a11faee tempest-VolumesNegativeTest-249218523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (889eefeb-99b0-408a-8dbf-6e038957ea42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '052cd28f-1f4a-4e1b-ad8d-e539320c6002', 'volume_name': 'volume-052cd28f-1f4a-4e1b-ad8d-e539320c6002', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:55:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a3877da5-5785-472f-a957-4a8a7a11faee tempest-VolumesNegativeTest-249218523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2529efc-bd5c-4dbf-a80a-f1ae845c2f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:55:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a3877da5-5785-472f-a957-4a8a7a11faee tempest-VolumesNegativeTest-249218523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2529efc-bd5c-4dbf-a80a-f1ae845c2f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:55:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a3877da5-5785-472f-a957-4a8a7a11faee tempest-VolumesNegativeTest-249218523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02ba6e48-aff6-42d7-bb2f-325fd12f63a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:55:34 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-a3877da5-5785-472f-a957-4a8a7a11faee tempest-VolumesNegativeTest-249218523 None] Volume 052cd28f-1f4a-4e1b-ad8d-e539320c6002: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-052cd28f-1f4a-4e1b-ad8d-e539320c6002', 'volume_size': 1} Nov 06 17:55:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a3877da5-5785-472f-a957-4a8a7a11faee tempest-VolumesNegativeTest-249218523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:55:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a3877da5-5785-472f-a957-4a8a7a11faee tempest-VolumesNegativeTest-249218523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:55:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a3877da5-5785-472f-a957-4a8a7a11faee tempest-VolumesNegativeTest-249218523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-501712451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=052cd28f-1f4a-4e1b-ad8d-e539320c6002,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e026dcbc02b34f67b6d8738b10153d95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:55:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:55:35Z,use_quota=True,user_id='435faefbda1f43c2b9575e1ce0a81e5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:55:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-a3877da5-5785-472f-a957-4a8a7a11faee tempest-VolumesNegativeTest-249218523 None] Creating volume 052cd28f-1f4a-4e1b-ad8d-e539320c6002 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:55:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a3877da5-5785-472f-a957-4a8a7a11faee tempest-VolumesNegativeTest-249218523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:55:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a3877da5-5785-472f-a957-4a8a7a11faee tempest-VolumesNegativeTest-249218523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:55:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a3877da5-5785-472f-a957-4a8a7a11faee tempest-VolumesNegativeTest-249218523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:55:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a3877da5-5785-472f-a957-4a8a7a11faee tempest-VolumesNegativeTest-249218523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:55:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a3877da5-5785-472f-a957-4a8a7a11faee tempest-VolumesNegativeTest-249218523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:55:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a3877da5-5785-472f-a957-4a8a7a11faee tempest-VolumesNegativeTest-249218523 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:55:34 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-a3877da5-5785-472f-a957-4a8a7a11faee tempest-VolumesNegativeTest-249218523 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:55:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a3877da5-5785-472f-a957-4a8a7a11faee tempest-VolumesNegativeTest-249218523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-052cd28f-1f4a-4e1b-ad8d-e539320c6002 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:35 devstack sudo[99022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-052cd28f-1f4a-4e1b-ad8d-e539320c6002 1073741824 Nov 06 17:55:35 devstack sudo[99022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:35 devstack sudo[99022]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a3877da5-5785-472f-a957-4a8a7a11faee tempest-VolumesNegativeTest-249218523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-052cd28f-1f4a-4e1b-ad8d-e539320c6002 1073741824" returned: 0 in 0.577s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a3877da5-5785-472f-a957-4a8a7a11faee tempest-VolumesNegativeTest-249218523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-052cd28f-1f4a-4e1b-ad8d-e539320c6002 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:35 devstack sudo[99028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-052cd28f-1f4a-4e1b-ad8d-e539320c6002 Nov 06 17:55:35 devstack sudo[99028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:36 devstack sudo[99028]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a3877da5-5785-472f-a957-4a8a7a11faee tempest-VolumesNegativeTest-249218523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-052cd28f-1f4a-4e1b-ad8d-e539320c6002" returned: 0 in 0.494s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:36 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a3877da5-5785-472f-a957-4a8a7a11faee tempest-VolumesNegativeTest-249218523 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:55:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a3877da5-5785-472f-a957-4a8a7a11faee tempest-VolumesNegativeTest-249218523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:55:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a3877da5-5785-472f-a957-4a8a7a11faee tempest-VolumesNegativeTest-249218523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02ba6e48-aff6-42d7-bb2f-325fd12f63a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-052cd28f-1f4a-4e1b-ad8d-e539320c6002', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:55:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a3877da5-5785-472f-a957-4a8a7a11faee tempest-VolumesNegativeTest-249218523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7085d012-f0db-452f-a850-2cca40e5e588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:55:36 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-a3877da5-5785-472f-a957-4a8a7a11faee tempest-VolumesNegativeTest-249218523 None] Volume volume-052cd28f-1f4a-4e1b-ad8d-e539320c6002 (052cd28f-1f4a-4e1b-ad8d-e539320c6002): created successfully Nov 06 17:55:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a3877da5-5785-472f-a957-4a8a7a11faee tempest-VolumesNegativeTest-249218523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7085d012-f0db-452f-a850-2cca40e5e588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:55:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a3877da5-5785-472f-a957-4a8a7a11faee tempest-VolumesNegativeTest-249218523 None] Flow 'volume_create_manager' (10b66fe6-5c8f-45d3-8689-4eaf340accf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:55:36 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-a3877da5-5785-472f-a957-4a8a7a11faee tempest-VolumesNegativeTest-249218523 None] Created volume successfully. Nov 06 17:55:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-66001858-169e-49d1-a7e6-abb316b5a0d0 req-1c553978-009d-467a-b9b9-1b5fe913440d tempest-TestInstancesWithCinderVolumes-1921145433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:55:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-66001858-169e-49d1-a7e6-abb316b5a0d0 req-1c553978-009d-467a-b9b9-1b5fe913440d tempest-TestInstancesWithCinderVolumes-1921145433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:55:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-66001858-169e-49d1-a7e6-abb316b5a0d0 req-1c553978-009d-467a-b9b9-1b5fe913440d tempest-TestInstancesWithCinderVolumes-1921145433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:55:39 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-66001858-169e-49d1-a7e6-abb316b5a0d0 req-1c553978-009d-467a-b9b9-1b5fe913440d tempest-TestInstancesWithCinderVolumes-1921145433 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072', 'name': 'volume-cb615f18-3857-432d-9177-ff47aa9eb95f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e1a84604-2117-454c-8fc4-23a90ed85cf7', 'enforce_multipath': True} {{(pid=87068) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 17:55:39 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-66001858-169e-49d1-a7e6-abb316b5a0d0 req-1c553978-009d-467a-b9b9-1b5fe913440d tempest-TestInstancesWithCinderVolumes-1921145433 None] attachment_update completed successfully. Nov 06 17:55:47 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc78e16a-8641-4ff3-9ffa-abfa4a0ddcba tempest-VolumesSnapshotTestJSON-187705537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:55:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cc78e16a-8641-4ff3-9ffa-abfa4a0ddcba tempest-VolumesSnapshotTestJSON-187705537 None] Flow 'volume_create_manager' (d205f21a-af81-4c57-92e4-10eb61b0f094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:55:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cc78e16a-8641-4ff3-9ffa-abfa4a0ddcba tempest-VolumesSnapshotTestJSON-187705537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7dc0577-39b2-4656-9703-965bf0f7ad9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:55:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cc78e16a-8641-4ff3-9ffa-abfa4a0ddcba tempest-VolumesSnapshotTestJSON-187705537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7dc0577-39b2-4656-9703-965bf0f7ad9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:55:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2060383157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=822f6ad8-4f03-465b-a1d8-77ff6133e7dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ec444c1ccd54c3aafbe41d1987ead32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:55:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:55:47Z,use_quota=True,user_id='40043c4a8d004be584aecf793d4b4273',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:55:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cc78e16a-8641-4ff3-9ffa-abfa4a0ddcba tempest-VolumesSnapshotTestJSON-187705537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c59e01f9-32b3-4732-83cd-609c3b0cfa40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:55:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cc78e16a-8641-4ff3-9ffa-abfa4a0ddcba tempest-VolumesSnapshotTestJSON-187705537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c59e01f9-32b3-4732-83cd-609c3b0cfa40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:55:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cc78e16a-8641-4ff3-9ffa-abfa4a0ddcba tempest-VolumesSnapshotTestJSON-187705537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee9f31fb-0b9b-465b-858c-6caf01954765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:55:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cc78e16a-8641-4ff3-9ffa-abfa4a0ddcba tempest-VolumesSnapshotTestJSON-187705537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee9f31fb-0b9b-465b-858c-6caf01954765) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '822f6ad8-4f03-465b-a1d8-77ff6133e7dd', 'volume_name': 'volume-822f6ad8-4f03-465b-a1d8-77ff6133e7dd', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:55:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cc78e16a-8641-4ff3-9ffa-abfa4a0ddcba tempest-VolumesSnapshotTestJSON-187705537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf4477ad-875e-4dd8-8a37-3e05a270ac96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:55:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cc78e16a-8641-4ff3-9ffa-abfa4a0ddcba tempest-VolumesSnapshotTestJSON-187705537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf4477ad-875e-4dd8-8a37-3e05a270ac96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:55:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cc78e16a-8641-4ff3-9ffa-abfa4a0ddcba tempest-VolumesSnapshotTestJSON-187705537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed154554-d65a-473b-aee6-718976e58e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:55:47 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-cc78e16a-8641-4ff3-9ffa-abfa4a0ddcba tempest-VolumesSnapshotTestJSON-187705537 None] Volume 822f6ad8-4f03-465b-a1d8-77ff6133e7dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-822f6ad8-4f03-465b-a1d8-77ff6133e7dd', 'volume_size': 1} Nov 06 17:55:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cc78e16a-8641-4ff3-9ffa-abfa4a0ddcba tempest-VolumesSnapshotTestJSON-187705537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:55:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cc78e16a-8641-4ff3-9ffa-abfa4a0ddcba tempest-VolumesSnapshotTestJSON-187705537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:55:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-cc78e16a-8641-4ff3-9ffa-abfa4a0ddcba tempest-VolumesSnapshotTestJSON-187705537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:55:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2060383157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=822f6ad8-4f03-465b-a1d8-77ff6133e7dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ec444c1ccd54c3aafbe41d1987ead32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:55:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:55:47Z,use_quota=True,user_id='40043c4a8d004be584aecf793d4b4273',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:55:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-cc78e16a-8641-4ff3-9ffa-abfa4a0ddcba tempest-VolumesSnapshotTestJSON-187705537 None] Creating volume 822f6ad8-4f03-465b-a1d8-77ff6133e7dd {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:55:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cc78e16a-8641-4ff3-9ffa-abfa4a0ddcba tempest-VolumesSnapshotTestJSON-187705537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:55:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cc78e16a-8641-4ff3-9ffa-abfa4a0ddcba tempest-VolumesSnapshotTestJSON-187705537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:55:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-cc78e16a-8641-4ff3-9ffa-abfa4a0ddcba tempest-VolumesSnapshotTestJSON-187705537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:55:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-cc78e16a-8641-4ff3-9ffa-abfa4a0ddcba tempest-VolumesSnapshotTestJSON-187705537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:55:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cc78e16a-8641-4ff3-9ffa-abfa4a0ddcba tempest-VolumesSnapshotTestJSON-187705537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:55:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-cc78e16a-8641-4ff3-9ffa-abfa4a0ddcba tempest-VolumesSnapshotTestJSON-187705537 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:55:47 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-cc78e16a-8641-4ff3-9ffa-abfa4a0ddcba tempest-VolumesSnapshotTestJSON-187705537 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:55:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cc78e16a-8641-4ff3-9ffa-abfa4a0ddcba tempest-VolumesSnapshotTestJSON-187705537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-822f6ad8-4f03-465b-a1d8-77ff6133e7dd 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:47 devstack sudo[99526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-822f6ad8-4f03-465b-a1d8-77ff6133e7dd 1073741824 Nov 06 17:55:47 devstack sudo[99526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:48 devstack sudo[99526]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cc78e16a-8641-4ff3-9ffa-abfa4a0ddcba tempest-VolumesSnapshotTestJSON-187705537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-822f6ad8-4f03-465b-a1d8-77ff6133e7dd 1073741824" returned: 0 in 0.856s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cc78e16a-8641-4ff3-9ffa-abfa4a0ddcba tempest-VolumesSnapshotTestJSON-187705537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-822f6ad8-4f03-465b-a1d8-77ff6133e7dd {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:48 devstack sudo[99546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-822f6ad8-4f03-465b-a1d8-77ff6133e7dd Nov 06 17:55:48 devstack sudo[99546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:49 devstack sudo[99546]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cc78e16a-8641-4ff3-9ffa-abfa4a0ddcba tempest-VolumesSnapshotTestJSON-187705537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-822f6ad8-4f03-465b-a1d8-77ff6133e7dd" returned: 0 in 0.697s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-cc78e16a-8641-4ff3-9ffa-abfa4a0ddcba tempest-VolumesSnapshotTestJSON-187705537 None] <== create_volume: return (1632ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:55:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cc78e16a-8641-4ff3-9ffa-abfa4a0ddcba tempest-VolumesSnapshotTestJSON-187705537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.635s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:55:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cc78e16a-8641-4ff3-9ffa-abfa4a0ddcba tempest-VolumesSnapshotTestJSON-187705537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed154554-d65a-473b-aee6-718976e58e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-822f6ad8-4f03-465b-a1d8-77ff6133e7dd', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:55:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cc78e16a-8641-4ff3-9ffa-abfa4a0ddcba tempest-VolumesSnapshotTestJSON-187705537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f079ce3d-51c3-482c-80b9-27a85457c5c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:55:49 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-cc78e16a-8641-4ff3-9ffa-abfa4a0ddcba tempest-VolumesSnapshotTestJSON-187705537 None] Volume volume-822f6ad8-4f03-465b-a1d8-77ff6133e7dd (822f6ad8-4f03-465b-a1d8-77ff6133e7dd): created successfully Nov 06 17:55:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cc78e16a-8641-4ff3-9ffa-abfa4a0ddcba tempest-VolumesSnapshotTestJSON-187705537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f079ce3d-51c3-482c-80b9-27a85457c5c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:55:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cc78e16a-8641-4ff3-9ffa-abfa4a0ddcba tempest-VolumesSnapshotTestJSON-187705537 None] Flow 'volume_create_manager' (d205f21a-af81-4c57-92e4-10eb61b0f094) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:55:49 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-cc78e16a-8641-4ff3-9ffa-abfa4a0ddcba tempest-VolumesSnapshotTestJSON-187705537 None] Created volume successfully. Nov 06 17:55:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-25f5201a-c0ea-49c2-a8e1-1badd3c9c22d tempest-VolumesSnapshotTestJSON-187705537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:55:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-25f5201a-c0ea-49c2-a8e1-1badd3c9c22d tempest-VolumesSnapshotTestJSON-187705537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:55:51 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-25f5201a-c0ea-49c2-a8e1-1badd3c9c22d tempest-VolumesSnapshotTestJSON-187705537 None] Creating offline snapshot 72b9eb93-15f0-49a4-91b3-8735fcaf46d9 of volume 822f6ad8-4f03-465b-a1d8-77ff6133e7dd {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 17:55:51 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c3bb93-0a15-4c81-94c7-f9d4fe60adc3]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:55:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-25f5201a-c0ea-49c2-a8e1-1badd3c9c22d tempest-VolumesSnapshotTestJSON-187705537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-822f6ad8-4f03-465b-a1d8-77ff6133e7dd {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:52 devstack sudo[99652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-822f6ad8-4f03-465b-a1d8-77ff6133e7dd Nov 06 17:55:52 devstack sudo[99652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:52 devstack sudo[99652]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-25f5201a-c0ea-49c2-a8e1-1badd3c9c22d tempest-VolumesSnapshotTestJSON-187705537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-822f6ad8-4f03-465b-a1d8-77ff6133e7dd" returned: 0 in 0.872s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-25f5201a-c0ea-49c2-a8e1-1badd3c9c22d tempest-VolumesSnapshotTestJSON-187705537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-822f6ad8-4f03-465b-a1d8-77ff6133e7dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-822f6ad8-4f03-465b-a1d8-77ff6133e7dd.72b9eb93-15f0-49a4-91b3-8735fcaf46d9 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:52 devstack sudo[99662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-822f6ad8-4f03-465b-a1d8-77ff6133e7dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-822f6ad8-4f03-465b-a1d8-77ff6133e7dd.72b9eb93-15f0-49a4-91b3-8735fcaf46d9 1G Nov 06 17:55:52 devstack sudo[99662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:53 devstack sudo[99662]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-25f5201a-c0ea-49c2-a8e1-1badd3c9c22d tempest-VolumesSnapshotTestJSON-187705537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-822f6ad8-4f03-465b-a1d8-77ff6133e7dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-822f6ad8-4f03-465b-a1d8-77ff6133e7dd.72b9eb93-15f0-49a4-91b3-8735fcaf46d9 1G" returned: 0 in 0.871s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-25f5201a-c0ea-49c2-a8e1-1badd3c9c22d tempest-VolumesSnapshotTestJSON-187705537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-822f6ad8-4f03-465b-a1d8-77ff6133e7dd -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-822f6ad8-4f03-465b-a1d8-77ff6133e7dd.72b9eb93-15f0-49a4-91b3-8735fcaf46d9 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:53 devstack sudo[99670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-822f6ad8-4f03-465b-a1d8-77ff6133e7dd -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-822f6ad8-4f03-465b-a1d8-77ff6133e7dd.72b9eb93-15f0-49a4-91b3-8735fcaf46d9 Nov 06 17:55:53 devstack sudo[99670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:54 devstack sudo[99670]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-25f5201a-c0ea-49c2-a8e1-1badd3c9c22d tempest-VolumesSnapshotTestJSON-187705537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-822f6ad8-4f03-465b-a1d8-77ff6133e7dd -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-822f6ad8-4f03-465b-a1d8-77ff6133e7dd.72b9eb93-15f0-49a4-91b3-8735fcaf46d9" returned: 0 in 0.704s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:54 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-25f5201a-c0ea-49c2-a8e1-1badd3c9c22d tempest-VolumesSnapshotTestJSON-187705537 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-822f6ad8-4f03-465b-a1d8-77ff6133e7dd.72b9eb93-15f0-49a4-91b3-8735fcaf46d9 is being set with open permissions: ugo+rw Nov 06 17:55:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-25f5201a-c0ea-49c2-a8e1-1badd3c9c22d tempest-VolumesSnapshotTestJSON-187705537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-822f6ad8-4f03-465b-a1d8-77ff6133e7dd.72b9eb93-15f0-49a4-91b3-8735fcaf46d9 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:54 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 17:55:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:55:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:55:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:55:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:55:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:55:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:54 devstack sudo[99675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-822f6ad8-4f03-465b-a1d8-77ff6133e7dd.72b9eb93-15f0-49a4-91b3-8735fcaf46d9 Nov 06 17:55:54 devstack sudo[99675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:54 devstack sudo[99677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:55:54 devstack sudo[99677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:55 devstack sudo[99677]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.500s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:55 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:55:55 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running periodic task VolumeManager._thread_info {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 17:55:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] thread count: 28 {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 17:55:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] thread info: [<_MainThread(MainThread, started 133940619505792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 17:55:55 devstack sudo[99675]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-25f5201a-c0ea-49c2-a8e1-1badd3c9c22d tempest-VolumesSnapshotTestJSON-187705537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-822f6ad8-4f03-465b-a1d8-77ff6133e7dd.72b9eb93-15f0-49a4-91b3-8735fcaf46d9" returned: 0 in 0.716s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-25f5201a-c0ea-49c2-a8e1-1badd3c9c22d tempest-VolumesSnapshotTestJSON-187705537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-822f6ad8-4f03-465b-a1d8-77ff6133e7dd.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:55 devstack sudo[99681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-822f6ad8-4f03-465b-a1d8-77ff6133e7dd.info Nov 06 17:55:55 devstack sudo[99681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:55 devstack sudo[99681]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-25f5201a-c0ea-49c2-a8e1-1badd3c9c22d tempest-VolumesSnapshotTestJSON-187705537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-822f6ad8-4f03-465b-a1d8-77ff6133e7dd.info" returned: 0 in 0.544s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:55 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-25f5201a-c0ea-49c2-a8e1-1badd3c9c22d tempest-VolumesSnapshotTestJSON-187705537 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-822f6ad8-4f03-465b-a1d8-77ff6133e7dd.info is being set with open permissions: ugo+rw Nov 06 17:55:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-25f5201a-c0ea-49c2-a8e1-1badd3c9c22d tempest-VolumesSnapshotTestJSON-187705537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-822f6ad8-4f03-465b-a1d8-77ff6133e7dd.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:55 devstack sudo[99684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-822f6ad8-4f03-465b-a1d8-77ff6133e7dd.info Nov 06 17:55:55 devstack sudo[99684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:56 devstack sudo[99684]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-25f5201a-c0ea-49c2-a8e1-1badd3c9c22d tempest-VolumesSnapshotTestJSON-187705537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-822f6ad8-4f03-465b-a1d8-77ff6133e7dd.info" returned: 0 in 0.486s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-25f5201a-c0ea-49c2-a8e1-1badd3c9c22d tempest-VolumesSnapshotTestJSON-187705537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.446s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:55:56 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-25f5201a-c0ea-49c2-a8e1-1badd3c9c22d tempest-VolumesSnapshotTestJSON-187705537 None] Create snapshot completed successfully Nov 06 17:55:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1a813be9-ec23-4414-bef1-d8f316284cd5 tempest-VolumesSnapshotTestJSON-187705537 None] Acquiring lock "cinder-72b9eb93-15f0-49a4-91b3-8735fcaf46d9-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:55:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1a813be9-ec23-4414-bef1-d8f316284cd5 tempest-VolumesSnapshotTestJSON-187705537 None] Lock "cinder-72b9eb93-15f0-49a4-91b3-8735fcaf46d9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:55:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1a813be9-ec23-4414-bef1-d8f316284cd5 tempest-VolumesSnapshotTestJSON-187705537 None] Acquiring lock "cinder-quobyte-822f6ad8-4f03-465b-a1d8-77ff6133e7dd" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:55:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1a813be9-ec23-4414-bef1-d8f316284cd5 tempest-VolumesSnapshotTestJSON-187705537 None] Lock "cinder-quobyte-822f6ad8-4f03-465b-a1d8-77ff6133e7dd" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:55:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1a813be9-ec23-4414-bef1-d8f316284cd5 tempest-VolumesSnapshotTestJSON-187705537 None] Acquiring lock "cinder-quobyte-72b9eb93-15f0-49a4-91b3-8735fcaf46d9" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:55:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1a813be9-ec23-4414-bef1-d8f316284cd5 tempest-VolumesSnapshotTestJSON-187705537 None] Lock "cinder-quobyte-72b9eb93-15f0-49a4-91b3-8735fcaf46d9" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:55:57 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-1a813be9-ec23-4414-bef1-d8f316284cd5 tempest-VolumesSnapshotTestJSON-187705537 None] Deleting offline snapshot 72b9eb93-15f0-49a4-91b3-8735fcaf46d9 of volume 822f6ad8-4f03-465b-a1d8-77ff6133e7dd {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 17:55:57 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-1a813be9-ec23-4414-bef1-d8f316284cd5 tempest-VolumesSnapshotTestJSON-187705537 None] snapshot_file for this snap is: volume-822f6ad8-4f03-465b-a1d8-77ff6133e7dd.72b9eb93-15f0-49a4-91b3-8735fcaf46d9 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 17:55:57 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[44442b96-15a1-4ee6-b81b-238303e42f2b]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:55:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1a813be9-ec23-4414-bef1-d8f316284cd5 tempest-VolumesSnapshotTestJSON-187705537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-822f6ad8-4f03-465b-a1d8-77ff6133e7dd.72b9eb93-15f0-49a4-91b3-8735fcaf46d9 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:57 devstack sudo[99709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-822f6ad8-4f03-465b-a1d8-77ff6133e7dd.72b9eb93-15f0-49a4-91b3-8735fcaf46d9 Nov 06 17:55:57 devstack sudo[99709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:58 devstack sudo[99709]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1a813be9-ec23-4414-bef1-d8f316284cd5 tempest-VolumesSnapshotTestJSON-187705537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-822f6ad8-4f03-465b-a1d8-77ff6133e7dd.72b9eb93-15f0-49a4-91b3-8735fcaf46d9" returned: 0 in 0.769s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:58 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-1a813be9-ec23-4414-bef1-d8f316284cd5 tempest-VolumesSnapshotTestJSON-187705537 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-822f6ad8-4f03-465b-a1d8-77ff6133e7dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 17:55:58 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0e4b6f-7398-488e-a7e0-1de55d122327]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:55:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1a813be9-ec23-4414-bef1-d8f316284cd5 tempest-VolumesSnapshotTestJSON-187705537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-822f6ad8-4f03-465b-a1d8-77ff6133e7dd {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:59 devstack sudo[99717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-822f6ad8-4f03-465b-a1d8-77ff6133e7dd Nov 06 17:55:59 devstack sudo[99717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:59 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-e195e351-d7f9-4215-b4c3-6ae651f7e29c tempest-VolumeQuotasAdminTestJSON-1326538137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:55:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e195e351-d7f9-4215-b4c3-6ae651f7e29c tempest-VolumeQuotasAdminTestJSON-1326538137 None] Flow 'volume_create_manager' (f89de280-58ad-4f49-9ed8-165c5bc6fda8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:55:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e195e351-d7f9-4215-b4c3-6ae651f7e29c tempest-VolumeQuotasAdminTestJSON-1326538137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9fca6fb-e451-4e3a-bcd0-9de3cbf1be45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:55:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e195e351-d7f9-4215-b4c3-6ae651f7e29c tempest-VolumeQuotasAdminTestJSON-1326538137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9fca6fb-e451-4e3a-bcd0-9de3cbf1be45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:55:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-242673638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=627259a6-b6d8-444c-b057-a1fecb3bc273,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcdad4a9e63446e689071a3c5f4711d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:55:59Z,use_quota=True,user_id='4c05a30f7f5745a49231cfadbc87d48b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:55:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e195e351-d7f9-4215-b4c3-6ae651f7e29c tempest-VolumeQuotasAdminTestJSON-1326538137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f496e03a-253f-4b8f-ae13-dea316431608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:55:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e195e351-d7f9-4215-b4c3-6ae651f7e29c tempest-VolumeQuotasAdminTestJSON-1326538137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f496e03a-253f-4b8f-ae13-dea316431608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:55:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e195e351-d7f9-4215-b4c3-6ae651f7e29c tempest-VolumeQuotasAdminTestJSON-1326538137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00e1be88-88fa-4a9a-9ab6-f3a0fc8473ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:55:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e195e351-d7f9-4215-b4c3-6ae651f7e29c tempest-VolumeQuotasAdminTestJSON-1326538137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00e1be88-88fa-4a9a-9ab6-f3a0fc8473ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '627259a6-b6d8-444c-b057-a1fecb3bc273', 'volume_name': 'volume-627259a6-b6d8-444c-b057-a1fecb3bc273', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:55:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e195e351-d7f9-4215-b4c3-6ae651f7e29c tempest-VolumeQuotasAdminTestJSON-1326538137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ac8371e-cb2d-40c2-b870-b40f968caef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:55:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e195e351-d7f9-4215-b4c3-6ae651f7e29c tempest-VolumeQuotasAdminTestJSON-1326538137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ac8371e-cb2d-40c2-b870-b40f968caef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:55:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e195e351-d7f9-4215-b4c3-6ae651f7e29c tempest-VolumeQuotasAdminTestJSON-1326538137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82d5d4e3-6e8b-4a3e-9bb3-fc0b7cf566b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:55:59 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-e195e351-d7f9-4215-b4c3-6ae651f7e29c tempest-VolumeQuotasAdminTestJSON-1326538137 None] Volume 627259a6-b6d8-444c-b057-a1fecb3bc273: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-627259a6-b6d8-444c-b057-a1fecb3bc273', 'volume_size': 1} Nov 06 17:55:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e195e351-d7f9-4215-b4c3-6ae651f7e29c tempest-VolumeQuotasAdminTestJSON-1326538137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:55:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e195e351-d7f9-4215-b4c3-6ae651f7e29c tempest-VolumeQuotasAdminTestJSON-1326538137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:55:59 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e195e351-d7f9-4215-b4c3-6ae651f7e29c tempest-VolumeQuotasAdminTestJSON-1326538137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:55:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-242673638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=627259a6-b6d8-444c-b057-a1fecb3bc273,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcdad4a9e63446e689071a3c5f4711d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:55:59Z,use_quota=True,user_id='4c05a30f7f5745a49231cfadbc87d48b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:55:59 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-e195e351-d7f9-4215-b4c3-6ae651f7e29c tempest-VolumeQuotasAdminTestJSON-1326538137 None] Creating volume 627259a6-b6d8-444c-b057-a1fecb3bc273 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:55:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e195e351-d7f9-4215-b4c3-6ae651f7e29c tempest-VolumeQuotasAdminTestJSON-1326538137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:55:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e195e351-d7f9-4215-b4c3-6ae651f7e29c tempest-VolumeQuotasAdminTestJSON-1326538137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:55:59 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e195e351-d7f9-4215-b4c3-6ae651f7e29c tempest-VolumeQuotasAdminTestJSON-1326538137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:55:59 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e195e351-d7f9-4215-b4c3-6ae651f7e29c tempest-VolumeQuotasAdminTestJSON-1326538137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:55:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e195e351-d7f9-4215-b4c3-6ae651f7e29c tempest-VolumeQuotasAdminTestJSON-1326538137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:55:59 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e195e351-d7f9-4215-b4c3-6ae651f7e29c tempest-VolumeQuotasAdminTestJSON-1326538137 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:55:59 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-e195e351-d7f9-4215-b4c3-6ae651f7e29c tempest-VolumeQuotasAdminTestJSON-1326538137 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:55:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e195e351-d7f9-4215-b4c3-6ae651f7e29c tempest-VolumeQuotasAdminTestJSON-1326538137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-627259a6-b6d8-444c-b057-a1fecb3bc273 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:59 devstack sudo[99722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-627259a6-b6d8-444c-b057-a1fecb3bc273 1073741824 Nov 06 17:55:59 devstack sudo[99722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:55:59 devstack sudo[99717]: pam_unix(sudo:session): session closed for user root Nov 06 17:55:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1a813be9-ec23-4414-bef1-d8f316284cd5 tempest-VolumesSnapshotTestJSON-187705537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-822f6ad8-4f03-465b-a1d8-77ff6133e7dd" returned: 0 in 0.882s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:55:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1a813be9-ec23-4414-bef1-d8f316284cd5 tempest-VolumesSnapshotTestJSON-187705537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-822f6ad8-4f03-465b-a1d8-77ff6133e7dd.72b9eb93-15f0-49a4-91b3-8735fcaf46d9 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:55:59 devstack sudo[99725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-822f6ad8-4f03-465b-a1d8-77ff6133e7dd.72b9eb93-15f0-49a4-91b3-8735fcaf46d9 Nov 06 17:55:59 devstack sudo[99725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:00 devstack sudo[99722]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e195e351-d7f9-4215-b4c3-6ae651f7e29c tempest-VolumeQuotasAdminTestJSON-1326538137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-627259a6-b6d8-444c-b057-a1fecb3bc273 1073741824" returned: 0 in 0.885s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e195e351-d7f9-4215-b4c3-6ae651f7e29c tempest-VolumeQuotasAdminTestJSON-1326538137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-627259a6-b6d8-444c-b057-a1fecb3bc273 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:00 devstack sudo[99725]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1a813be9-ec23-4414-bef1-d8f316284cd5 tempest-VolumesSnapshotTestJSON-187705537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-822f6ad8-4f03-465b-a1d8-77ff6133e7dd.72b9eb93-15f0-49a4-91b3-8735fcaf46d9" returned: 0 in 0.848s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1a813be9-ec23-4414-bef1-d8f316284cd5 tempest-VolumesSnapshotTestJSON-187705537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-822f6ad8-4f03-465b-a1d8-77ff6133e7dd.72b9eb93-15f0-49a4-91b3-8735fcaf46d9 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:00 devstack sudo[99733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-627259a6-b6d8-444c-b057-a1fecb3bc273 Nov 06 17:56:00 devstack sudo[99733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:00 devstack sudo[99734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-822f6ad8-4f03-465b-a1d8-77ff6133e7dd.72b9eb93-15f0-49a4-91b3-8735fcaf46d9 Nov 06 17:56:00 devstack sudo[99734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:00 devstack sudo[99733]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e195e351-d7f9-4215-b4c3-6ae651f7e29c tempest-VolumeQuotasAdminTestJSON-1326538137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-627259a6-b6d8-444c-b057-a1fecb3bc273" returned: 0 in 0.626s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:00 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e195e351-d7f9-4215-b4c3-6ae651f7e29c tempest-VolumeQuotasAdminTestJSON-1326538137 None] <== create_volume: return (1610ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:56:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e195e351-d7f9-4215-b4c3-6ae651f7e29c tempest-VolumeQuotasAdminTestJSON-1326538137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.615s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:56:00 devstack sudo[99734]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1a813be9-ec23-4414-bef1-d8f316284cd5 tempest-VolumesSnapshotTestJSON-187705537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-822f6ad8-4f03-465b-a1d8-77ff6133e7dd.72b9eb93-15f0-49a4-91b3-8735fcaf46d9" returned: 0 in 0.624s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e195e351-d7f9-4215-b4c3-6ae651f7e29c tempest-VolumeQuotasAdminTestJSON-1326538137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82d5d4e3-6e8b-4a3e-9bb3-fc0b7cf566b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-627259a6-b6d8-444c-b057-a1fecb3bc273', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:56:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e195e351-d7f9-4215-b4c3-6ae651f7e29c tempest-VolumeQuotasAdminTestJSON-1326538137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (306a2324-6a39-4738-9807-3a84b7323a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:56:01 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1a813be9-ec23-4414-bef1-d8f316284cd5 tempest-VolumesSnapshotTestJSON-187705537 None] Lock "cinder-quobyte-72b9eb93-15f0-49a4-91b3-8735fcaf46d9" released by "_delete_snapshot" :: held 3.332s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:56:01 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-e195e351-d7f9-4215-b4c3-6ae651f7e29c tempest-VolumeQuotasAdminTestJSON-1326538137 None] Volume volume-627259a6-b6d8-444c-b057-a1fecb3bc273 (627259a6-b6d8-444c-b057-a1fecb3bc273): created successfully Nov 06 17:56:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e195e351-d7f9-4215-b4c3-6ae651f7e29c tempest-VolumeQuotasAdminTestJSON-1326538137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (306a2324-6a39-4738-9807-3a84b7323a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:56:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e195e351-d7f9-4215-b4c3-6ae651f7e29c tempest-VolumeQuotasAdminTestJSON-1326538137 None] Flow 'volume_create_manager' (f89de280-58ad-4f49-9ed8-165c5bc6fda8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:56:01 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1a813be9-ec23-4414-bef1-d8f316284cd5 tempest-VolumesSnapshotTestJSON-187705537 None] Lock "cinder-quobyte-822f6ad8-4f03-465b-a1d8-77ff6133e7dd" released by "delete_snapshot" :: held 3.386s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:56:01 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-e195e351-d7f9-4215-b4c3-6ae651f7e29c tempest-VolumeQuotasAdminTestJSON-1326538137 None] Created volume successfully. Nov 06 17:56:01 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-1a813be9-ec23-4414-bef1-d8f316284cd5 tempest-VolumesSnapshotTestJSON-187705537 None] Created reservations ['39222a36-d64f-46ad-b7b8-b7bc2b63f350', 'db78a880-6645-4dc3-9fc9-6a2190846c0f', 'c6b17f65-70f9-447a-8fbd-64dcfe2c345a', '15d7064d-8a41-4c79-852f-b3323d938a1d'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:56:01 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-1a813be9-ec23-4414-bef1-d8f316284cd5 tempest-VolumesSnapshotTestJSON-187705537 None] Delete snapshot completed successfully. Nov 06 17:56:01 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1a813be9-ec23-4414-bef1-d8f316284cd5 tempest-VolumesSnapshotTestJSON-187705537 None] Lock "cinder-72b9eb93-15f0-49a4-91b3-8735fcaf46d9-delete_snapshot" released by "delete_snapshot" :: held 3.824s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:56:01 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c2cc8d6d-3764-40b1-b43b-c32f2529d905 tempest-VolumeQuotasAdminTestJSON-1326538137 None] Acquiring lock "cinder-627259a6-b6d8-444c-b057-a1fecb3bc273-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:56:01 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c2cc8d6d-3764-40b1-b43b-c32f2529d905 tempest-VolumeQuotasAdminTestJSON-1326538137 None] Lock "cinder-627259a6-b6d8-444c-b057-a1fecb3bc273-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:56:01 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c2cc8d6d-3764-40b1-b43b-c32f2529d905 tempest-VolumeQuotasAdminTestJSON-1326538137 None] Acquiring lock "cinder-quobyte-627259a6-b6d8-444c-b057-a1fecb3bc273" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:56:01 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c2cc8d6d-3764-40b1-b43b-c32f2529d905 tempest-VolumeQuotasAdminTestJSON-1326538137 None] Lock "cinder-quobyte-627259a6-b6d8-444c-b057-a1fecb3bc273" acquired by "delete_volume" :: waited 0.027s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:56:01 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[997a39ba-6400-46a0-ab24-c49cfcf6c1a0]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:56:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c2cc8d6d-3764-40b1-b43b-c32f2529d905 tempest-VolumeQuotasAdminTestJSON-1326538137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-627259a6-b6d8-444c-b057-a1fecb3bc273 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:01 devstack sudo[99742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-627259a6-b6d8-444c-b057-a1fecb3bc273 Nov 06 17:56:01 devstack sudo[99742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:02 devstack sudo[99742]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c2cc8d6d-3764-40b1-b43b-c32f2529d905 tempest-VolumeQuotasAdminTestJSON-1326538137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-627259a6-b6d8-444c-b057-a1fecb3bc273" returned: 0 in 0.632s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c2cc8d6d-3764-40b1-b43b-c32f2529d905 tempest-VolumeQuotasAdminTestJSON-1326538137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-627259a6-b6d8-444c-b057-a1fecb3bc273 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:02 devstack sudo[99747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-627259a6-b6d8-444c-b057-a1fecb3bc273 Nov 06 17:56:02 devstack sudo[99747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:02 devstack sudo[99747]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c2cc8d6d-3764-40b1-b43b-c32f2529d905 tempest-VolumeQuotasAdminTestJSON-1326538137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-627259a6-b6d8-444c-b057-a1fecb3bc273" returned: 0 in 0.359s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:02 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c2cc8d6d-3764-40b1-b43b-c32f2529d905 tempest-VolumeQuotasAdminTestJSON-1326538137 None] Lock "cinder-quobyte-627259a6-b6d8-444c-b057-a1fecb3bc273" released by "delete_volume" :: held 1.084s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:56:02 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-c2cc8d6d-3764-40b1-b43b-c32f2529d905 tempest-VolumeQuotasAdminTestJSON-1326538137 None] Created reservations ['2629aff4-6224-4479-97c0-2ff8a6f51751', '6ede9dea-d33f-4c2e-9375-1c796c52cc1b', 'eb466f59-3a06-4b14-96ad-ba2f7b376ed9', 'e1861bd0-c88c-4805-836f-15316d176a29'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:56:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c2cc8d6d-3764-40b1-b43b-c32f2529d905 tempest-VolumeQuotasAdminTestJSON-1326538137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:56:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c2cc8d6d-3764-40b1-b43b-c32f2529d905 tempest-VolumeQuotasAdminTestJSON-1326538137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:56:03 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c2cc8d6d-3764-40b1-b43b-c32f2529d905 tempest-VolumeQuotasAdminTestJSON-1326538137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:56:03 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c2cc8d6d-3764-40b1-b43b-c32f2529d905 tempest-VolumeQuotasAdminTestJSON-1326538137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:56:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c2cc8d6d-3764-40b1-b43b-c32f2529d905 tempest-VolumeQuotasAdminTestJSON-1326538137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:56:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c2cc8d6d-3764-40b1-b43b-c32f2529d905 tempest-VolumeQuotasAdminTestJSON-1326538137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:03 devstack sudo[99750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:56:03 devstack sudo[99750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:03 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd235ba0-ce80-4c5a-a08a-206907363a65 tempest-VolumesSnapshotTestJSON-187705537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:56:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bd235ba0-ce80-4c5a-a08a-206907363a65 tempest-VolumesSnapshotTestJSON-187705537 None] Flow 'volume_create_manager' (eba02698-754f-498c-bcb7-1f8b5b5635de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:56:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bd235ba0-ce80-4c5a-a08a-206907363a65 tempest-VolumesSnapshotTestJSON-187705537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af975e64-eb53-448b-97a2-9644e8b0313d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:56:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bd235ba0-ce80-4c5a-a08a-206907363a65 tempest-VolumesSnapshotTestJSON-187705537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af975e64-eb53-448b-97a2-9644e8b0313d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:56:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-986187385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3c4f339-ccdd-41ae-8080-da3ea64ad688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ec444c1ccd54c3aafbe41d1987ead32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:56:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:56:03Z,use_quota=True,user_id='40043c4a8d004be584aecf793d4b4273',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:56:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bd235ba0-ce80-4c5a-a08a-206907363a65 tempest-VolumesSnapshotTestJSON-187705537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cd5339d-6ff9-4be2-81a5-3b7ad5ea1504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:56:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bd235ba0-ce80-4c5a-a08a-206907363a65 tempest-VolumesSnapshotTestJSON-187705537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cd5339d-6ff9-4be2-81a5-3b7ad5ea1504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:56:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bd235ba0-ce80-4c5a-a08a-206907363a65 tempest-VolumesSnapshotTestJSON-187705537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c72841f-f75a-4738-8fdf-637d0586e83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:56:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bd235ba0-ce80-4c5a-a08a-206907363a65 tempest-VolumesSnapshotTestJSON-187705537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c72841f-f75a-4738-8fdf-637d0586e83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3c4f339-ccdd-41ae-8080-da3ea64ad688', 'volume_name': 'volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:56:03 devstack sudo[99750]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bd235ba0-ce80-4c5a-a08a-206907363a65 tempest-VolumesSnapshotTestJSON-187705537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (460a3703-67d9-450f-b390-cb0337237b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:56:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bd235ba0-ce80-4c5a-a08a-206907363a65 tempest-VolumesSnapshotTestJSON-187705537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (460a3703-67d9-450f-b390-cb0337237b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:56:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bd235ba0-ce80-4c5a-a08a-206907363a65 tempest-VolumesSnapshotTestJSON-187705537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8607a2c1-ef20-4f88-88fc-c65b2d9b6559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:56:03 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-bd235ba0-ce80-4c5a-a08a-206907363a65 tempest-VolumesSnapshotTestJSON-187705537 None] Volume e3c4f339-ccdd-41ae-8080-da3ea64ad688: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688', 'volume_size': 1} Nov 06 17:56:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-bd235ba0-ce80-4c5a-a08a-206907363a65 tempest-VolumesSnapshotTestJSON-187705537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:56:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-bd235ba0-ce80-4c5a-a08a-206907363a65 tempest-VolumesSnapshotTestJSON-187705537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:56:03 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-bd235ba0-ce80-4c5a-a08a-206907363a65 tempest-VolumesSnapshotTestJSON-187705537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:56:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-986187385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3c4f339-ccdd-41ae-8080-da3ea64ad688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ec444c1ccd54c3aafbe41d1987ead32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:56:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:56:03Z,use_quota=True,user_id='40043c4a8d004be584aecf793d4b4273',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:56:03 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-bd235ba0-ce80-4c5a-a08a-206907363a65 tempest-VolumesSnapshotTestJSON-187705537 None] Creating volume e3c4f339-ccdd-41ae-8080-da3ea64ad688 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:56:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-bd235ba0-ce80-4c5a-a08a-206907363a65 tempest-VolumesSnapshotTestJSON-187705537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:56:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-bd235ba0-ce80-4c5a-a08a-206907363a65 tempest-VolumesSnapshotTestJSON-187705537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:56:03 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-bd235ba0-ce80-4c5a-a08a-206907363a65 tempest-VolumesSnapshotTestJSON-187705537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:56:03 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-bd235ba0-ce80-4c5a-a08a-206907363a65 tempest-VolumesSnapshotTestJSON-187705537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:56:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-bd235ba0-ce80-4c5a-a08a-206907363a65 tempest-VolumesSnapshotTestJSON-187705537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:56:03 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-bd235ba0-ce80-4c5a-a08a-206907363a65 tempest-VolumesSnapshotTestJSON-187705537 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:56:03 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-bd235ba0-ce80-4c5a-a08a-206907363a65 tempest-VolumesSnapshotTestJSON-187705537 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:56:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bd235ba0-ce80-4c5a-a08a-206907363a65 tempest-VolumesSnapshotTestJSON-187705537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c2cc8d6d-3764-40b1-b43b-c32f2529d905 tempest-VolumeQuotasAdminTestJSON-1326538137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.405s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:03 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-c2cc8d6d-3764-40b1-b43b-c32f2529d905 tempest-VolumeQuotasAdminTestJSON-1326538137 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:56:03 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-c2cc8d6d-3764-40b1-b43b-c32f2529d905 tempest-VolumeQuotasAdminTestJSON-1326538137 None] Deleted volume successfully. Nov 06 17:56:03 devstack sudo[99753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688 1073741824 Nov 06 17:56:03 devstack sudo[99753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:03 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c2cc8d6d-3764-40b1-b43b-c32f2529d905 tempest-VolumeQuotasAdminTestJSON-1326538137 None] Lock "cinder-627259a6-b6d8-444c-b057-a1fecb3bc273-delete_volume" released by "delete_volume" :: held 2.010s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:56:04 devstack sudo[99753]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bd235ba0-ce80-4c5a-a08a-206907363a65 tempest-VolumesSnapshotTestJSON-187705537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688 1073741824" returned: 0 in 0.794s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bd235ba0-ce80-4c5a-a08a-206907363a65 tempest-VolumesSnapshotTestJSON-187705537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:04 devstack sudo[99759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688 Nov 06 17:56:04 devstack sudo[99759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:04 devstack sudo[99759]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bd235ba0-ce80-4c5a-a08a-206907363a65 tempest-VolumesSnapshotTestJSON-187705537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688" returned: 0 in 0.523s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:04 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-bd235ba0-ce80-4c5a-a08a-206907363a65 tempest-VolumesSnapshotTestJSON-187705537 None] <== create_volume: return (1414ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:56:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-bd235ba0-ce80-4c5a-a08a-206907363a65 tempest-VolumesSnapshotTestJSON-187705537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.418s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:56:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bd235ba0-ce80-4c5a-a08a-206907363a65 tempest-VolumesSnapshotTestJSON-187705537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8607a2c1-ef20-4f88-88fc-c65b2d9b6559) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:56:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bd235ba0-ce80-4c5a-a08a-206907363a65 tempest-VolumesSnapshotTestJSON-187705537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdfaf3d1-dccc-4257-a2a9-06740778807e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:56:04 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-bd235ba0-ce80-4c5a-a08a-206907363a65 tempest-VolumesSnapshotTestJSON-187705537 None] Volume volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688 (e3c4f339-ccdd-41ae-8080-da3ea64ad688): created successfully Nov 06 17:56:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bd235ba0-ce80-4c5a-a08a-206907363a65 tempest-VolumesSnapshotTestJSON-187705537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdfaf3d1-dccc-4257-a2a9-06740778807e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:56:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bd235ba0-ce80-4c5a-a08a-206907363a65 tempest-VolumesSnapshotTestJSON-187705537 None] Flow 'volume_create_manager' (eba02698-754f-498c-bcb7-1f8b5b5635de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:56:04 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-305efde0-f5a2-48ed-9093-e24ace3d9878 tempest-VolumeQuotasAdminTestJSON-1326538137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:56:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-305efde0-f5a2-48ed-9093-e24ace3d9878 tempest-VolumeQuotasAdminTestJSON-1326538137 None] Flow 'volume_create_manager' (017262bd-167b-41b8-872a-22b08d456a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:56:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-305efde0-f5a2-48ed-9093-e24ace3d9878 tempest-VolumeQuotasAdminTestJSON-1326538137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5406739d-2580-4dbb-a2b2-dfa865aa1aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:56:05 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-bd235ba0-ce80-4c5a-a08a-206907363a65 tempest-VolumesSnapshotTestJSON-187705537 None] Created volume successfully. Nov 06 17:56:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-305efde0-f5a2-48ed-9093-e24ace3d9878 tempest-VolumeQuotasAdminTestJSON-1326538137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5406739d-2580-4dbb-a2b2-dfa865aa1aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:56:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1174351142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49af0c77-d3f7-4409-9425-557f14aa9b9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcdad4a9e63446e689071a3c5f4711d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:56:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:56:05Z,use_quota=True,user_id='4c05a30f7f5745a49231cfadbc87d48b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:56:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-305efde0-f5a2-48ed-9093-e24ace3d9878 tempest-VolumeQuotasAdminTestJSON-1326538137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fce49fa5-4da5-4a01-818a-f63479bfffd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:56:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-305efde0-f5a2-48ed-9093-e24ace3d9878 tempest-VolumeQuotasAdminTestJSON-1326538137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fce49fa5-4da5-4a01-818a-f63479bfffd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:56:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-305efde0-f5a2-48ed-9093-e24ace3d9878 tempest-VolumeQuotasAdminTestJSON-1326538137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (221afe34-271f-4054-b1f0-f622c5a9dab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:56:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-305efde0-f5a2-48ed-9093-e24ace3d9878 tempest-VolumeQuotasAdminTestJSON-1326538137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (221afe34-271f-4054-b1f0-f622c5a9dab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49af0c77-d3f7-4409-9425-557f14aa9b9b', 'volume_name': 'volume-49af0c77-d3f7-4409-9425-557f14aa9b9b', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:56:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-305efde0-f5a2-48ed-9093-e24ace3d9878 tempest-VolumeQuotasAdminTestJSON-1326538137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (932a9f85-9365-403b-aaac-70d6dc9398da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:56:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-305efde0-f5a2-48ed-9093-e24ace3d9878 tempest-VolumeQuotasAdminTestJSON-1326538137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (932a9f85-9365-403b-aaac-70d6dc9398da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:56:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-305efde0-f5a2-48ed-9093-e24ace3d9878 tempest-VolumeQuotasAdminTestJSON-1326538137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3818d1dd-f913-4cf8-a508-3cdacfd9f433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:56:05 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-305efde0-f5a2-48ed-9093-e24ace3d9878 tempest-VolumeQuotasAdminTestJSON-1326538137 None] Volume 49af0c77-d3f7-4409-9425-557f14aa9b9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49af0c77-d3f7-4409-9425-557f14aa9b9b', 'volume_size': 1} Nov 06 17:56:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-305efde0-f5a2-48ed-9093-e24ace3d9878 tempest-VolumeQuotasAdminTestJSON-1326538137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:56:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-305efde0-f5a2-48ed-9093-e24ace3d9878 tempest-VolumeQuotasAdminTestJSON-1326538137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:56:05 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-305efde0-f5a2-48ed-9093-e24ace3d9878 tempest-VolumeQuotasAdminTestJSON-1326538137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:56:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1174351142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49af0c77-d3f7-4409-9425-557f14aa9b9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcdad4a9e63446e689071a3c5f4711d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:56:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:56:05Z,use_quota=True,user_id='4c05a30f7f5745a49231cfadbc87d48b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:56:05 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-305efde0-f5a2-48ed-9093-e24ace3d9878 tempest-VolumeQuotasAdminTestJSON-1326538137 None] Creating volume 49af0c77-d3f7-4409-9425-557f14aa9b9b {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:56:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-305efde0-f5a2-48ed-9093-e24ace3d9878 tempest-VolumeQuotasAdminTestJSON-1326538137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:56:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-305efde0-f5a2-48ed-9093-e24ace3d9878 tempest-VolumeQuotasAdminTestJSON-1326538137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:56:05 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-305efde0-f5a2-48ed-9093-e24ace3d9878 tempest-VolumeQuotasAdminTestJSON-1326538137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:56:05 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-305efde0-f5a2-48ed-9093-e24ace3d9878 tempest-VolumeQuotasAdminTestJSON-1326538137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:56:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-305efde0-f5a2-48ed-9093-e24ace3d9878 tempest-VolumeQuotasAdminTestJSON-1326538137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:56:05 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-305efde0-f5a2-48ed-9093-e24ace3d9878 tempest-VolumeQuotasAdminTestJSON-1326538137 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:56:05 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-305efde0-f5a2-48ed-9093-e24ace3d9878 tempest-VolumeQuotasAdminTestJSON-1326538137 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:56:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-305efde0-f5a2-48ed-9093-e24ace3d9878 tempest-VolumeQuotasAdminTestJSON-1326538137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-49af0c77-d3f7-4409-9425-557f14aa9b9b 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:05 devstack sudo[99763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-49af0c77-d3f7-4409-9425-557f14aa9b9b 1073741824 Nov 06 17:56:05 devstack sudo[99763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-53d5dde9-2fe5-4916-984b-1580b3d9b993 tempest-VolumesSnapshotTestJSON-187705537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:56:06 devstack sudo[99763]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-305efde0-f5a2-48ed-9093-e24ace3d9878 tempest-VolumeQuotasAdminTestJSON-1326538137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-49af0c77-d3f7-4409-9425-557f14aa9b9b 1073741824" returned: 0 in 0.920s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-305efde0-f5a2-48ed-9093-e24ace3d9878 tempest-VolumeQuotasAdminTestJSON-1326538137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-49af0c77-d3f7-4409-9425-557f14aa9b9b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:06 devstack sudo[99770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-49af0c77-d3f7-4409-9425-557f14aa9b9b Nov 06 17:56:06 devstack sudo[99770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:06 devstack sudo[99770]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-305efde0-f5a2-48ed-9093-e24ace3d9878 tempest-VolumeQuotasAdminTestJSON-1326538137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-49af0c77-d3f7-4409-9425-557f14aa9b9b" returned: 0 in 0.318s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-305efde0-f5a2-48ed-9093-e24ace3d9878 tempest-VolumeQuotasAdminTestJSON-1326538137 None] <== create_volume: return (1309ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:56:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-305efde0-f5a2-48ed-9093-e24ace3d9878 tempest-VolumeQuotasAdminTestJSON-1326538137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.311s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:56:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-53d5dde9-2fe5-4916-984b-1580b3d9b993 tempest-VolumesSnapshotTestJSON-187705537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.410s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:56:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-305efde0-f5a2-48ed-9093-e24ace3d9878 tempest-VolumeQuotasAdminTestJSON-1326538137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3818d1dd-f913-4cf8-a508-3cdacfd9f433) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49af0c77-d3f7-4409-9425-557f14aa9b9b', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:56:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-305efde0-f5a2-48ed-9093-e24ace3d9878 tempest-VolumeQuotasAdminTestJSON-1326538137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b8b2f7e-533d-4d61-9ea5-29215d797fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:56:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-53d5dde9-2fe5-4916-984b-1580b3d9b993 tempest-VolumesSnapshotTestJSON-187705537 None] Creating offline snapshot e78a4b00-75c9-4572-9147-38eb8c648ab6 of volume e3c4f339-ccdd-41ae-8080-da3ea64ad688 {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 17:56:06 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8ac949-b7f4-4494-aa79-80d3223423be]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:56:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-53d5dde9-2fe5-4916-984b-1580b3d9b993 tempest-VolumesSnapshotTestJSON-187705537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:06 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-305efde0-f5a2-48ed-9093-e24ace3d9878 tempest-VolumeQuotasAdminTestJSON-1326538137 None] Volume volume-49af0c77-d3f7-4409-9425-557f14aa9b9b (49af0c77-d3f7-4409-9425-557f14aa9b9b): created successfully Nov 06 17:56:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-305efde0-f5a2-48ed-9093-e24ace3d9878 tempest-VolumeQuotasAdminTestJSON-1326538137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b8b2f7e-533d-4d61-9ea5-29215d797fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:56:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-305efde0-f5a2-48ed-9093-e24ace3d9878 tempest-VolumeQuotasAdminTestJSON-1326538137 None] Flow 'volume_create_manager' (017262bd-167b-41b8-872a-22b08d456a72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:56:06 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-305efde0-f5a2-48ed-9093-e24ace3d9878 tempest-VolumeQuotasAdminTestJSON-1326538137 None] Created volume successfully. Nov 06 17:56:06 devstack sudo[99797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688 Nov 06 17:56:06 devstack sudo[99797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:07 devstack sudo[99797]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-53d5dde9-2fe5-4916-984b-1580b3d9b993 tempest-VolumesSnapshotTestJSON-187705537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688" returned: 0 in 0.566s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-53d5dde9-2fe5-4916-984b-1580b3d9b993 tempest-VolumesSnapshotTestJSON-187705537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688.e78a4b00-75c9-4572-9147-38eb8c648ab6 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:07 devstack sudo[99802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688.e78a4b00-75c9-4572-9147-38eb8c648ab6 1G Nov 06 17:56:07 devstack sudo[99802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:07 devstack sudo[99802]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-53d5dde9-2fe5-4916-984b-1580b3d9b993 tempest-VolumesSnapshotTestJSON-187705537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688.e78a4b00-75c9-4572-9147-38eb8c648ab6 1G" returned: 0 in 0.595s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-53d5dde9-2fe5-4916-984b-1580b3d9b993 tempest-VolumesSnapshotTestJSON-187705537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688.e78a4b00-75c9-4572-9147-38eb8c648ab6 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:07 devstack sudo[99809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688.e78a4b00-75c9-4572-9147-38eb8c648ab6 Nov 06 17:56:07 devstack sudo[99809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:07 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-5ead04a3-ac01-47bc-968a-cf55d0f25c01 tempest-VolumeQuotasAdminTestJSON-109993064 None] Transfer volume completed successfully. Nov 06 17:56:08 devstack sudo[99809]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-53d5dde9-2fe5-4916-984b-1580b3d9b993 tempest-VolumesSnapshotTestJSON-187705537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688.e78a4b00-75c9-4572-9147-38eb8c648ab6" returned: 0 in 0.422s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:08 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-53d5dde9-2fe5-4916-984b-1580b3d9b993 tempest-VolumesSnapshotTestJSON-187705537 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688.e78a4b00-75c9-4572-9147-38eb8c648ab6 is being set with open permissions: ugo+rw Nov 06 17:56:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-53d5dde9-2fe5-4916-984b-1580b3d9b993 tempest-VolumesSnapshotTestJSON-187705537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688.e78a4b00-75c9-4572-9147-38eb8c648ab6 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:08 devstack sudo[99817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688.e78a4b00-75c9-4572-9147-38eb8c648ab6 Nov 06 17:56:08 devstack sudo[99817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:08 devstack sudo[99817]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-53d5dde9-2fe5-4916-984b-1580b3d9b993 tempest-VolumesSnapshotTestJSON-187705537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688.e78a4b00-75c9-4572-9147-38eb8c648ab6" returned: 0 in 0.357s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-53d5dde9-2fe5-4916-984b-1580b3d9b993 tempest-VolumesSnapshotTestJSON-187705537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:08 devstack sudo[99820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688.info Nov 06 17:56:08 devstack sudo[99820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:08 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f9d0a568-9b17-405e-9518-8904ef7c86fe tempest-VolumeQuotasAdminTestJSON-671541447 None] Acquiring lock "cinder-49af0c77-d3f7-4409-9425-557f14aa9b9b-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:56:08 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f9d0a568-9b17-405e-9518-8904ef7c86fe tempest-VolumeQuotasAdminTestJSON-671541447 None] Lock "cinder-49af0c77-d3f7-4409-9425-557f14aa9b9b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:56:08 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f9d0a568-9b17-405e-9518-8904ef7c86fe tempest-VolumeQuotasAdminTestJSON-671541447 None] Acquiring lock "cinder-quobyte-49af0c77-d3f7-4409-9425-557f14aa9b9b" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:56:08 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f9d0a568-9b17-405e-9518-8904ef7c86fe tempest-VolumeQuotasAdminTestJSON-671541447 None] Lock "cinder-quobyte-49af0c77-d3f7-4409-9425-557f14aa9b9b" acquired by "delete_volume" :: waited 0.028s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:56:08 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7225ba-ef99-42d0-987c-ec18f456ecd3]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:56:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f9d0a568-9b17-405e-9518-8904ef7c86fe tempest-VolumeQuotasAdminTestJSON-671541447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-49af0c77-d3f7-4409-9425-557f14aa9b9b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:08 devstack sudo[99822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-49af0c77-d3f7-4409-9425-557f14aa9b9b Nov 06 17:56:08 devstack sudo[99822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:08 devstack sudo[99820]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-53d5dde9-2fe5-4916-984b-1580b3d9b993 tempest-VolumesSnapshotTestJSON-187705537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688.info" returned: 0 in 0.461s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:08 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-53d5dde9-2fe5-4916-984b-1580b3d9b993 tempest-VolumesSnapshotTestJSON-187705537 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688.info is being set with open permissions: ugo+rw Nov 06 17:56:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-53d5dde9-2fe5-4916-984b-1580b3d9b993 tempest-VolumesSnapshotTestJSON-187705537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:09 devstack sudo[99825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688.info Nov 06 17:56:09 devstack sudo[99825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:09 devstack sudo[99825]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-53d5dde9-2fe5-4916-984b-1580b3d9b993 tempest-VolumesSnapshotTestJSON-187705537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688.info" returned: 0 in 0.319s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-53d5dde9-2fe5-4916-984b-1580b3d9b993 tempest-VolumesSnapshotTestJSON-187705537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.879s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:56:09 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-53d5dde9-2fe5-4916-984b-1580b3d9b993 tempest-VolumesSnapshotTestJSON-187705537 None] Create snapshot completed successfully Nov 06 17:56:09 devstack sudo[99822]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f9d0a568-9b17-405e-9518-8904ef7c86fe tempest-VolumeQuotasAdminTestJSON-671541447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-49af0c77-d3f7-4409-9425-557f14aa9b9b" returned: 0 in 0.576s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f9d0a568-9b17-405e-9518-8904ef7c86fe tempest-VolumeQuotasAdminTestJSON-671541447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-49af0c77-d3f7-4409-9425-557f14aa9b9b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:09 devstack sudo[99831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-49af0c77-d3f7-4409-9425-557f14aa9b9b Nov 06 17:56:09 devstack sudo[99831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:09 devstack sudo[99831]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f9d0a568-9b17-405e-9518-8904ef7c86fe tempest-VolumeQuotasAdminTestJSON-671541447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-49af0c77-d3f7-4409-9425-557f14aa9b9b" returned: 0 in 0.288s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:09 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f9d0a568-9b17-405e-9518-8904ef7c86fe tempest-VolumeQuotasAdminTestJSON-671541447 None] Lock "cinder-quobyte-49af0c77-d3f7-4409-9425-557f14aa9b9b" released by "delete_volume" :: held 0.957s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:56:09 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-f9d0a568-9b17-405e-9518-8904ef7c86fe tempest-VolumeQuotasAdminTestJSON-671541447 None] Created reservations ['aa45195f-1770-49a9-9db6-c7591882beca', 'ada7464e-ce38-4510-91e6-41b623743e4b', '49caaf03-af2f-4e77-ae3f-7215fe763142', 'b214a74c-7294-4468-b54d-26b631089c80'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:56:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f9d0a568-9b17-405e-9518-8904ef7c86fe tempest-VolumeQuotasAdminTestJSON-671541447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:56:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f9d0a568-9b17-405e-9518-8904ef7c86fe tempest-VolumeQuotasAdminTestJSON-671541447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:56:09 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f9d0a568-9b17-405e-9518-8904ef7c86fe tempest-VolumeQuotasAdminTestJSON-671541447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:56:09 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f9d0a568-9b17-405e-9518-8904ef7c86fe tempest-VolumeQuotasAdminTestJSON-671541447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:56:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f9d0a568-9b17-405e-9518-8904ef7c86fe tempest-VolumeQuotasAdminTestJSON-671541447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:56:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f9d0a568-9b17-405e-9518-8904ef7c86fe tempest-VolumeQuotasAdminTestJSON-671541447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:09 devstack sudo[99844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:56:09 devstack sudo[99844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:10 devstack sudo[99844]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f9d0a568-9b17-405e-9518-8904ef7c86fe tempest-VolumeQuotasAdminTestJSON-671541447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.332s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:10 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-f9d0a568-9b17-405e-9518-8904ef7c86fe tempest-VolumeQuotasAdminTestJSON-671541447 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:56:10 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-f9d0a568-9b17-405e-9518-8904ef7c86fe tempest-VolumeQuotasAdminTestJSON-671541447 None] Deleted volume successfully. Nov 06 17:56:10 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f9d0a568-9b17-405e-9518-8904ef7c86fe tempest-VolumeQuotasAdminTestJSON-671541447 None] Lock "cinder-49af0c77-d3f7-4409-9425-557f14aa9b9b-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:56:10 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4d669cf-e880-4506-afd1-7ccf6c4a8bee tempest-VolumesSnapshotTestJSON-187705537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:56:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c4d669cf-e880-4506-afd1-7ccf6c4a8bee tempest-VolumesSnapshotTestJSON-187705537 None] Flow 'volume_create_manager' (4f0ef0bc-7d11-4279-93ed-8f6be58c7b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:56:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c4d669cf-e880-4506-afd1-7ccf6c4a8bee tempest-VolumesSnapshotTestJSON-187705537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70a7ac1b-7512-4e44-82f3-5d5a976d8b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:56:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c4d669cf-e880-4506-afd1-7ccf6c4a8bee tempest-VolumesSnapshotTestJSON-187705537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70a7ac1b-7512-4e44-82f3-5d5a976d8b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1293342837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d5b7d06-5e22-4f70-a0cf-c7cc8ac8dad9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ec444c1ccd54c3aafbe41d1987ead32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:56:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=e78a4b00-75c9-4572-9147-38eb8c648ab6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:56:11Z,use_quota=True,user_id='40043c4a8d004be584aecf793d4b4273',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:56:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c4d669cf-e880-4506-afd1-7ccf6c4a8bee tempest-VolumesSnapshotTestJSON-187705537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d19290a-9027-42ce-933b-a99558373179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:56:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c4d669cf-e880-4506-afd1-7ccf6c4a8bee tempest-VolumesSnapshotTestJSON-187705537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d19290a-9027-42ce-933b-a99558373179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:56:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c4d669cf-e880-4506-afd1-7ccf6c4a8bee tempest-VolumesSnapshotTestJSON-187705537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1c25cea-3f59-471e-9bdd-cf8a4889b268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:56:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c4d669cf-e880-4506-afd1-7ccf6c4a8bee tempest-VolumesSnapshotTestJSON-187705537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1c25cea-3f59-471e-9bdd-cf8a4889b268) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3d5b7d06-5e22-4f70-a0cf-c7cc8ac8dad9', 'volume_name': 'volume-3d5b7d06-5e22-4f70-a0cf-c7cc8ac8dad9', 'volume_size': 2, 'snapshot_id': 'e78a4b00-75c9-4572-9147-38eb8c648ab6'}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:56:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c4d669cf-e880-4506-afd1-7ccf6c4a8bee tempest-VolumesSnapshotTestJSON-187705537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfc2a095-dc19-43cc-b3b5-332f0bce84e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:56:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c4d669cf-e880-4506-afd1-7ccf6c4a8bee tempest-VolumesSnapshotTestJSON-187705537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfc2a095-dc19-43cc-b3b5-332f0bce84e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:56:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c4d669cf-e880-4506-afd1-7ccf6c4a8bee tempest-VolumesSnapshotTestJSON-187705537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e94b8061-7bbb-4285-9b08-e26464b62845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:56:10 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-c4d669cf-e880-4506-afd1-7ccf6c4a8bee tempest-VolumesSnapshotTestJSON-187705537 None] Volume 3d5b7d06-5e22-4f70-a0cf-c7cc8ac8dad9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3d5b7d06-5e22-4f70-a0cf-c7cc8ac8dad9', 'volume_size': 2, 'snapshot_id': 'e78a4b00-75c9-4572-9147-38eb8c648ab6'} Nov 06 17:56:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c4d669cf-e880-4506-afd1-7ccf6c4a8bee tempest-VolumesSnapshotTestJSON-187705537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:56:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c4d669cf-e880-4506-afd1-7ccf6c4a8bee tempest-VolumesSnapshotTestJSON-187705537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:56:10 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c4d669cf-e880-4506-afd1-7ccf6c4a8bee tempest-VolumesSnapshotTestJSON-187705537 None] Acquiring lock "cinder-quobyte-e78a4b00-75c9-4572-9147-38eb8c648ab6-3d5b7d06-5e22-4f70-a0cf-c7cc8ac8dad9" by "_create_volume_from_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:56:10 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c4d669cf-e880-4506-afd1-7ccf6c4a8bee tempest-VolumesSnapshotTestJSON-187705537 None] Lock "cinder-quobyte-e78a4b00-75c9-4572-9147-38eb8c648ab6-3d5b7d06-5e22-4f70-a0cf-c7cc8ac8dad9" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:56:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c4d669cf-e880-4506-afd1-7ccf6c4a8bee tempest-VolumesSnapshotTestJSON-187705537 None] Creating volume 3d5b7d06-5e22-4f70-a0cf-c7cc8ac8dad9 from snapshot e78a4b00-75c9-4572-9147-38eb8c648ab6 {{(pid=87068) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 17:56:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c4d669cf-e880-4506-afd1-7ccf6c4a8bee tempest-VolumesSnapshotTestJSON-187705537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:56:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c4d669cf-e880-4506-afd1-7ccf6c4a8bee tempest-VolumesSnapshotTestJSON-187705537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:56:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c4d669cf-e880-4506-afd1-7ccf6c4a8bee tempest-VolumesSnapshotTestJSON-187705537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:56:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c4d669cf-e880-4506-afd1-7ccf6c4a8bee tempest-VolumesSnapshotTestJSON-187705537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:56:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c4d669cf-e880-4506-afd1-7ccf6c4a8bee tempest-VolumesSnapshotTestJSON-187705537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:56:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c4d669cf-e880-4506-afd1-7ccf6c4a8bee tempest-VolumesSnapshotTestJSON-187705537 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:56:10 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c4d669cf-e880-4506-afd1-7ccf6c4a8bee tempest-VolumesSnapshotTestJSON-187705537 None] Acquiring lock "cinder-quobyte-3d5b7d06-5e22-4f70-a0cf-c7cc8ac8dad9" by "_copy_volume_from_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:56:11 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c4d669cf-e880-4506-afd1-7ccf6c4a8bee tempest-VolumesSnapshotTestJSON-187705537 None] Lock "cinder-quobyte-3d5b7d06-5e22-4f70-a0cf-c7cc8ac8dad9" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:56:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c4d669cf-e880-4506-afd1-7ccf6c4a8bee tempest-VolumesSnapshotTestJSON-187705537 None] snapshot: e78a4b00-75c9-4572-9147-38eb8c648ab6, volume: 3d5b7d06-5e22-4f70-a0cf-c7cc8ac8dad9, {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 17:56:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c4d669cf-e880-4506-afd1-7ccf6c4a8bee tempest-VolumesSnapshotTestJSON-187705537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:56:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c4d669cf-e880-4506-afd1-7ccf6c4a8bee tempest-VolumesSnapshotTestJSON-187705537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:56:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c4d669cf-e880-4506-afd1-7ccf6c4a8bee tempest-VolumesSnapshotTestJSON-187705537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:56:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c4d669cf-e880-4506-afd1-7ccf6c4a8bee tempest-VolumesSnapshotTestJSON-187705537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:56:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c4d669cf-e880-4506-afd1-7ccf6c4a8bee tempest-VolumesSnapshotTestJSON-187705537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:56:11 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[547d557e-7575-4de6-bcd7-d8b2fea7d287]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:56:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c4d669cf-e880-4506-afd1-7ccf6c4a8bee tempest-VolumesSnapshotTestJSON-187705537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688.e78a4b00-75c9-4572-9147-38eb8c648ab6 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:11 devstack sudo[99848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688.e78a4b00-75c9-4572-9147-38eb8c648ab6 Nov 06 17:56:11 devstack sudo[99848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:11 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-097c591f-d253-4519-a783-a1fa0f4fe034 tempest-VolumesNegativeTest-249218523 None] Acquiring lock "cinder-052cd28f-1f4a-4e1b-ad8d-e539320c6002-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:56:11 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-097c591f-d253-4519-a783-a1fa0f4fe034 tempest-VolumesNegativeTest-249218523 None] Lock "cinder-052cd28f-1f4a-4e1b-ad8d-e539320c6002-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:56:11 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-097c591f-d253-4519-a783-a1fa0f4fe034 tempest-VolumesNegativeTest-249218523 None] Acquiring lock "cinder-quobyte-052cd28f-1f4a-4e1b-ad8d-e539320c6002" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:56:11 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-097c591f-d253-4519-a783-a1fa0f4fe034 tempest-VolumesNegativeTest-249218523 None] Lock "cinder-quobyte-052cd28f-1f4a-4e1b-ad8d-e539320c6002" acquired by "delete_volume" :: waited 0.020s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:56:11 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[55bd0593-998f-491d-8b08-8676166872ae]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:56:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-097c591f-d253-4519-a783-a1fa0f4fe034 tempest-VolumesNegativeTest-249218523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-052cd28f-1f4a-4e1b-ad8d-e539320c6002 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:11 devstack sudo[99848]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c4d669cf-e880-4506-afd1-7ccf6c4a8bee tempest-VolumesSnapshotTestJSON-187705537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688.e78a4b00-75c9-4572-9147-38eb8c648ab6" returned: 0 in 0.493s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-c4d669cf-e880-4506-afd1-7ccf6c4a8bee tempest-VolumesSnapshotTestJSON-187705537 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 17:56:11 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb3ba3d-3af6-4e3d-8ae1-9243af55e123]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:56:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c4d669cf-e880-4506-afd1-7ccf6c4a8bee tempest-VolumesSnapshotTestJSON-187705537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:11 devstack sudo[99852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-052cd28f-1f4a-4e1b-ad8d-e539320c6002 Nov 06 17:56:11 devstack sudo[99852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:11 devstack sudo[99854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688 Nov 06 17:56:11 devstack sudo[99854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:11 devstack sudo[99852]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-097c591f-d253-4519-a783-a1fa0f4fe034 tempest-VolumesNegativeTest-249218523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-052cd28f-1f4a-4e1b-ad8d-e539320c6002" returned: 0 in 0.416s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-097c591f-d253-4519-a783-a1fa0f4fe034 tempest-VolumesNegativeTest-249218523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-052cd28f-1f4a-4e1b-ad8d-e539320c6002 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:11 devstack sudo[99860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-052cd28f-1f4a-4e1b-ad8d-e539320c6002 Nov 06 17:56:11 devstack sudo[99860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:12 devstack sudo[99854]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c4d669cf-e880-4506-afd1-7ccf6c4a8bee tempest-VolumesSnapshotTestJSON-187705537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688" returned: 0 in 0.417s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:12 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c4d669cf-e880-4506-afd1-7ccf6c4a8bee tempest-VolumesSnapshotTestJSON-187705537 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688 {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 17:56:12 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c4d669cf-e880-4506-afd1-7ccf6c4a8bee tempest-VolumesSnapshotTestJSON-187705537 None] Creating direct copy from snapshot {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 17:56:12 devstack cinder-volume[87068]: DEBUG cinder.utils [None req-c4d669cf-e880-4506-afd1-7ccf6c4a8bee tempest-VolumesSnapshotTestJSON-187705537 None] Path /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d5b7d06-5e22-4f70-a0cf-c7cc8ac8dad9 not found in is_blk_device check {{(pid=87068) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 17:56:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c4d669cf-e880-4506-afd1-7ccf6c4a8bee tempest-VolumesSnapshotTestJSON-187705537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d5b7d06-5e22-4f70-a0cf-c7cc8ac8dad9 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:12 devstack sudo[99866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d5b7d06-5e22-4f70-a0cf-c7cc8ac8dad9 Nov 06 17:56:12 devstack sudo[99866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:12 devstack sudo[99860]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-097c591f-d253-4519-a783-a1fa0f4fe034 tempest-VolumesNegativeTest-249218523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-052cd28f-1f4a-4e1b-ad8d-e539320c6002" returned: 0 in 0.317s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:12 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-097c591f-d253-4519-a783-a1fa0f4fe034 tempest-VolumesNegativeTest-249218523 None] Lock "cinder-quobyte-052cd28f-1f4a-4e1b-ad8d-e539320c6002" released by "delete_volume" :: held 0.790s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:56:12 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-097c591f-d253-4519-a783-a1fa0f4fe034 tempest-VolumesNegativeTest-249218523 None] Created reservations ['a70d652d-2fcb-4537-a526-8da293db4cf8', '8775d605-91b7-49c5-be96-4b2dfa8eb430', '7a76934f-d934-4c93-ac03-24abbef2fc36', 'c816f527-e94f-4c4b-a2f5-bf25f426dd34'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:56:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-097c591f-d253-4519-a783-a1fa0f4fe034 tempest-VolumesNegativeTest-249218523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:56:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-097c591f-d253-4519-a783-a1fa0f4fe034 tempest-VolumesNegativeTest-249218523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:56:12 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-097c591f-d253-4519-a783-a1fa0f4fe034 tempest-VolumesNegativeTest-249218523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:56:12 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-097c591f-d253-4519-a783-a1fa0f4fe034 tempest-VolumesNegativeTest-249218523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:56:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-097c591f-d253-4519-a783-a1fa0f4fe034 tempest-VolumesNegativeTest-249218523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:56:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-097c591f-d253-4519-a783-a1fa0f4fe034 tempest-VolumesNegativeTest-249218523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:12 devstack sudo[99873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:56:12 devstack sudo[99873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:12 devstack sudo[99873]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-097c591f-d253-4519-a783-a1fa0f4fe034 tempest-VolumesNegativeTest-249218523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.402s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:12 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-097c591f-d253-4519-a783-a1fa0f4fe034 tempest-VolumesNegativeTest-249218523 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:56:12 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-097c591f-d253-4519-a783-a1fa0f4fe034 tempest-VolumesNegativeTest-249218523 None] Deleted volume successfully. Nov 06 17:56:12 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-097c591f-d253-4519-a783-a1fa0f4fe034 tempest-VolumesNegativeTest-249218523 None] Lock "cinder-052cd28f-1f4a-4e1b-ad8d-e539320c6002-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:56:21 devstack sudo[99866]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c4d669cf-e880-4506-afd1-7ccf6c4a8bee tempest-VolumesSnapshotTestJSON-187705537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d5b7d06-5e22-4f70-a0cf-c7cc8ac8dad9" returned: 0 in 9.454s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:21 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-c4d669cf-e880-4506-afd1-7ccf6c4a8bee tempest-VolumesSnapshotTestJSON-187705537 None] Image conversion details: src /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688, size 1024.00 MB, duration 9.45 sec, destination /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d5b7d06-5e22-4f70-a0cf-c7cc8ac8dad9 {{(pid=87068) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 17:56:21 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-c4d669cf-e880-4506-afd1-7ccf6c4a8bee tempest-VolumesSnapshotTestJSON-187705537 None] Converted 1024.00 MB image at 108.30 MB/s Nov 06 17:56:21 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-c4d669cf-e880-4506-afd1-7ccf6c4a8bee tempest-VolumesSnapshotTestJSON-187705537 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d5b7d06-5e22-4f70-a0cf-c7cc8ac8dad9 is being set with open permissions: ugo+rw Nov 06 17:56:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c4d669cf-e880-4506-afd1-7ccf6c4a8bee tempest-VolumesSnapshotTestJSON-187705537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d5b7d06-5e22-4f70-a0cf-c7cc8ac8dad9 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:21 devstack sudo[99897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d5b7d06-5e22-4f70-a0cf-c7cc8ac8dad9 Nov 06 17:56:21 devstack sudo[99897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:21 devstack sudo[99897]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c4d669cf-e880-4506-afd1-7ccf6c4a8bee tempest-VolumesSnapshotTestJSON-187705537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d5b7d06-5e22-4f70-a0cf-c7cc8ac8dad9" returned: 0 in 0.358s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c4d669cf-e880-4506-afd1-7ccf6c4a8bee tempest-VolumesSnapshotTestJSON-187705537 None] Lock "cinder-quobyte-3d5b7d06-5e22-4f70-a0cf-c7cc8ac8dad9" released by "_copy_volume_from_snapshot" :: held 10.860s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:56:21 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=102,cinder:UPDATE=109,cinder:INSERT=29,cinder:DELETE=10 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 17:56:21 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:UPDATE=113,cinder:SELECT=95,cinder:INSERT=29,cinder:DELETE=10 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 17:56:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c4d669cf-e880-4506-afd1-7ccf6c4a8bee tempest-VolumesSnapshotTestJSON-187705537 None] Lock "cinder-quobyte-e78a4b00-75c9-4572-9147-38eb8c648ab6-3d5b7d06-5e22-4f70-a0cf-c7cc8ac8dad9" released by "_create_volume_from_snapshot" :: held 10.973s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:56:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c4d669cf-e880-4506-afd1-7ccf6c4a8bee tempest-VolumesSnapshotTestJSON-187705537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.997s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:56:21 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c4d669cf-e880-4506-afd1-7ccf6c4a8bee tempest-VolumesSnapshotTestJSON-187705537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e94b8061-7bbb-4285-9b08-e26464b62845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d5b7d06-5e22-4f70-a0cf-c7cc8ac8dad9', 'volume_size': 2, 'snapshot_id': 'e78a4b00-75c9-4572-9147-38eb8c648ab6'}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:56:22 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c4d669cf-e880-4506-afd1-7ccf6c4a8bee tempest-VolumesSnapshotTestJSON-187705537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2c43a85-36f3-4dae-a733-2d5910f6a5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:56:22 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-c4d669cf-e880-4506-afd1-7ccf6c4a8bee tempest-VolumesSnapshotTestJSON-187705537 None] Volume volume-3d5b7d06-5e22-4f70-a0cf-c7cc8ac8dad9 (3d5b7d06-5e22-4f70-a0cf-c7cc8ac8dad9): created successfully Nov 06 17:56:22 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c4d669cf-e880-4506-afd1-7ccf6c4a8bee tempest-VolumesSnapshotTestJSON-187705537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2c43a85-36f3-4dae-a733-2d5910f6a5e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:56:22 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c4d669cf-e880-4506-afd1-7ccf6c4a8bee tempest-VolumesSnapshotTestJSON-187705537 None] Flow 'volume_create_manager' (4f0ef0bc-7d11-4279-93ed-8f6be58c7b4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:56:22 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-c4d669cf-e880-4506-afd1-7ccf6c4a8bee tempest-VolumesSnapshotTestJSON-187705537 None] Created volume successfully. Nov 06 17:56:22 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b206ffdb-2b72-4064-bb73-a3d3e14732b9 tempest-VolumesSnapshotTestJSON-187705537 None] Acquiring lock "cinder-3d5b7d06-5e22-4f70-a0cf-c7cc8ac8dad9-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:56:22 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b206ffdb-2b72-4064-bb73-a3d3e14732b9 tempest-VolumesSnapshotTestJSON-187705537 None] Lock "cinder-3d5b7d06-5e22-4f70-a0cf-c7cc8ac8dad9-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:56:22 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b206ffdb-2b72-4064-bb73-a3d3e14732b9 tempest-VolumesSnapshotTestJSON-187705537 None] Acquiring lock "cinder-quobyte-3d5b7d06-5e22-4f70-a0cf-c7cc8ac8dad9" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:56:22 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b206ffdb-2b72-4064-bb73-a3d3e14732b9 tempest-VolumesSnapshotTestJSON-187705537 None] Lock "cinder-quobyte-3d5b7d06-5e22-4f70-a0cf-c7cc8ac8dad9" acquired by "delete_volume" :: waited 0.026s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:56:22 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbda0e62-14a0-43da-970b-049ed2b44eaa]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:56:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b206ffdb-2b72-4064-bb73-a3d3e14732b9 tempest-VolumesSnapshotTestJSON-187705537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d5b7d06-5e22-4f70-a0cf-c7cc8ac8dad9 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:22 devstack sudo[99906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d5b7d06-5e22-4f70-a0cf-c7cc8ac8dad9 Nov 06 17:56:22 devstack sudo[99906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-893e822a-012a-4497-9c63-2ca95a9d9654 req-551af0f4-3621-45e0-9a65-25a1ecf07b51 tempest-TestInstancesWithCinderVolumes-1921145433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:56:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-893e822a-012a-4497-9c63-2ca95a9d9654 req-551af0f4-3621-45e0-9a65-25a1ecf07b51 tempest-TestInstancesWithCinderVolumes-1921145433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:56:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-893e822a-012a-4497-9c63-2ca95a9d9654 req-551af0f4-3621-45e0-9a65-25a1ecf07b51 tempest-TestInstancesWithCinderVolumes-1921145433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:56:22 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-893e822a-012a-4497-9c63-2ca95a9d9654 req-551af0f4-3621-45e0-9a65-25a1ecf07b51 tempest-TestInstancesWithCinderVolumes-1921145433 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072', 'name': 'volume-629b05cd-98a5-4d26-a9e1-64b94c3e9a69', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '16b0088a-62d3-40c4-81c7-30b4ae4eff64', 'enforce_multipath': True} {{(pid=87068) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 17:56:22 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-893e822a-012a-4497-9c63-2ca95a9d9654 req-551af0f4-3621-45e0-9a65-25a1ecf07b51 tempest-TestInstancesWithCinderVolumes-1921145433 None] attachment_update completed successfully. Nov 06 17:56:22 devstack sudo[99906]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b206ffdb-2b72-4064-bb73-a3d3e14732b9 tempest-VolumesSnapshotTestJSON-187705537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d5b7d06-5e22-4f70-a0cf-c7cc8ac8dad9" returned: 0 in 0.491s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b206ffdb-2b72-4064-bb73-a3d3e14732b9 tempest-VolumesSnapshotTestJSON-187705537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d5b7d06-5e22-4f70-a0cf-c7cc8ac8dad9 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:22 devstack sudo[99914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d5b7d06-5e22-4f70-a0cf-c7cc8ac8dad9 Nov 06 17:56:22 devstack sudo[99914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:23 devstack sudo[99914]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b206ffdb-2b72-4064-bb73-a3d3e14732b9 tempest-VolumesSnapshotTestJSON-187705537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3d5b7d06-5e22-4f70-a0cf-c7cc8ac8dad9" returned: 0 in 0.345s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:23 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b206ffdb-2b72-4064-bb73-a3d3e14732b9 tempest-VolumesSnapshotTestJSON-187705537 None] Lock "cinder-quobyte-3d5b7d06-5e22-4f70-a0cf-c7cc8ac8dad9" released by "delete_volume" :: held 0.906s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:56:23 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-b206ffdb-2b72-4064-bb73-a3d3e14732b9 tempest-VolumesSnapshotTestJSON-187705537 None] Created reservations ['4d56a728-88d4-438c-85b1-c419f31b5178', '1050801d-a977-4cb4-ac3b-0bfce28e24fc', '2b8d04ac-ecf0-4e2e-b16f-347160813c21', 'c4243360-5ae2-4576-8eb3-6df039fdb734'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:56:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b206ffdb-2b72-4064-bb73-a3d3e14732b9 tempest-VolumesSnapshotTestJSON-187705537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:56:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b206ffdb-2b72-4064-bb73-a3d3e14732b9 tempest-VolumesSnapshotTestJSON-187705537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:56:23 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b206ffdb-2b72-4064-bb73-a3d3e14732b9 tempest-VolumesSnapshotTestJSON-187705537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:56:23 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b206ffdb-2b72-4064-bb73-a3d3e14732b9 tempest-VolumesSnapshotTestJSON-187705537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:56:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b206ffdb-2b72-4064-bb73-a3d3e14732b9 tempest-VolumesSnapshotTestJSON-187705537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:56:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b206ffdb-2b72-4064-bb73-a3d3e14732b9 tempest-VolumesSnapshotTestJSON-187705537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:23 devstack sudo[99918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:56:23 devstack sudo[99918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:23 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d71cda6-711d-4bb3-b489-d22edeb3f176 tempest-VolumesServicesTestJSON-1413449626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:56:23 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6d71cda6-711d-4bb3-b489-d22edeb3f176 tempest-VolumesServicesTestJSON-1413449626 None] Flow 'volume_create_manager' (d1dd04a7-0293-4712-9744-55c8e385a92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:56:23 devstack sudo[99918]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:23 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6d71cda6-711d-4bb3-b489-d22edeb3f176 tempest-VolumesServicesTestJSON-1413449626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (603c6b4b-efde-4bec-b04f-60f114c88cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:56:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b206ffdb-2b72-4064-bb73-a3d3e14732b9 tempest-VolumesSnapshotTestJSON-187705537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.304s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:23 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-b206ffdb-2b72-4064-bb73-a3d3e14732b9 tempest-VolumesSnapshotTestJSON-187705537 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:56:23 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-b206ffdb-2b72-4064-bb73-a3d3e14732b9 tempest-VolumesSnapshotTestJSON-187705537 None] Deleted volume successfully. Nov 06 17:56:23 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6d71cda6-711d-4bb3-b489-d22edeb3f176 tempest-VolumesServicesTestJSON-1413449626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (603c6b4b-efde-4bec-b04f-60f114c88cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:56:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-884307655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ece6df2f-8fdf-4876-b4f1-8f56624ad17f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c34ccc6eb9f64705901419e3443919c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:56:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:56:24Z,use_quota=True,user_id='40a0fe8d4aeb485781d46ac001439843',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:56:23 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6d71cda6-711d-4bb3-b489-d22edeb3f176 tempest-VolumesServicesTestJSON-1413449626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a0b4786-b2bb-4f28-b5c2-26a27c58bbf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:56:23 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6d71cda6-711d-4bb3-b489-d22edeb3f176 tempest-VolumesServicesTestJSON-1413449626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a0b4786-b2bb-4f28-b5c2-26a27c58bbf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:56:23 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6d71cda6-711d-4bb3-b489-d22edeb3f176 tempest-VolumesServicesTestJSON-1413449626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06737d74-dffd-4559-9de3-9ffabd22f7cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:56:23 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6d71cda6-711d-4bb3-b489-d22edeb3f176 tempest-VolumesServicesTestJSON-1413449626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06737d74-dffd-4559-9de3-9ffabd22f7cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ece6df2f-8fdf-4876-b4f1-8f56624ad17f', 'volume_name': 'volume-ece6df2f-8fdf-4876-b4f1-8f56624ad17f', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:56:23 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6d71cda6-711d-4bb3-b489-d22edeb3f176 tempest-VolumesServicesTestJSON-1413449626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38a769d9-cc9d-4f72-8fd2-07adb8ce2e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:56:23 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6d71cda6-711d-4bb3-b489-d22edeb3f176 tempest-VolumesServicesTestJSON-1413449626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38a769d9-cc9d-4f72-8fd2-07adb8ce2e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:56:23 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6d71cda6-711d-4bb3-b489-d22edeb3f176 tempest-VolumesServicesTestJSON-1413449626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cf81d07-4b35-454f-bdb1-6eccdbfbfe8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:56:23 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-6d71cda6-711d-4bb3-b489-d22edeb3f176 tempest-VolumesServicesTestJSON-1413449626 None] Volume ece6df2f-8fdf-4876-b4f1-8f56624ad17f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ece6df2f-8fdf-4876-b4f1-8f56624ad17f', 'volume_size': 1} Nov 06 17:56:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6d71cda6-711d-4bb3-b489-d22edeb3f176 tempest-VolumesServicesTestJSON-1413449626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:56:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6d71cda6-711d-4bb3-b489-d22edeb3f176 tempest-VolumesServicesTestJSON-1413449626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:56:23 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-6d71cda6-711d-4bb3-b489-d22edeb3f176 tempest-VolumesServicesTestJSON-1413449626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:56:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-884307655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ece6df2f-8fdf-4876-b4f1-8f56624ad17f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c34ccc6eb9f64705901419e3443919c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:56:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:56:24Z,use_quota=True,user_id='40a0fe8d4aeb485781d46ac001439843',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:56:23 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-6d71cda6-711d-4bb3-b489-d22edeb3f176 tempest-VolumesServicesTestJSON-1413449626 None] Creating volume ece6df2f-8fdf-4876-b4f1-8f56624ad17f {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:56:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6d71cda6-711d-4bb3-b489-d22edeb3f176 tempest-VolumesServicesTestJSON-1413449626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:56:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6d71cda6-711d-4bb3-b489-d22edeb3f176 tempest-VolumesServicesTestJSON-1413449626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:56:23 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-6d71cda6-711d-4bb3-b489-d22edeb3f176 tempest-VolumesServicesTestJSON-1413449626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:56:23 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-6d71cda6-711d-4bb3-b489-d22edeb3f176 tempest-VolumesServicesTestJSON-1413449626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:56:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6d71cda6-711d-4bb3-b489-d22edeb3f176 tempest-VolumesServicesTestJSON-1413449626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:56:23 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-6d71cda6-711d-4bb3-b489-d22edeb3f176 tempest-VolumesServicesTestJSON-1413449626 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:56:23 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-6d71cda6-711d-4bb3-b489-d22edeb3f176 tempest-VolumesServicesTestJSON-1413449626 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:56:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6d71cda6-711d-4bb3-b489-d22edeb3f176 tempest-VolumesServicesTestJSON-1413449626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ece6df2f-8fdf-4876-b4f1-8f56624ad17f 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:23 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b206ffdb-2b72-4064-bb73-a3d3e14732b9 tempest-VolumesSnapshotTestJSON-187705537 None] Lock "cinder-3d5b7d06-5e22-4f70-a0cf-c7cc8ac8dad9-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:56:23 devstack sudo[99921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ece6df2f-8fdf-4876-b4f1-8f56624ad17f 1073741824 Nov 06 17:56:23 devstack sudo[99921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:24 devstack sudo[99921]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6d71cda6-711d-4bb3-b489-d22edeb3f176 tempest-VolumesServicesTestJSON-1413449626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ece6df2f-8fdf-4876-b4f1-8f56624ad17f 1073741824" returned: 0 in 0.457s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6d71cda6-711d-4bb3-b489-d22edeb3f176 tempest-VolumesServicesTestJSON-1413449626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ece6df2f-8fdf-4876-b4f1-8f56624ad17f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:24 devstack sudo[99927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ece6df2f-8fdf-4876-b4f1-8f56624ad17f Nov 06 17:56:24 devstack sudo[99927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:24 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-33951ba8-b9d8-41c7-8a60-e18ed274c5dc tempest-VolumesSnapshotTestJSON-187705537 None] Acquiring lock "cinder-e78a4b00-75c9-4572-9147-38eb8c648ab6-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:56:24 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-33951ba8-b9d8-41c7-8a60-e18ed274c5dc tempest-VolumesSnapshotTestJSON-187705537 None] Lock "cinder-e78a4b00-75c9-4572-9147-38eb8c648ab6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:56:24 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-33951ba8-b9d8-41c7-8a60-e18ed274c5dc tempest-VolumesSnapshotTestJSON-187705537 None] Acquiring lock "cinder-quobyte-e3c4f339-ccdd-41ae-8080-da3ea64ad688" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:56:24 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-33951ba8-b9d8-41c7-8a60-e18ed274c5dc tempest-VolumesSnapshotTestJSON-187705537 None] Lock "cinder-quobyte-e3c4f339-ccdd-41ae-8080-da3ea64ad688" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:56:24 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-33951ba8-b9d8-41c7-8a60-e18ed274c5dc tempest-VolumesSnapshotTestJSON-187705537 None] Acquiring lock "cinder-quobyte-e78a4b00-75c9-4572-9147-38eb8c648ab6" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:56:24 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-33951ba8-b9d8-41c7-8a60-e18ed274c5dc tempest-VolumesSnapshotTestJSON-187705537 None] Lock "cinder-quobyte-e78a4b00-75c9-4572-9147-38eb8c648ab6" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:56:24 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-33951ba8-b9d8-41c7-8a60-e18ed274c5dc tempest-VolumesSnapshotTestJSON-187705537 None] Deleting offline snapshot e78a4b00-75c9-4572-9147-38eb8c648ab6 of volume e3c4f339-ccdd-41ae-8080-da3ea64ad688 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 17:56:24 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-33951ba8-b9d8-41c7-8a60-e18ed274c5dc tempest-VolumesSnapshotTestJSON-187705537 None] snapshot_file for this snap is: volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688.e78a4b00-75c9-4572-9147-38eb8c648ab6 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 17:56:24 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0e04fa-ba65-4f4f-a597-cc89635046f7]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:56:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-33951ba8-b9d8-41c7-8a60-e18ed274c5dc tempest-VolumesSnapshotTestJSON-187705537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688.e78a4b00-75c9-4572-9147-38eb8c648ab6 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:24 devstack sudo[99927]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6d71cda6-711d-4bb3-b489-d22edeb3f176 tempest-VolumesServicesTestJSON-1413449626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ece6df2f-8fdf-4876-b4f1-8f56624ad17f" returned: 0 in 0.408s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:24 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-6d71cda6-711d-4bb3-b489-d22edeb3f176 tempest-VolumesServicesTestJSON-1413449626 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:56:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6d71cda6-711d-4bb3-b489-d22edeb3f176 tempest-VolumesServicesTestJSON-1413449626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:56:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6d71cda6-711d-4bb3-b489-d22edeb3f176 tempest-VolumesServicesTestJSON-1413449626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cf81d07-4b35-454f-bdb1-6eccdbfbfe8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ece6df2f-8fdf-4876-b4f1-8f56624ad17f', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:56:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6d71cda6-711d-4bb3-b489-d22edeb3f176 tempest-VolumesServicesTestJSON-1413449626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdab8e8e-9c40-4e1a-8425-3ce8e16a8336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:56:24 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-6d71cda6-711d-4bb3-b489-d22edeb3f176 tempest-VolumesServicesTestJSON-1413449626 None] Volume volume-ece6df2f-8fdf-4876-b4f1-8f56624ad17f (ece6df2f-8fdf-4876-b4f1-8f56624ad17f): created successfully Nov 06 17:56:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6d71cda6-711d-4bb3-b489-d22edeb3f176 tempest-VolumesServicesTestJSON-1413449626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdab8e8e-9c40-4e1a-8425-3ce8e16a8336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:56:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6d71cda6-711d-4bb3-b489-d22edeb3f176 tempest-VolumesServicesTestJSON-1413449626 None] Flow 'volume_create_manager' (d1dd04a7-0293-4712-9744-55c8e385a92d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:56:24 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-6d71cda6-711d-4bb3-b489-d22edeb3f176 tempest-VolumesServicesTestJSON-1413449626 None] Created volume successfully. Nov 06 17:56:24 devstack sudo[99934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688.e78a4b00-75c9-4572-9147-38eb8c648ab6 Nov 06 17:56:24 devstack sudo[99934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:25 devstack sudo[99934]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-33951ba8-b9d8-41c7-8a60-e18ed274c5dc tempest-VolumesSnapshotTestJSON-187705537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688.e78a4b00-75c9-4572-9147-38eb8c648ab6" returned: 0 in 0.421s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:25 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-33951ba8-b9d8-41c7-8a60-e18ed274c5dc tempest-VolumesSnapshotTestJSON-187705537 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 17:56:25 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7575a42c-2015-4476-8c1f-f5fda5cf75a8]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:56:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-33951ba8-b9d8-41c7-8a60-e18ed274c5dc tempest-VolumesSnapshotTestJSON-187705537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:25 devstack sudo[99945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688 Nov 06 17:56:25 devstack sudo[99945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:25 devstack sudo[99945]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-33951ba8-b9d8-41c7-8a60-e18ed274c5dc tempest-VolumesSnapshotTestJSON-187705537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688" returned: 0 in 0.644s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-33951ba8-b9d8-41c7-8a60-e18ed274c5dc tempest-VolumesSnapshotTestJSON-187705537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688.e78a4b00-75c9-4572-9147-38eb8c648ab6 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:25 devstack sudo[99959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688.e78a4b00-75c9-4572-9147-38eb8c648ab6 Nov 06 17:56:25 devstack sudo[99959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-596b0807-a816-4cb9-9025-21e77c58fb8d req-199015a6-5c2a-4716-b75f-a5e6806f6e31 tempest-TestInstancesWithCinderVolumes-1921145433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:56:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-596b0807-a816-4cb9-9025-21e77c58fb8d req-199015a6-5c2a-4716-b75f-a5e6806f6e31 tempest-TestInstancesWithCinderVolumes-1921145433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:56:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-596b0807-a816-4cb9-9025-21e77c58fb8d req-199015a6-5c2a-4716-b75f-a5e6806f6e31 tempest-TestInstancesWithCinderVolumes-1921145433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:56:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-596b0807-a816-4cb9-9025-21e77c58fb8d req-199015a6-5c2a-4716-b75f-a5e6806f6e31 tempest-TestInstancesWithCinderVolumes-1921145433 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072', 'name': 'volume-f7b1b28a-23b2-4790-a6d8-ed28e51c5c00', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '737f1ac0-d22c-4dbb-9c62-d2430e32f0e2', 'enforce_multipath': True} {{(pid=87068) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 17:56:26 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-445be55a-3b3a-47f0-9d48-28c608f9d1e4 tempest-VolumesServicesTestJSON-1413449626 None] Acquiring lock "cinder-ece6df2f-8fdf-4876-b4f1-8f56624ad17f-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:56:26 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-445be55a-3b3a-47f0-9d48-28c608f9d1e4 tempest-VolumesServicesTestJSON-1413449626 None] Lock "cinder-ece6df2f-8fdf-4876-b4f1-8f56624ad17f-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:56:26 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-596b0807-a816-4cb9-9025-21e77c58fb8d req-199015a6-5c2a-4716-b75f-a5e6806f6e31 tempest-TestInstancesWithCinderVolumes-1921145433 None] attachment_update completed successfully. Nov 06 17:56:26 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-445be55a-3b3a-47f0-9d48-28c608f9d1e4 tempest-VolumesServicesTestJSON-1413449626 None] Acquiring lock "cinder-quobyte-ece6df2f-8fdf-4876-b4f1-8f56624ad17f" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:56:26 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-445be55a-3b3a-47f0-9d48-28c608f9d1e4 tempest-VolumesServicesTestJSON-1413449626 None] Lock "cinder-quobyte-ece6df2f-8fdf-4876-b4f1-8f56624ad17f" acquired by "delete_volume" :: waited 0.022s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:56:26 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab407352-22dc-4c37-92df-d281686e852e]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:56:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-445be55a-3b3a-47f0-9d48-28c608f9d1e4 tempest-VolumesServicesTestJSON-1413449626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ece6df2f-8fdf-4876-b4f1-8f56624ad17f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:26 devstack sudo[99959]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-33951ba8-b9d8-41c7-8a60-e18ed274c5dc tempest-VolumesSnapshotTestJSON-187705537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688.e78a4b00-75c9-4572-9147-38eb8c648ab6" returned: 0 in 0.665s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-33951ba8-b9d8-41c7-8a60-e18ed274c5dc tempest-VolumesSnapshotTestJSON-187705537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688.e78a4b00-75c9-4572-9147-38eb8c648ab6 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:26 devstack sudo[99968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688.e78a4b00-75c9-4572-9147-38eb8c648ab6 Nov 06 17:56:26 devstack sudo[99968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:26 devstack sudo[99966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ece6df2f-8fdf-4876-b4f1-8f56624ad17f Nov 06 17:56:26 devstack sudo[99966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:27 devstack sudo[99966]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-445be55a-3b3a-47f0-9d48-28c608f9d1e4 tempest-VolumesServicesTestJSON-1413449626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ece6df2f-8fdf-4876-b4f1-8f56624ad17f" returned: 0 in 0.538s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-445be55a-3b3a-47f0-9d48-28c608f9d1e4 tempest-VolumesServicesTestJSON-1413449626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ece6df2f-8fdf-4876-b4f1-8f56624ad17f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:27 devstack sudo[99974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ece6df2f-8fdf-4876-b4f1-8f56624ad17f Nov 06 17:56:27 devstack sudo[99974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:27 devstack sudo[99968]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-33951ba8-b9d8-41c7-8a60-e18ed274c5dc tempest-VolumesSnapshotTestJSON-187705537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688.e78a4b00-75c9-4572-9147-38eb8c648ab6" returned: 0 in 0.560s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:27 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-33951ba8-b9d8-41c7-8a60-e18ed274c5dc tempest-VolumesSnapshotTestJSON-187705537 None] Lock "cinder-quobyte-e78a4b00-75c9-4572-9147-38eb8c648ab6" released by "_delete_snapshot" :: held 2.462s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:56:27 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-33951ba8-b9d8-41c7-8a60-e18ed274c5dc tempest-VolumesSnapshotTestJSON-187705537 None] Lock "cinder-quobyte-e3c4f339-ccdd-41ae-8080-da3ea64ad688" released by "delete_snapshot" :: held 2.500s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:56:27 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-33951ba8-b9d8-41c7-8a60-e18ed274c5dc tempest-VolumesSnapshotTestJSON-187705537 None] Created reservations ['dfc66384-043c-4427-bf28-a9138d9cbb77', 'ae95e1df-86c4-4726-80e0-ee3d342d16eb', 'da558228-d564-4ba6-a179-5541271959e2', '67ad1e4f-df02-47d7-b04a-33cc46ace85a'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:56:27 devstack sudo[99974]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-445be55a-3b3a-47f0-9d48-28c608f9d1e4 tempest-VolumesServicesTestJSON-1413449626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ece6df2f-8fdf-4876-b4f1-8f56624ad17f" returned: 0 in 0.338s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:27 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-445be55a-3b3a-47f0-9d48-28c608f9d1e4 tempest-VolumesServicesTestJSON-1413449626 None] Lock "cinder-quobyte-ece6df2f-8fdf-4876-b4f1-8f56624ad17f" released by "delete_volume" :: held 0.950s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:56:27 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-33951ba8-b9d8-41c7-8a60-e18ed274c5dc tempest-VolumesSnapshotTestJSON-187705537 None] Delete snapshot completed successfully. Nov 06 17:56:27 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-33951ba8-b9d8-41c7-8a60-e18ed274c5dc tempest-VolumesSnapshotTestJSON-187705537 None] Lock "cinder-e78a4b00-75c9-4572-9147-38eb8c648ab6-delete_snapshot" released by "delete_snapshot" :: held 2.735s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:56:27 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-445be55a-3b3a-47f0-9d48-28c608f9d1e4 tempest-VolumesServicesTestJSON-1413449626 None] Created reservations ['6f7ac7dc-bfd2-4050-9352-914962575b9d', '28514b72-b937-4938-84e4-d69586996ca3', 'b2cc81bc-4f5f-4387-b137-6b4b7f2558e2', '4c59f394-11a7-4d2a-a4ba-7bb8224c0c1e'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:56:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-445be55a-3b3a-47f0-9d48-28c608f9d1e4 tempest-VolumesServicesTestJSON-1413449626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:56:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-445be55a-3b3a-47f0-9d48-28c608f9d1e4 tempest-VolumesServicesTestJSON-1413449626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:56:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-445be55a-3b3a-47f0-9d48-28c608f9d1e4 tempest-VolumesServicesTestJSON-1413449626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:56:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-445be55a-3b3a-47f0-9d48-28c608f9d1e4 tempest-VolumesServicesTestJSON-1413449626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:56:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-445be55a-3b3a-47f0-9d48-28c608f9d1e4 tempest-VolumesServicesTestJSON-1413449626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:56:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-445be55a-3b3a-47f0-9d48-28c608f9d1e4 tempest-VolumesServicesTestJSON-1413449626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:27 devstack sudo[99978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:56:27 devstack sudo[99978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:27 devstack sudo[99978]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-445be55a-3b3a-47f0-9d48-28c608f9d1e4 tempest-VolumesServicesTestJSON-1413449626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.280s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:27 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-445be55a-3b3a-47f0-9d48-28c608f9d1e4 tempest-VolumesServicesTestJSON-1413449626 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:56:27 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-445be55a-3b3a-47f0-9d48-28c608f9d1e4 tempest-VolumesServicesTestJSON-1413449626 None] Deleted volume successfully. Nov 06 17:56:27 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-445be55a-3b3a-47f0-9d48-28c608f9d1e4 tempest-VolumesServicesTestJSON-1413449626 None] Lock "cinder-ece6df2f-8fdf-4876-b4f1-8f56624ad17f-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:56:28 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8dc72653-95b8-407d-b077-6229a16d0469 tempest-VolumesSnapshotTestJSON-187705537 None] Acquiring lock "cinder-e3c4f339-ccdd-41ae-8080-da3ea64ad688-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:56:28 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8dc72653-95b8-407d-b077-6229a16d0469 tempest-VolumesSnapshotTestJSON-187705537 None] Lock "cinder-e3c4f339-ccdd-41ae-8080-da3ea64ad688-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:56:28 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8dc72653-95b8-407d-b077-6229a16d0469 tempest-VolumesSnapshotTestJSON-187705537 None] Acquiring lock "cinder-quobyte-e3c4f339-ccdd-41ae-8080-da3ea64ad688" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:56:28 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8dc72653-95b8-407d-b077-6229a16d0469 tempest-VolumesSnapshotTestJSON-187705537 None] Lock "cinder-quobyte-e3c4f339-ccdd-41ae-8080-da3ea64ad688" acquired by "delete_volume" :: waited 0.035s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:56:28 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[de177350-a675-43aa-a739-c3fcce7fab88]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:56:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8dc72653-95b8-407d-b077-6229a16d0469 tempest-VolumesSnapshotTestJSON-187705537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:28 devstack sudo[99985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688 Nov 06 17:56:28 devstack sudo[99985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:28 devstack sudo[99985]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8dc72653-95b8-407d-b077-6229a16d0469 tempest-VolumesSnapshotTestJSON-187705537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688" returned: 0 in 0.547s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8dc72653-95b8-407d-b077-6229a16d0469 tempest-VolumesSnapshotTestJSON-187705537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:28 devstack sudo[99994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688 Nov 06 17:56:28 devstack sudo[99994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:29 devstack sudo[99994]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8dc72653-95b8-407d-b077-6229a16d0469 tempest-VolumesSnapshotTestJSON-187705537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e3c4f339-ccdd-41ae-8080-da3ea64ad688" returned: 0 in 0.478s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:29 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8dc72653-95b8-407d-b077-6229a16d0469 tempest-VolumesSnapshotTestJSON-187705537 None] Lock "cinder-quobyte-e3c4f339-ccdd-41ae-8080-da3ea64ad688" released by "delete_volume" :: held 1.115s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:56:29 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-8dc72653-95b8-407d-b077-6229a16d0469 tempest-VolumesSnapshotTestJSON-187705537 None] Created reservations ['b4625815-8272-46c9-8ab3-a7fee72fee45', '81d7117e-5145-46f8-ab4a-fe398d2aaa2b', '0251f425-ac1e-46a9-962a-7b428fd613a4', 'c46a7baa-5a70-4f94-b711-79303a2d1bcd'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:56:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8dc72653-95b8-407d-b077-6229a16d0469 tempest-VolumesSnapshotTestJSON-187705537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:56:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8dc72653-95b8-407d-b077-6229a16d0469 tempest-VolumesSnapshotTestJSON-187705537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:56:29 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8dc72653-95b8-407d-b077-6229a16d0469 tempest-VolumesSnapshotTestJSON-187705537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:56:29 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8dc72653-95b8-407d-b077-6229a16d0469 tempest-VolumesSnapshotTestJSON-187705537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:56:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8dc72653-95b8-407d-b077-6229a16d0469 tempest-VolumesSnapshotTestJSON-187705537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:56:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8dc72653-95b8-407d-b077-6229a16d0469 tempest-VolumesSnapshotTestJSON-187705537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:29 devstack sudo[99997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:56:29 devstack sudo[99997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:29 devstack sudo[99997]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8dc72653-95b8-407d-b077-6229a16d0469 tempest-VolumesSnapshotTestJSON-187705537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.346s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:29 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-8dc72653-95b8-407d-b077-6229a16d0469 tempest-VolumesSnapshotTestJSON-187705537 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:56:29 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-8dc72653-95b8-407d-b077-6229a16d0469 tempest-VolumesSnapshotTestJSON-187705537 None] Deleted volume successfully. Nov 06 17:56:29 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8dc72653-95b8-407d-b077-6229a16d0469 tempest-VolumesSnapshotTestJSON-187705537 None] Lock "cinder-e3c4f339-ccdd-41ae-8080-da3ea64ad688-delete_volume" released by "delete_volume" :: held 1.778s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:56:31 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-2733d755-5d43-40f5-afa0-01cabd35947d tempest-VolumesSnapshotTestJSON-187705537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:56:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2733d755-5d43-40f5-afa0-01cabd35947d tempest-VolumesSnapshotTestJSON-187705537 None] Flow 'volume_create_manager' (9e97426e-8983-40eb-940a-c046b7c42d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:56:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2733d755-5d43-40f5-afa0-01cabd35947d tempest-VolumesSnapshotTestJSON-187705537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82de2b75-08f5-4250-a800-669a956d34c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:56:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2733d755-5d43-40f5-afa0-01cabd35947d tempest-VolumesSnapshotTestJSON-187705537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82de2b75-08f5-4250-a800-669a956d34c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1647292605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b3b271c-4b28-4fef-b704-3f054ca43c89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ec444c1ccd54c3aafbe41d1987ead32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:56:31Z,use_quota=True,user_id='40043c4a8d004be584aecf793d4b4273',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:56:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2733d755-5d43-40f5-afa0-01cabd35947d tempest-VolumesSnapshotTestJSON-187705537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15f8e196-9631-446b-b734-eec4b16c976a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:56:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2733d755-5d43-40f5-afa0-01cabd35947d tempest-VolumesSnapshotTestJSON-187705537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15f8e196-9631-446b-b734-eec4b16c976a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:56:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2733d755-5d43-40f5-afa0-01cabd35947d tempest-VolumesSnapshotTestJSON-187705537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9d5d222-772f-4556-a0c5-a42bfabdd524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:56:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2733d755-5d43-40f5-afa0-01cabd35947d tempest-VolumesSnapshotTestJSON-187705537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9d5d222-772f-4556-a0c5-a42bfabdd524) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b3b271c-4b28-4fef-b704-3f054ca43c89', 'volume_name': 'volume-7b3b271c-4b28-4fef-b704-3f054ca43c89', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:56:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2733d755-5d43-40f5-afa0-01cabd35947d tempest-VolumesSnapshotTestJSON-187705537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac629143-f83f-45f7-a3c2-55ea59cd4f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:56:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2733d755-5d43-40f5-afa0-01cabd35947d tempest-VolumesSnapshotTestJSON-187705537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac629143-f83f-45f7-a3c2-55ea59cd4f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:56:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2733d755-5d43-40f5-afa0-01cabd35947d tempest-VolumesSnapshotTestJSON-187705537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d64f0b77-b07a-4163-8adb-d72327eb45a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:56:31 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-2733d755-5d43-40f5-afa0-01cabd35947d tempest-VolumesSnapshotTestJSON-187705537 None] Volume 7b3b271c-4b28-4fef-b704-3f054ca43c89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b3b271c-4b28-4fef-b704-3f054ca43c89', 'volume_size': 1} Nov 06 17:56:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2733d755-5d43-40f5-afa0-01cabd35947d tempest-VolumesSnapshotTestJSON-187705537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:56:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2733d755-5d43-40f5-afa0-01cabd35947d tempest-VolumesSnapshotTestJSON-187705537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:56:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2733d755-5d43-40f5-afa0-01cabd35947d tempest-VolumesSnapshotTestJSON-187705537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1647292605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b3b271c-4b28-4fef-b704-3f054ca43c89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ec444c1ccd54c3aafbe41d1987ead32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:56:31Z,use_quota=True,user_id='40043c4a8d004be584aecf793d4b4273',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:56:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-2733d755-5d43-40f5-afa0-01cabd35947d tempest-VolumesSnapshotTestJSON-187705537 None] Creating volume 7b3b271c-4b28-4fef-b704-3f054ca43c89 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:56:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2733d755-5d43-40f5-afa0-01cabd35947d tempest-VolumesSnapshotTestJSON-187705537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:56:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2733d755-5d43-40f5-afa0-01cabd35947d tempest-VolumesSnapshotTestJSON-187705537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:56:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2733d755-5d43-40f5-afa0-01cabd35947d tempest-VolumesSnapshotTestJSON-187705537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:56:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2733d755-5d43-40f5-afa0-01cabd35947d tempest-VolumesSnapshotTestJSON-187705537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:56:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2733d755-5d43-40f5-afa0-01cabd35947d tempest-VolumesSnapshotTestJSON-187705537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:56:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2733d755-5d43-40f5-afa0-01cabd35947d tempest-VolumesSnapshotTestJSON-187705537 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:56:31 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-2733d755-5d43-40f5-afa0-01cabd35947d tempest-VolumesSnapshotTestJSON-187705537 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:56:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2733d755-5d43-40f5-afa0-01cabd35947d tempest-VolumesSnapshotTestJSON-187705537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7b3b271c-4b28-4fef-b704-3f054ca43c89 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:31 devstack sudo[100007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7b3b271c-4b28-4fef-b704-3f054ca43c89 1073741824 Nov 06 17:56:31 devstack sudo[100007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:32 devstack sudo[100007]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2733d755-5d43-40f5-afa0-01cabd35947d tempest-VolumesSnapshotTestJSON-187705537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7b3b271c-4b28-4fef-b704-3f054ca43c89 1073741824" returned: 0 in 0.781s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2733d755-5d43-40f5-afa0-01cabd35947d tempest-VolumesSnapshotTestJSON-187705537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7b3b271c-4b28-4fef-b704-3f054ca43c89 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:32 devstack sudo[100028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7b3b271c-4b28-4fef-b704-3f054ca43c89 Nov 06 17:56:32 devstack sudo[100028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:32 devstack sudo[100028]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2733d755-5d43-40f5-afa0-01cabd35947d tempest-VolumesSnapshotTestJSON-187705537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7b3b271c-4b28-4fef-b704-3f054ca43c89" returned: 0 in 0.315s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2733d755-5d43-40f5-afa0-01cabd35947d tempest-VolumesSnapshotTestJSON-187705537 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:56:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2733d755-5d43-40f5-afa0-01cabd35947d tempest-VolumesSnapshotTestJSON-187705537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:56:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2733d755-5d43-40f5-afa0-01cabd35947d tempest-VolumesSnapshotTestJSON-187705537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d64f0b77-b07a-4163-8adb-d72327eb45a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b3b271c-4b28-4fef-b704-3f054ca43c89', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:56:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2733d755-5d43-40f5-afa0-01cabd35947d tempest-VolumesSnapshotTestJSON-187705537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c7ebc99-f74d-4b13-8a87-085aeebde119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:56:32 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-2733d755-5d43-40f5-afa0-01cabd35947d tempest-VolumesSnapshotTestJSON-187705537 None] Volume volume-7b3b271c-4b28-4fef-b704-3f054ca43c89 (7b3b271c-4b28-4fef-b704-3f054ca43c89): created successfully Nov 06 17:56:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2733d755-5d43-40f5-afa0-01cabd35947d tempest-VolumesSnapshotTestJSON-187705537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c7ebc99-f74d-4b13-8a87-085aeebde119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:56:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2733d755-5d43-40f5-afa0-01cabd35947d tempest-VolumesSnapshotTestJSON-187705537 None] Flow 'volume_create_manager' (9e97426e-8983-40eb-940a-c046b7c42d12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:56:32 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-2733d755-5d43-40f5-afa0-01cabd35947d tempest-VolumesSnapshotTestJSON-187705537 None] Created volume successfully. Nov 06 17:56:33 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-fc7e1d21-c8b8-4d2f-9d19-cc692c2474e5 req-382320cf-2e09-413e-92a7-3461504312c7 tempest-TestInstancesWithCinderVolumes-1921145433 None] Terminate volume connection completed successfully. Nov 06 17:56:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-fc7e1d21-c8b8-4d2f-9d19-cc692c2474e5 req-382320cf-2e09-413e-92a7-3461504312c7 tempest-TestInstancesWithCinderVolumes-1921145433 None] Deleting attachment 16b0088a-62d3-40c4-81c7-30b4ae4eff64. {{(pid=87068) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 17:56:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4ef29a57-8804-4f94-a80c-4c8792328567 tempest-VolumesSnapshotTestJSON-187705537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:56:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4ef29a57-8804-4f94-a80c-4c8792328567 tempest-VolumesSnapshotTestJSON-187705537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:56:33 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-4ef29a57-8804-4f94-a80c-4c8792328567 tempest-VolumesSnapshotTestJSON-187705537 None] Creating offline snapshot e47745dd-23c7-4b51-bbd6-0895b5ee67ff of volume 7b3b271c-4b28-4fef-b704-3f054ca43c89 {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 17:56:33 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86dc655-a7e7-49dd-8a78-272cfb2f85ce]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:56:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4ef29a57-8804-4f94-a80c-4c8792328567 tempest-VolumesSnapshotTestJSON-187705537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7b3b271c-4b28-4fef-b704-3f054ca43c89 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:33 devstack sudo[100035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7b3b271c-4b28-4fef-b704-3f054ca43c89 Nov 06 17:56:33 devstack sudo[100035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:33 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ea982b0d-cf77-4913-9364-660c04a62b82 tempest-TestInstancesWithCinderVolumes-1921145433 None] Acquiring lock "cinder-629b05cd-98a5-4d26-a9e1-64b94c3e9a69-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:56:33 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ea982b0d-cf77-4913-9364-660c04a62b82 tempest-TestInstancesWithCinderVolumes-1921145433 None] Lock "cinder-629b05cd-98a5-4d26-a9e1-64b94c3e9a69-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:56:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ea982b0d-cf77-4913-9364-660c04a62b82 tempest-TestInstancesWithCinderVolumes-1921145433 None] Acquiring lock "cinder-quobyte-629b05cd-98a5-4d26-a9e1-64b94c3e9a69" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:56:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ea982b0d-cf77-4913-9364-660c04a62b82 tempest-TestInstancesWithCinderVolumes-1921145433 None] Lock "cinder-quobyte-629b05cd-98a5-4d26-a9e1-64b94c3e9a69" acquired by "delete_volume" :: waited 0.015s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:56:34 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f2392a-5232-4734-8c20-2b05558f7ff6]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:56:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ea982b0d-cf77-4913-9364-660c04a62b82 tempest-TestInstancesWithCinderVolumes-1921145433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-629b05cd-98a5-4d26-a9e1-64b94c3e9a69 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:34 devstack sudo[100035]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4ef29a57-8804-4f94-a80c-4c8792328567 tempest-VolumesSnapshotTestJSON-187705537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7b3b271c-4b28-4fef-b704-3f054ca43c89" returned: 0 in 0.599s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4ef29a57-8804-4f94-a80c-4c8792328567 tempest-VolumesSnapshotTestJSON-187705537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7b3b271c-4b28-4fef-b704-3f054ca43c89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7b3b271c-4b28-4fef-b704-3f054ca43c89.e47745dd-23c7-4b51-bbd6-0895b5ee67ff 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:34 devstack sudo[100046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7b3b271c-4b28-4fef-b704-3f054ca43c89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7b3b271c-4b28-4fef-b704-3f054ca43c89.e47745dd-23c7-4b51-bbd6-0895b5ee67ff 1G Nov 06 17:56:34 devstack sudo[100046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:34 devstack sudo[100045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-629b05cd-98a5-4d26-a9e1-64b94c3e9a69 Nov 06 17:56:34 devstack sudo[100045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:34 devstack sudo[100045]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ea982b0d-cf77-4913-9364-660c04a62b82 tempest-TestInstancesWithCinderVolumes-1921145433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-629b05cd-98a5-4d26-a9e1-64b94c3e9a69" returned: 0 in 0.650s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ea982b0d-cf77-4913-9364-660c04a62b82 tempest-TestInstancesWithCinderVolumes-1921145433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-629b05cd-98a5-4d26-a9e1-64b94c3e9a69 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:34 devstack sudo[100046]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:34 devstack sudo[100056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-629b05cd-98a5-4d26-a9e1-64b94c3e9a69 Nov 06 17:56:34 devstack sudo[100056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4ef29a57-8804-4f94-a80c-4c8792328567 tempest-VolumesSnapshotTestJSON-187705537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7b3b271c-4b28-4fef-b704-3f054ca43c89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7b3b271c-4b28-4fef-b704-3f054ca43c89.e47745dd-23c7-4b51-bbd6-0895b5ee67ff 1G" returned: 0 in 0.646s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4ef29a57-8804-4f94-a80c-4c8792328567 tempest-VolumesSnapshotTestJSON-187705537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b3b271c-4b28-4fef-b704-3f054ca43c89 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7b3b271c-4b28-4fef-b704-3f054ca43c89.e47745dd-23c7-4b51-bbd6-0895b5ee67ff {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:34 devstack sudo[100058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b3b271c-4b28-4fef-b704-3f054ca43c89 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7b3b271c-4b28-4fef-b704-3f054ca43c89.e47745dd-23c7-4b51-bbd6-0895b5ee67ff Nov 06 17:56:34 devstack sudo[100058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:35 devstack sudo[100056]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ea982b0d-cf77-4913-9364-660c04a62b82 tempest-TestInstancesWithCinderVolumes-1921145433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-629b05cd-98a5-4d26-a9e1-64b94c3e9a69" returned: 0 in 0.373s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ea982b0d-cf77-4913-9364-660c04a62b82 tempest-TestInstancesWithCinderVolumes-1921145433 None] Lock "cinder-quobyte-629b05cd-98a5-4d26-a9e1-64b94c3e9a69" released by "delete_volume" :: held 1.089s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:56:35 devstack cinder-volume[87068]: WARNING cinder.quota [None req-ea982b0d-cf77-4913-9364-660c04a62b82 tempest-TestInstancesWithCinderVolumes-1921145433 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-300661075-66546327 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-300661075-66546327, it is now deprecated. Please use the default quota class for default quota. Nov 06 17:56:35 devstack cinder-volume[87068]: WARNING cinder.quota [None req-ea982b0d-cf77-4913-9364-660c04a62b82 tempest-TestInstancesWithCinderVolumes-1921145433 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-300661075-66546327 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-300661075-66546327, it is now deprecated. Please use the default quota class for default quota. Nov 06 17:56:35 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-ea982b0d-cf77-4913-9364-660c04a62b82 tempest-TestInstancesWithCinderVolumes-1921145433 None] Created reservations ['aa329b73-0829-4fd7-adb9-e1598489c570', 'a812f241-4001-4ac3-a36a-c87a9245fd00', '9fe0ac5d-ec95-4f25-9cd4-cb1c39af46d1', 'a20ff183-44df-41d1-b676-959e08b7031a'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:56:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ea982b0d-cf77-4913-9364-660c04a62b82 tempest-TestInstancesWithCinderVolumes-1921145433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:56:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ea982b0d-cf77-4913-9364-660c04a62b82 tempest-TestInstancesWithCinderVolumes-1921145433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:56:35 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ea982b0d-cf77-4913-9364-660c04a62b82 tempest-TestInstancesWithCinderVolumes-1921145433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:56:35 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ea982b0d-cf77-4913-9364-660c04a62b82 tempest-TestInstancesWithCinderVolumes-1921145433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:56:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ea982b0d-cf77-4913-9364-660c04a62b82 tempest-TestInstancesWithCinderVolumes-1921145433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:56:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ea982b0d-cf77-4913-9364-660c04a62b82 tempest-TestInstancesWithCinderVolumes-1921145433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:35 devstack sudo[100058]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4ef29a57-8804-4f94-a80c-4c8792328567 tempest-VolumesSnapshotTestJSON-187705537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b3b271c-4b28-4fef-b704-3f054ca43c89 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7b3b271c-4b28-4fef-b704-3f054ca43c89.e47745dd-23c7-4b51-bbd6-0895b5ee67ff" returned: 0 in 0.613s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:35 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-4ef29a57-8804-4f94-a80c-4c8792328567 tempest-VolumesSnapshotTestJSON-187705537 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7b3b271c-4b28-4fef-b704-3f054ca43c89.e47745dd-23c7-4b51-bbd6-0895b5ee67ff is being set with open permissions: ugo+rw Nov 06 17:56:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4ef29a57-8804-4f94-a80c-4c8792328567 tempest-VolumesSnapshotTestJSON-187705537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7b3b271c-4b28-4fef-b704-3f054ca43c89.e47745dd-23c7-4b51-bbd6-0895b5ee67ff {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:35 devstack sudo[100065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:56:35 devstack sudo[100065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:35 devstack sudo[100066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7b3b271c-4b28-4fef-b704-3f054ca43c89.e47745dd-23c7-4b51-bbd6-0895b5ee67ff Nov 06 17:56:35 devstack sudo[100066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:35 devstack sudo[100066]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:35 devstack sudo[100065]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4ef29a57-8804-4f94-a80c-4c8792328567 tempest-VolumesSnapshotTestJSON-187705537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7b3b271c-4b28-4fef-b704-3f054ca43c89.e47745dd-23c7-4b51-bbd6-0895b5ee67ff" returned: 0 in 0.367s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ea982b0d-cf77-4913-9364-660c04a62b82 tempest-TestInstancesWithCinderVolumes-1921145433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.407s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:35 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-ea982b0d-cf77-4913-9364-660c04a62b82 tempest-TestInstancesWithCinderVolumes-1921145433 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:56:35 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-ea982b0d-cf77-4913-9364-660c04a62b82 tempest-TestInstancesWithCinderVolumes-1921145433 None] Deleted volume successfully. Nov 06 17:56:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4ef29a57-8804-4f94-a80c-4c8792328567 tempest-VolumesSnapshotTestJSON-187705537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7b3b271c-4b28-4fef-b704-3f054ca43c89.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ea982b0d-cf77-4913-9364-660c04a62b82 tempest-TestInstancesWithCinderVolumes-1921145433 None] Lock "cinder-629b05cd-98a5-4d26-a9e1-64b94c3e9a69-delete_volume" released by "delete_volume" :: held 1.899s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:56:35 devstack sudo[100071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7b3b271c-4b28-4fef-b704-3f054ca43c89.info Nov 06 17:56:35 devstack sudo[100071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:36 devstack sudo[100071]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4ef29a57-8804-4f94-a80c-4c8792328567 tempest-VolumesSnapshotTestJSON-187705537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7b3b271c-4b28-4fef-b704-3f054ca43c89.info" returned: 0 in 0.318s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:36 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-4ef29a57-8804-4f94-a80c-4c8792328567 tempest-VolumesSnapshotTestJSON-187705537 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7b3b271c-4b28-4fef-b704-3f054ca43c89.info is being set with open permissions: ugo+rw Nov 06 17:56:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4ef29a57-8804-4f94-a80c-4c8792328567 tempest-VolumesSnapshotTestJSON-187705537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7b3b271c-4b28-4fef-b704-3f054ca43c89.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:36 devstack sudo[100074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7b3b271c-4b28-4fef-b704-3f054ca43c89.info Nov 06 17:56:36 devstack sudo[100074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:36 devstack sudo[100074]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4ef29a57-8804-4f94-a80c-4c8792328567 tempest-VolumesSnapshotTestJSON-187705537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7b3b271c-4b28-4fef-b704-3f054ca43c89.info" returned: 0 in 0.290s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4ef29a57-8804-4f94-a80c-4c8792328567 tempest-VolumesSnapshotTestJSON-187705537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.988s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:56:36 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-4ef29a57-8804-4f94-a80c-4c8792328567 tempest-VolumesSnapshotTestJSON-187705537 None] Create snapshot completed successfully Nov 06 17:56:37 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-760cf1b0-a05e-4f1c-b97f-0af6e54cc576 tempest-VolumesSnapshotTestJSON-187705537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:56:37 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-760cf1b0-a05e-4f1c-b97f-0af6e54cc576 tempest-VolumesSnapshotTestJSON-187705537 None] Flow 'volume_create_manager' (4c9881e2-8b1d-47f6-b811-baf67eb2a190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:56:37 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-760cf1b0-a05e-4f1c-b97f-0af6e54cc576 tempest-VolumesSnapshotTestJSON-187705537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5cb6398-ac94-442e-b215-42395cf0a29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:56:37 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-760cf1b0-a05e-4f1c-b97f-0af6e54cc576 tempest-VolumesSnapshotTestJSON-187705537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5cb6398-ac94-442e-b215-42395cf0a29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:56:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1347576385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b12b50a-7072-4ed6-ab85-8e61f584e7a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ec444c1ccd54c3aafbe41d1987ead32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:56:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e47745dd-23c7-4b51-bbd6-0895b5ee67ff,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:56:37Z,use_quota=True,user_id='40043c4a8d004be584aecf793d4b4273',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:56:37 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-760cf1b0-a05e-4f1c-b97f-0af6e54cc576 tempest-VolumesSnapshotTestJSON-187705537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8f460d8-9438-4a0b-819a-cfb231758fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:56:37 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-760cf1b0-a05e-4f1c-b97f-0af6e54cc576 tempest-VolumesSnapshotTestJSON-187705537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8f460d8-9438-4a0b-819a-cfb231758fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:56:37 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-760cf1b0-a05e-4f1c-b97f-0af6e54cc576 tempest-VolumesSnapshotTestJSON-187705537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4704da04-8932-4905-bbb7-5a1fba65108f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:56:37 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-760cf1b0-a05e-4f1c-b97f-0af6e54cc576 tempest-VolumesSnapshotTestJSON-187705537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4704da04-8932-4905-bbb7-5a1fba65108f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5b12b50a-7072-4ed6-ab85-8e61f584e7a8', 'volume_name': 'volume-5b12b50a-7072-4ed6-ab85-8e61f584e7a8', 'volume_size': 1, 'snapshot_id': 'e47745dd-23c7-4b51-bbd6-0895b5ee67ff'}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:56:37 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-760cf1b0-a05e-4f1c-b97f-0af6e54cc576 tempest-VolumesSnapshotTestJSON-187705537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e221afc1-3e60-4039-9f1b-c98562feaff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:56:37 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-760cf1b0-a05e-4f1c-b97f-0af6e54cc576 tempest-VolumesSnapshotTestJSON-187705537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e221afc1-3e60-4039-9f1b-c98562feaff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:56:37 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-760cf1b0-a05e-4f1c-b97f-0af6e54cc576 tempest-VolumesSnapshotTestJSON-187705537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b08c0e5d-5caa-4f47-9a67-767a5b692239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:56:37 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-760cf1b0-a05e-4f1c-b97f-0af6e54cc576 tempest-VolumesSnapshotTestJSON-187705537 None] Volume 5b12b50a-7072-4ed6-ab85-8e61f584e7a8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5b12b50a-7072-4ed6-ab85-8e61f584e7a8', 'volume_size': 1, 'snapshot_id': 'e47745dd-23c7-4b51-bbd6-0895b5ee67ff'} Nov 06 17:56:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-760cf1b0-a05e-4f1c-b97f-0af6e54cc576 tempest-VolumesSnapshotTestJSON-187705537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:56:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-760cf1b0-a05e-4f1c-b97f-0af6e54cc576 tempest-VolumesSnapshotTestJSON-187705537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:56:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-760cf1b0-a05e-4f1c-b97f-0af6e54cc576 tempest-VolumesSnapshotTestJSON-187705537 None] Acquiring lock "cinder-quobyte-e47745dd-23c7-4b51-bbd6-0895b5ee67ff-5b12b50a-7072-4ed6-ab85-8e61f584e7a8" by "_create_volume_from_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:56:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-760cf1b0-a05e-4f1c-b97f-0af6e54cc576 tempest-VolumesSnapshotTestJSON-187705537 None] Lock "cinder-quobyte-e47745dd-23c7-4b51-bbd6-0895b5ee67ff-5b12b50a-7072-4ed6-ab85-8e61f584e7a8" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:56:37 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-760cf1b0-a05e-4f1c-b97f-0af6e54cc576 tempest-VolumesSnapshotTestJSON-187705537 None] Creating volume 5b12b50a-7072-4ed6-ab85-8e61f584e7a8 from snapshot e47745dd-23c7-4b51-bbd6-0895b5ee67ff {{(pid=87068) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 17:56:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-760cf1b0-a05e-4f1c-b97f-0af6e54cc576 tempest-VolumesSnapshotTestJSON-187705537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:56:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-760cf1b0-a05e-4f1c-b97f-0af6e54cc576 tempest-VolumesSnapshotTestJSON-187705537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:56:37 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-760cf1b0-a05e-4f1c-b97f-0af6e54cc576 tempest-VolumesSnapshotTestJSON-187705537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:56:37 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-760cf1b0-a05e-4f1c-b97f-0af6e54cc576 tempest-VolumesSnapshotTestJSON-187705537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:56:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-760cf1b0-a05e-4f1c-b97f-0af6e54cc576 tempest-VolumesSnapshotTestJSON-187705537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:56:37 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-760cf1b0-a05e-4f1c-b97f-0af6e54cc576 tempest-VolumesSnapshotTestJSON-187705537 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:56:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-760cf1b0-a05e-4f1c-b97f-0af6e54cc576 tempest-VolumesSnapshotTestJSON-187705537 None] Acquiring lock "cinder-quobyte-5b12b50a-7072-4ed6-ab85-8e61f584e7a8" by "_copy_volume_from_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:56:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-760cf1b0-a05e-4f1c-b97f-0af6e54cc576 tempest-VolumesSnapshotTestJSON-187705537 None] Lock "cinder-quobyte-5b12b50a-7072-4ed6-ab85-8e61f584e7a8" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:56:37 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-760cf1b0-a05e-4f1c-b97f-0af6e54cc576 tempest-VolumesSnapshotTestJSON-187705537 None] snapshot: e47745dd-23c7-4b51-bbd6-0895b5ee67ff, volume: 5b12b50a-7072-4ed6-ab85-8e61f584e7a8, {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 17:56:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-760cf1b0-a05e-4f1c-b97f-0af6e54cc576 tempest-VolumesSnapshotTestJSON-187705537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:56:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-760cf1b0-a05e-4f1c-b97f-0af6e54cc576 tempest-VolumesSnapshotTestJSON-187705537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:56:37 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-760cf1b0-a05e-4f1c-b97f-0af6e54cc576 tempest-VolumesSnapshotTestJSON-187705537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:56:37 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-760cf1b0-a05e-4f1c-b97f-0af6e54cc576 tempest-VolumesSnapshotTestJSON-187705537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:56:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-760cf1b0-a05e-4f1c-b97f-0af6e54cc576 tempest-VolumesSnapshotTestJSON-187705537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:56:37 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b42f8cd-cb3c-4667-8db3-28047375ed4d]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:56:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-760cf1b0-a05e-4f1c-b97f-0af6e54cc576 tempest-VolumesSnapshotTestJSON-187705537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7b3b271c-4b28-4fef-b704-3f054ca43c89.e47745dd-23c7-4b51-bbd6-0895b5ee67ff {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:37 devstack sudo[100095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7b3b271c-4b28-4fef-b704-3f054ca43c89.e47745dd-23c7-4b51-bbd6-0895b5ee67ff Nov 06 17:56:37 devstack sudo[100095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:38 devstack sudo[100095]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-760cf1b0-a05e-4f1c-b97f-0af6e54cc576 tempest-VolumesSnapshotTestJSON-187705537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7b3b271c-4b28-4fef-b704-3f054ca43c89.e47745dd-23c7-4b51-bbd6-0895b5ee67ff" returned: 0 in 0.569s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-760cf1b0-a05e-4f1c-b97f-0af6e54cc576 tempest-VolumesSnapshotTestJSON-187705537 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b3b271c-4b28-4fef-b704-3f054ca43c89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 17:56:38 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e1d6d8-79f6-42b4-84e6-3f8c80992bc1]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:56:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-760cf1b0-a05e-4f1c-b97f-0af6e54cc576 tempest-VolumesSnapshotTestJSON-187705537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7b3b271c-4b28-4fef-b704-3f054ca43c89 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:38 devstack sudo[100106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7b3b271c-4b28-4fef-b704-3f054ca43c89 Nov 06 17:56:38 devstack sudo[100106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:38 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-4c6cb866-1834-4a63-8bd7-febf5f956864 req-760fe5bd-df62-44a6-a8ad-a4dfb8a3fa57 tempest-TestInstancesWithCinderVolumes-1921145433 None] Terminate volume connection completed successfully. Nov 06 17:56:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-4c6cb866-1834-4a63-8bd7-febf5f956864 req-760fe5bd-df62-44a6-a8ad-a4dfb8a3fa57 tempest-TestInstancesWithCinderVolumes-1921145433 None] Deleting attachment 737f1ac0-d22c-4dbb-9c62-d2430e32f0e2. {{(pid=87068) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 17:56:38 devstack sudo[100106]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-760cf1b0-a05e-4f1c-b97f-0af6e54cc576 tempest-VolumesSnapshotTestJSON-187705537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7b3b271c-4b28-4fef-b704-3f054ca43c89" returned: 0 in 0.449s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-760cf1b0-a05e-4f1c-b97f-0af6e54cc576 tempest-VolumesSnapshotTestJSON-187705537 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7b3b271c-4b28-4fef-b704-3f054ca43c89 {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 17:56:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-760cf1b0-a05e-4f1c-b97f-0af6e54cc576 tempest-VolumesSnapshotTestJSON-187705537 None] Creating direct copy from snapshot {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 17:56:38 devstack cinder-volume[87068]: DEBUG cinder.utils [None req-760cf1b0-a05e-4f1c-b97f-0af6e54cc576 tempest-VolumesSnapshotTestJSON-187705537 None] Path /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5b12b50a-7072-4ed6-ab85-8e61f584e7a8 not found in is_blk_device check {{(pid=87068) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 17:56:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-760cf1b0-a05e-4f1c-b97f-0af6e54cc576 tempest-VolumesSnapshotTestJSON-187705537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7b3b271c-4b28-4fef-b704-3f054ca43c89 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5b12b50a-7072-4ed6-ab85-8e61f584e7a8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:38 devstack sudo[100113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7b3b271c-4b28-4fef-b704-3f054ca43c89 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5b12b50a-7072-4ed6-ab85-8e61f584e7a8 Nov 06 17:56:38 devstack sudo[100113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:39 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-de05acb0-d3c2-429b-9fc6-62db997eaed4 tempest-TestInstancesWithCinderVolumes-1921145433 None] Acquiring lock "cinder-f7b1b28a-23b2-4790-a6d8-ed28e51c5c00-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:56:39 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-de05acb0-d3c2-429b-9fc6-62db997eaed4 tempest-TestInstancesWithCinderVolumes-1921145433 None] Lock "cinder-f7b1b28a-23b2-4790-a6d8-ed28e51c5c00-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:56:39 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-de05acb0-d3c2-429b-9fc6-62db997eaed4 tempest-TestInstancesWithCinderVolumes-1921145433 None] Acquiring lock "cinder-quobyte-f7b1b28a-23b2-4790-a6d8-ed28e51c5c00" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:56:39 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-de05acb0-d3c2-429b-9fc6-62db997eaed4 tempest-TestInstancesWithCinderVolumes-1921145433 None] Lock "cinder-quobyte-f7b1b28a-23b2-4790-a6d8-ed28e51c5c00" acquired by "delete_volume" :: waited 0.048s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:56:39 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96b2a9b-5bbd-457f-9d38-8724d49dfb40]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:56:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-de05acb0-d3c2-429b-9fc6-62db997eaed4 tempest-TestInstancesWithCinderVolumes-1921145433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f7b1b28a-23b2-4790-a6d8-ed28e51c5c00 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:40 devstack sudo[100125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f7b1b28a-23b2-4790-a6d8-ed28e51c5c00 Nov 06 17:56:40 devstack sudo[100125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:40 devstack sudo[100125]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-de05acb0-d3c2-429b-9fc6-62db997eaed4 tempest-TestInstancesWithCinderVolumes-1921145433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f7b1b28a-23b2-4790-a6d8-ed28e51c5c00" returned: 0 in 0.957s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-de05acb0-d3c2-429b-9fc6-62db997eaed4 tempest-TestInstancesWithCinderVolumes-1921145433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f7b1b28a-23b2-4790-a6d8-ed28e51c5c00 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:40 devstack sudo[100133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f7b1b28a-23b2-4790-a6d8-ed28e51c5c00 Nov 06 17:56:40 devstack sudo[100133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:41 devstack sudo[100133]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-de05acb0-d3c2-429b-9fc6-62db997eaed4 tempest-TestInstancesWithCinderVolumes-1921145433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f7b1b28a-23b2-4790-a6d8-ed28e51c5c00" returned: 0 in 0.632s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:41 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-de05acb0-d3c2-429b-9fc6-62db997eaed4 tempest-TestInstancesWithCinderVolumes-1921145433 None] Lock "cinder-quobyte-f7b1b28a-23b2-4790-a6d8-ed28e51c5c00" released by "delete_volume" :: held 1.752s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:56:41 devstack cinder-volume[87068]: WARNING cinder.quota [None req-de05acb0-d3c2-429b-9fc6-62db997eaed4 tempest-TestInstancesWithCinderVolumes-1921145433 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2110441887-40154858 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2110441887-40154858, it is now deprecated. Please use the default quota class for default quota. Nov 06 17:56:41 devstack cinder-volume[87068]: WARNING cinder.quota [None req-de05acb0-d3c2-429b-9fc6-62db997eaed4 tempest-TestInstancesWithCinderVolumes-1921145433 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2110441887-40154858 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2110441887-40154858, it is now deprecated. Please use the default quota class for default quota. Nov 06 17:56:41 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-de05acb0-d3c2-429b-9fc6-62db997eaed4 tempest-TestInstancesWithCinderVolumes-1921145433 None] Created reservations ['6ed05d87-279c-4d8e-a7f0-5be04b338c6f', '6c419cac-7e33-4f33-9b60-defcf30c0289', '381dca64-7ca4-4fe9-80f1-ae075940875c', 'e06d1d45-974e-4bb0-a962-edaa52d774c4'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:56:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-de05acb0-d3c2-429b-9fc6-62db997eaed4 tempest-TestInstancesWithCinderVolumes-1921145433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:56:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-de05acb0-d3c2-429b-9fc6-62db997eaed4 tempest-TestInstancesWithCinderVolumes-1921145433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:56:41 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-de05acb0-d3c2-429b-9fc6-62db997eaed4 tempest-TestInstancesWithCinderVolumes-1921145433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:56:41 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-de05acb0-d3c2-429b-9fc6-62db997eaed4 tempest-TestInstancesWithCinderVolumes-1921145433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:56:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-de05acb0-d3c2-429b-9fc6-62db997eaed4 tempest-TestInstancesWithCinderVolumes-1921145433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:56:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-de05acb0-d3c2-429b-9fc6-62db997eaed4 tempest-TestInstancesWithCinderVolumes-1921145433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:41 devstack sudo[100136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:56:41 devstack sudo[100136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:42 devstack sudo[100136]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-de05acb0-d3c2-429b-9fc6-62db997eaed4 tempest-TestInstancesWithCinderVolumes-1921145433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.508s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:42 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-de05acb0-d3c2-429b-9fc6-62db997eaed4 tempest-TestInstancesWithCinderVolumes-1921145433 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:56:42 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-de05acb0-d3c2-429b-9fc6-62db997eaed4 tempest-TestInstancesWithCinderVolumes-1921145433 None] Deleted volume successfully. Nov 06 17:56:42 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-de05acb0-d3c2-429b-9fc6-62db997eaed4 tempest-TestInstancesWithCinderVolumes-1921145433 None] Lock "cinder-f7b1b28a-23b2-4790-a6d8-ed28e51c5c00-delete_volume" released by "delete_volume" :: held 2.905s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:56:49 devstack sudo[100113]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-760cf1b0-a05e-4f1c-b97f-0af6e54cc576 tempest-VolumesSnapshotTestJSON-187705537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7b3b271c-4b28-4fef-b704-3f054ca43c89 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5b12b50a-7072-4ed6-ab85-8e61f584e7a8" returned: 0 in 10.269s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:49 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-760cf1b0-a05e-4f1c-b97f-0af6e54cc576 tempest-VolumesSnapshotTestJSON-187705537 None] Image conversion details: src /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7b3b271c-4b28-4fef-b704-3f054ca43c89, size 1024.00 MB, duration 10.27 sec, destination /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5b12b50a-7072-4ed6-ab85-8e61f584e7a8 {{(pid=87068) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 17:56:49 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-760cf1b0-a05e-4f1c-b97f-0af6e54cc576 tempest-VolumesSnapshotTestJSON-187705537 None] Converted 1024.00 MB image at 99.71 MB/s Nov 06 17:56:49 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-760cf1b0-a05e-4f1c-b97f-0af6e54cc576 tempest-VolumesSnapshotTestJSON-187705537 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5b12b50a-7072-4ed6-ab85-8e61f584e7a8 is being set with open permissions: ugo+rw Nov 06 17:56:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-760cf1b0-a05e-4f1c-b97f-0af6e54cc576 tempest-VolumesSnapshotTestJSON-187705537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5b12b50a-7072-4ed6-ab85-8e61f584e7a8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:49 devstack sudo[100141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5b12b50a-7072-4ed6-ab85-8e61f584e7a8 Nov 06 17:56:49 devstack sudo[100141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:49 devstack sudo[100141]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-760cf1b0-a05e-4f1c-b97f-0af6e54cc576 tempest-VolumesSnapshotTestJSON-187705537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5b12b50a-7072-4ed6-ab85-8e61f584e7a8" returned: 0 in 0.304s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:49 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-760cf1b0-a05e-4f1c-b97f-0af6e54cc576 tempest-VolumesSnapshotTestJSON-187705537 None] Lock "cinder-quobyte-5b12b50a-7072-4ed6-ab85-8e61f584e7a8" released by "_copy_volume_from_snapshot" :: held 11.734s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:56:49 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-760cf1b0-a05e-4f1c-b97f-0af6e54cc576 tempest-VolumesSnapshotTestJSON-187705537 None] Lock "cinder-quobyte-e47745dd-23c7-4b51-bbd6-0895b5ee67ff-5b12b50a-7072-4ed6-ab85-8e61f584e7a8" released by "_create_volume_from_snapshot" :: held 11.839s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:56:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-760cf1b0-a05e-4f1c-b97f-0af6e54cc576 tempest-VolumesSnapshotTestJSON-187705537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.861s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:56:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-760cf1b0-a05e-4f1c-b97f-0af6e54cc576 tempest-VolumesSnapshotTestJSON-187705537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b08c0e5d-5caa-4f47-9a67-767a5b692239) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b12b50a-7072-4ed6-ab85-8e61f584e7a8', 'volume_size': 1, 'snapshot_id': 'e47745dd-23c7-4b51-bbd6-0895b5ee67ff'}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:56:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-760cf1b0-a05e-4f1c-b97f-0af6e54cc576 tempest-VolumesSnapshotTestJSON-187705537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c3838a9-a1ff-40f3-81e5-509a397f1177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:56:49 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-760cf1b0-a05e-4f1c-b97f-0af6e54cc576 tempest-VolumesSnapshotTestJSON-187705537 None] Volume volume-5b12b50a-7072-4ed6-ab85-8e61f584e7a8 (5b12b50a-7072-4ed6-ab85-8e61f584e7a8): created successfully Nov 06 17:56:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-760cf1b0-a05e-4f1c-b97f-0af6e54cc576 tempest-VolumesSnapshotTestJSON-187705537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c3838a9-a1ff-40f3-81e5-509a397f1177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:56:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-760cf1b0-a05e-4f1c-b97f-0af6e54cc576 tempest-VolumesSnapshotTestJSON-187705537 None] Flow 'volume_create_manager' (4c9881e2-8b1d-47f6-b811-baf67eb2a190) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:56:49 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-760cf1b0-a05e-4f1c-b97f-0af6e54cc576 tempest-VolumesSnapshotTestJSON-187705537 None] Created volume successfully. Nov 06 17:56:49 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-a57086a9-7a37-473b-b5b3-72b637cde43d tempest-VolumeTypesAccessTest-1272147260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:56:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a57086a9-7a37-473b-b5b3-72b637cde43d tempest-VolumeTypesAccessTest-1272147260 None] Flow 'volume_create_manager' (f5e2a0d6-8ad6-4f10-8ce8-e4ee3f7f3d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:56:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a57086a9-7a37-473b-b5b3-72b637cde43d tempest-VolumeTypesAccessTest-1272147260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (003b048b-c962-4433-ae0d-904fdfb79ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:56:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a57086a9-7a37-473b-b5b3-72b637cde43d tempest-VolumeTypesAccessTest-1272147260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (003b048b-c962-4433-ae0d-904fdfb79ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:56:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-707968024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39ced021-a1e0-4b90-9bc8-3c1cc552d568,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddda1c4ff8e04ac2996857d3b89ae993',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:56:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:56:50Z,use_quota=True,user_id='d5c6dc2c18854b9fb1431a969d147b7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d2ef151d-352b-43de-b17f-b1fee3a4dabb),volume_type_id=d2ef151d-352b-43de-b17f-b1fee3a4dabb)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:56:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a57086a9-7a37-473b-b5b3-72b637cde43d tempest-VolumeTypesAccessTest-1272147260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d2053ea-43b7-4d10-a992-3ac5e5b50374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:56:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a57086a9-7a37-473b-b5b3-72b637cde43d tempest-VolumeTypesAccessTest-1272147260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d2053ea-43b7-4d10-a992-3ac5e5b50374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:56:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a57086a9-7a37-473b-b5b3-72b637cde43d tempest-VolumeTypesAccessTest-1272147260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7e069b8-197c-45ee-a63e-23652d6b6856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:56:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a57086a9-7a37-473b-b5b3-72b637cde43d tempest-VolumeTypesAccessTest-1272147260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7e069b8-197c-45ee-a63e-23652d6b6856) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39ced021-a1e0-4b90-9bc8-3c1cc552d568', 'volume_name': 'volume-39ced021-a1e0-4b90-9bc8-3c1cc552d568', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:56:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a57086a9-7a37-473b-b5b3-72b637cde43d tempest-VolumeTypesAccessTest-1272147260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e911b675-cbb0-4a24-9d5e-c6f2a6b1b2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:56:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a57086a9-7a37-473b-b5b3-72b637cde43d tempest-VolumeTypesAccessTest-1272147260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e911b675-cbb0-4a24-9d5e-c6f2a6b1b2f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:56:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a57086a9-7a37-473b-b5b3-72b637cde43d tempest-VolumeTypesAccessTest-1272147260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6426427c-6602-4236-a761-d93963a05955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:56:49 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-a57086a9-7a37-473b-b5b3-72b637cde43d tempest-VolumeTypesAccessTest-1272147260 None] Volume 39ced021-a1e0-4b90-9bc8-3c1cc552d568: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39ced021-a1e0-4b90-9bc8-3c1cc552d568', 'volume_size': 1} Nov 06 17:56:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a57086a9-7a37-473b-b5b3-72b637cde43d tempest-VolumeTypesAccessTest-1272147260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:56:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a57086a9-7a37-473b-b5b3-72b637cde43d tempest-VolumeTypesAccessTest-1272147260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:56:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a57086a9-7a37-473b-b5b3-72b637cde43d tempest-VolumeTypesAccessTest-1272147260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:56:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-707968024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39ced021-a1e0-4b90-9bc8-3c1cc552d568,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddda1c4ff8e04ac2996857d3b89ae993',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:56:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:56:50Z,use_quota=True,user_id='d5c6dc2c18854b9fb1431a969d147b7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d2ef151d-352b-43de-b17f-b1fee3a4dabb),volume_type_id=d2ef151d-352b-43de-b17f-b1fee3a4dabb)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:56:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-a57086a9-7a37-473b-b5b3-72b637cde43d tempest-VolumeTypesAccessTest-1272147260 None] Creating volume 39ced021-a1e0-4b90-9bc8-3c1cc552d568 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:56:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a57086a9-7a37-473b-b5b3-72b637cde43d tempest-VolumeTypesAccessTest-1272147260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:56:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a57086a9-7a37-473b-b5b3-72b637cde43d tempest-VolumeTypesAccessTest-1272147260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:56:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a57086a9-7a37-473b-b5b3-72b637cde43d tempest-VolumeTypesAccessTest-1272147260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:56:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a57086a9-7a37-473b-b5b3-72b637cde43d tempest-VolumeTypesAccessTest-1272147260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:56:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a57086a9-7a37-473b-b5b3-72b637cde43d tempest-VolumeTypesAccessTest-1272147260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:56:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a57086a9-7a37-473b-b5b3-72b637cde43d tempest-VolumeTypesAccessTest-1272147260 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:56:49 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-a57086a9-7a37-473b-b5b3-72b637cde43d tempest-VolumeTypesAccessTest-1272147260 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:56:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a57086a9-7a37-473b-b5b3-72b637cde43d tempest-VolumeTypesAccessTest-1272147260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-39ced021-a1e0-4b90-9bc8-3c1cc552d568 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:49 devstack sudo[100144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-39ced021-a1e0-4b90-9bc8-3c1cc552d568 1073741824 Nov 06 17:56:49 devstack sudo[100144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:50 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-48e3887f-787f-4198-b77a-af5c82595d9a tempest-VolumesSnapshotTestJSON-187705537 None] Acquiring lock "cinder-5b12b50a-7072-4ed6-ab85-8e61f584e7a8-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:56:50 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-48e3887f-787f-4198-b77a-af5c82595d9a tempest-VolumesSnapshotTestJSON-187705537 None] Lock "cinder-5b12b50a-7072-4ed6-ab85-8e61f584e7a8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:56:50 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-48e3887f-787f-4198-b77a-af5c82595d9a tempest-VolumesSnapshotTestJSON-187705537 None] Acquiring lock "cinder-quobyte-5b12b50a-7072-4ed6-ab85-8e61f584e7a8" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:56:50 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-48e3887f-787f-4198-b77a-af5c82595d9a tempest-VolumesSnapshotTestJSON-187705537 None] Lock "cinder-quobyte-5b12b50a-7072-4ed6-ab85-8e61f584e7a8" acquired by "delete_volume" :: waited 0.017s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:56:50 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae56efb-18b5-49b0-8a94-583b43e82fcd]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:56:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-48e3887f-787f-4198-b77a-af5c82595d9a tempest-VolumesSnapshotTestJSON-187705537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5b12b50a-7072-4ed6-ab85-8e61f584e7a8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:50 devstack sudo[100149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5b12b50a-7072-4ed6-ab85-8e61f584e7a8 Nov 06 17:56:50 devstack sudo[100149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:50 devstack sudo[100144]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a57086a9-7a37-473b-b5b3-72b637cde43d tempest-VolumeTypesAccessTest-1272147260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-39ced021-a1e0-4b90-9bc8-3c1cc552d568 1073741824" returned: 0 in 0.705s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a57086a9-7a37-473b-b5b3-72b637cde43d tempest-VolumeTypesAccessTest-1272147260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-39ced021-a1e0-4b90-9bc8-3c1cc552d568 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:50 devstack sudo[100153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-39ced021-a1e0-4b90-9bc8-3c1cc552d568 Nov 06 17:56:50 devstack sudo[100153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:50 devstack sudo[100149]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-48e3887f-787f-4198-b77a-af5c82595d9a tempest-VolumesSnapshotTestJSON-187705537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5b12b50a-7072-4ed6-ab85-8e61f584e7a8" returned: 0 in 0.523s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-48e3887f-787f-4198-b77a-af5c82595d9a tempest-VolumesSnapshotTestJSON-187705537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5b12b50a-7072-4ed6-ab85-8e61f584e7a8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:50 devstack sudo[100158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5b12b50a-7072-4ed6-ab85-8e61f584e7a8 Nov 06 17:56:50 devstack sudo[100158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:50 devstack sudo[100153]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a57086a9-7a37-473b-b5b3-72b637cde43d tempest-VolumeTypesAccessTest-1272147260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-39ced021-a1e0-4b90-9bc8-3c1cc552d568" returned: 0 in 0.353s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:50 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a57086a9-7a37-473b-b5b3-72b637cde43d tempest-VolumeTypesAccessTest-1272147260 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:56:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a57086a9-7a37-473b-b5b3-72b637cde43d tempest-VolumeTypesAccessTest-1272147260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:56:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a57086a9-7a37-473b-b5b3-72b637cde43d tempest-VolumeTypesAccessTest-1272147260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6426427c-6602-4236-a761-d93963a05955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39ced021-a1e0-4b90-9bc8-3c1cc552d568', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:56:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a57086a9-7a37-473b-b5b3-72b637cde43d tempest-VolumeTypesAccessTest-1272147260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2b4175a-f27e-4f69-9cae-1c21d4d33106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:56:50 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-a57086a9-7a37-473b-b5b3-72b637cde43d tempest-VolumeTypesAccessTest-1272147260 None] Volume volume-39ced021-a1e0-4b90-9bc8-3c1cc552d568 (39ced021-a1e0-4b90-9bc8-3c1cc552d568): created successfully Nov 06 17:56:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a57086a9-7a37-473b-b5b3-72b637cde43d tempest-VolumeTypesAccessTest-1272147260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2b4175a-f27e-4f69-9cae-1c21d4d33106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:56:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a57086a9-7a37-473b-b5b3-72b637cde43d tempest-VolumeTypesAccessTest-1272147260 None] Flow 'volume_create_manager' (f5e2a0d6-8ad6-4f10-8ce8-e4ee3f7f3d40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:56:51 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-a57086a9-7a37-473b-b5b3-72b637cde43d tempest-VolumeTypesAccessTest-1272147260 None] Created volume successfully. Nov 06 17:56:51 devstack sudo[100158]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-48e3887f-787f-4198-b77a-af5c82595d9a tempest-VolumesSnapshotTestJSON-187705537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5b12b50a-7072-4ed6-ab85-8e61f584e7a8" returned: 0 in 0.356s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:51 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-48e3887f-787f-4198-b77a-af5c82595d9a tempest-VolumesSnapshotTestJSON-187705537 None] Lock "cinder-quobyte-5b12b50a-7072-4ed6-ab85-8e61f584e7a8" released by "delete_volume" :: held 0.947s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:56:51 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-48e3887f-787f-4198-b77a-af5c82595d9a tempest-VolumesSnapshotTestJSON-187705537 None] Created reservations ['5085ba55-565a-4ff7-a708-19de0e3e4d5d', '84e02eb9-0817-4ec7-9f72-27ea76ce80a5', '1056cc0b-1fcc-4e7d-a649-d22062f2c0c9', 'd2d4e626-3b4c-47c3-a9d2-4006cef3dd33'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:56:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-48e3887f-787f-4198-b77a-af5c82595d9a tempest-VolumesSnapshotTestJSON-187705537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:56:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-48e3887f-787f-4198-b77a-af5c82595d9a tempest-VolumesSnapshotTestJSON-187705537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:56:51 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-48e3887f-787f-4198-b77a-af5c82595d9a tempest-VolumesSnapshotTestJSON-187705537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:56:51 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-48e3887f-787f-4198-b77a-af5c82595d9a tempest-VolumesSnapshotTestJSON-187705537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:56:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-48e3887f-787f-4198-b77a-af5c82595d9a tempest-VolumesSnapshotTestJSON-187705537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:56:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-48e3887f-787f-4198-b77a-af5c82595d9a tempest-VolumesSnapshotTestJSON-187705537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:51 devstack sudo[100198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:56:51 devstack sudo[100198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:51 devstack sudo[100198]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-48e3887f-787f-4198-b77a-af5c82595d9a tempest-VolumesSnapshotTestJSON-187705537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.356s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:51 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-48e3887f-787f-4198-b77a-af5c82595d9a tempest-VolumesSnapshotTestJSON-187705537 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:56:51 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-48e3887f-787f-4198-b77a-af5c82595d9a tempest-VolumesSnapshotTestJSON-187705537 None] Deleted volume successfully. Nov 06 17:56:51 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-48e3887f-787f-4198-b77a-af5c82595d9a tempest-VolumesSnapshotTestJSON-187705537 None] Lock "cinder-5b12b50a-7072-4ed6-ab85-8e61f584e7a8-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:56:51 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ba94e992-6e28-4f21-80d0-612217b3699f tempest-VolumeTypesAccessTest-1272147260 None] Acquiring lock "cinder-39ced021-a1e0-4b90-9bc8-3c1cc552d568-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:56:51 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ba94e992-6e28-4f21-80d0-612217b3699f tempest-VolumeTypesAccessTest-1272147260 None] Lock "cinder-39ced021-a1e0-4b90-9bc8-3c1cc552d568-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:56:52 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ba94e992-6e28-4f21-80d0-612217b3699f tempest-VolumeTypesAccessTest-1272147260 None] Acquiring lock "cinder-quobyte-39ced021-a1e0-4b90-9bc8-3c1cc552d568" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:56:52 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ba94e992-6e28-4f21-80d0-612217b3699f tempest-VolumeTypesAccessTest-1272147260 None] Lock "cinder-quobyte-39ced021-a1e0-4b90-9bc8-3c1cc552d568" acquired by "delete_volume" :: waited 0.034s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:56:52 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdaf2f1d-6808-4ced-9084-7289ecd49ab4]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:56:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ba94e992-6e28-4f21-80d0-612217b3699f tempest-VolumeTypesAccessTest-1272147260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-39ced021-a1e0-4b90-9bc8-3c1cc552d568 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:52 devstack sudo[100209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-39ced021-a1e0-4b90-9bc8-3c1cc552d568 Nov 06 17:56:52 devstack sudo[100209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:52 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d9fe54d5-a84a-4cf8-9956-4c4882b8b432 tempest-VolumesSnapshotTestJSON-187705537 None] Acquiring lock "cinder-e47745dd-23c7-4b51-bbd6-0895b5ee67ff-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:56:52 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d9fe54d5-a84a-4cf8-9956-4c4882b8b432 tempest-VolumesSnapshotTestJSON-187705537 None] Lock "cinder-e47745dd-23c7-4b51-bbd6-0895b5ee67ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:56:52 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d9fe54d5-a84a-4cf8-9956-4c4882b8b432 tempest-VolumesSnapshotTestJSON-187705537 None] Acquiring lock "cinder-quobyte-7b3b271c-4b28-4fef-b704-3f054ca43c89" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:56:52 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d9fe54d5-a84a-4cf8-9956-4c4882b8b432 tempest-VolumesSnapshotTestJSON-187705537 None] Lock "cinder-quobyte-7b3b271c-4b28-4fef-b704-3f054ca43c89" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:56:52 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d9fe54d5-a84a-4cf8-9956-4c4882b8b432 tempest-VolumesSnapshotTestJSON-187705537 None] Acquiring lock "cinder-quobyte-e47745dd-23c7-4b51-bbd6-0895b5ee67ff" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:56:52 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d9fe54d5-a84a-4cf8-9956-4c4882b8b432 tempest-VolumesSnapshotTestJSON-187705537 None] Lock "cinder-quobyte-e47745dd-23c7-4b51-bbd6-0895b5ee67ff" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:56:52 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-d9fe54d5-a84a-4cf8-9956-4c4882b8b432 tempest-VolumesSnapshotTestJSON-187705537 None] Deleting offline snapshot e47745dd-23c7-4b51-bbd6-0895b5ee67ff of volume 7b3b271c-4b28-4fef-b704-3f054ca43c89 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 17:56:52 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-d9fe54d5-a84a-4cf8-9956-4c4882b8b432 tempest-VolumesSnapshotTestJSON-187705537 None] snapshot_file for this snap is: volume-7b3b271c-4b28-4fef-b704-3f054ca43c89.e47745dd-23c7-4b51-bbd6-0895b5ee67ff {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 17:56:52 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f325c81-a9fd-422a-9ad4-33ec7b5e7737]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:56:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d9fe54d5-a84a-4cf8-9956-4c4882b8b432 tempest-VolumesSnapshotTestJSON-187705537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7b3b271c-4b28-4fef-b704-3f054ca43c89.e47745dd-23c7-4b51-bbd6-0895b5ee67ff {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:52 devstack sudo[100209]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ba94e992-6e28-4f21-80d0-612217b3699f tempest-VolumeTypesAccessTest-1272147260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-39ced021-a1e0-4b90-9bc8-3c1cc552d568" returned: 0 in 0.703s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ba94e992-6e28-4f21-80d0-612217b3699f tempest-VolumeTypesAccessTest-1272147260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-39ced021-a1e0-4b90-9bc8-3c1cc552d568 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:52 devstack sudo[100215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7b3b271c-4b28-4fef-b704-3f054ca43c89.e47745dd-23c7-4b51-bbd6-0895b5ee67ff Nov 06 17:56:52 devstack sudo[100215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:52 devstack sudo[100218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-39ced021-a1e0-4b90-9bc8-3c1cc552d568 Nov 06 17:56:52 devstack sudo[100218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:53 devstack sudo[100218]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ba94e992-6e28-4f21-80d0-612217b3699f tempest-VolumeTypesAccessTest-1272147260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-39ced021-a1e0-4b90-9bc8-3c1cc552d568" returned: 0 in 0.474s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:53 devstack sudo[100215]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d9fe54d5-a84a-4cf8-9956-4c4882b8b432 tempest-VolumesSnapshotTestJSON-187705537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7b3b271c-4b28-4fef-b704-3f054ca43c89.e47745dd-23c7-4b51-bbd6-0895b5ee67ff" returned: 0 in 0.638s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-d9fe54d5-a84a-4cf8-9956-4c4882b8b432 tempest-VolumesSnapshotTestJSON-187705537 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b3b271c-4b28-4fef-b704-3f054ca43c89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 17:56:53 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ba94e992-6e28-4f21-80d0-612217b3699f tempest-VolumeTypesAccessTest-1272147260 None] Lock "cinder-quobyte-39ced021-a1e0-4b90-9bc8-3c1cc552d568" released by "delete_volume" :: held 1.274s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:56:53 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae83637-d3b8-41fa-b33c-fef9158ad4bd]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:56:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d9fe54d5-a84a-4cf8-9956-4c4882b8b432 tempest-VolumesSnapshotTestJSON-187705537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7b3b271c-4b28-4fef-b704-3f054ca43c89 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:53 devstack cinder-volume[87068]: WARNING cinder.quota [None req-ba94e992-6e28-4f21-80d0-612217b3699f tempest-VolumeTypesAccessTest-1272147260 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1644411345 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1644411345, it is now deprecated. Please use the default quota class for default quota. Nov 06 17:56:53 devstack cinder-volume[87068]: WARNING cinder.quota [None req-ba94e992-6e28-4f21-80d0-612217b3699f tempest-VolumeTypesAccessTest-1272147260 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1644411345 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1644411345, it is now deprecated. Please use the default quota class for default quota. Nov 06 17:56:53 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-ba94e992-6e28-4f21-80d0-612217b3699f tempest-VolumeTypesAccessTest-1272147260 None] Created reservations ['2b7d8a4f-7401-4bdc-a86e-9031bbec5b42', '845b87ed-de10-4c58-ab67-04ff2516c38c', '25702e7a-42c7-4917-b4f5-10885ccda779', '9673b2fc-7103-4133-96d3-698bc32f80f7'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:56:53 devstack sudo[100242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7b3b271c-4b28-4fef-b704-3f054ca43c89 Nov 06 17:56:53 devstack sudo[100242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ba94e992-6e28-4f21-80d0-612217b3699f tempest-VolumeTypesAccessTest-1272147260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:56:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ba94e992-6e28-4f21-80d0-612217b3699f tempest-VolumeTypesAccessTest-1272147260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:56:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ba94e992-6e28-4f21-80d0-612217b3699f tempest-VolumeTypesAccessTest-1272147260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:56:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ba94e992-6e28-4f21-80d0-612217b3699f tempest-VolumeTypesAccessTest-1272147260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:56:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ba94e992-6e28-4f21-80d0-612217b3699f tempest-VolumeTypesAccessTest-1272147260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:56:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ba94e992-6e28-4f21-80d0-612217b3699f tempest-VolumeTypesAccessTest-1272147260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:53 devstack sudo[100247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:56:53 devstack sudo[100247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:54 devstack sudo[100247]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ba94e992-6e28-4f21-80d0-612217b3699f tempest-VolumeTypesAccessTest-1272147260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.353s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:54 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-ba94e992-6e28-4f21-80d0-612217b3699f tempest-VolumeTypesAccessTest-1272147260 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:56:54 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-ba94e992-6e28-4f21-80d0-612217b3699f tempest-VolumeTypesAccessTest-1272147260 None] Deleted volume successfully. Nov 06 17:56:54 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ba94e992-6e28-4f21-80d0-612217b3699f tempest-VolumeTypesAccessTest-1272147260 None] Lock "cinder-39ced021-a1e0-4b90-9bc8-3c1cc552d568-delete_volume" released by "delete_volume" :: held 2.143s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:56:54 devstack sudo[100242]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d9fe54d5-a84a-4cf8-9956-4c4882b8b432 tempest-VolumesSnapshotTestJSON-187705537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7b3b271c-4b28-4fef-b704-3f054ca43c89" returned: 0 in 0.790s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d9fe54d5-a84a-4cf8-9956-4c4882b8b432 tempest-VolumesSnapshotTestJSON-187705537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7b3b271c-4b28-4fef-b704-3f054ca43c89.e47745dd-23c7-4b51-bbd6-0895b5ee67ff {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:54 devstack sudo[100254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7b3b271c-4b28-4fef-b704-3f054ca43c89.e47745dd-23c7-4b51-bbd6-0895b5ee67ff Nov 06 17:56:54 devstack sudo[100254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:54 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 17:56:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:56:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:56:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:56:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:56:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:56:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:54 devstack sudo[100261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:56:54 devstack sudo[100261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:54 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-9fb35608-a952-4dca-958f-c489f86da4db req-f452cee5-4969-4d30-9ffb-d754901c7a00 tempest-TestInstancesWithCinderVolumes-1921145433 None] Terminate volume connection completed successfully. Nov 06 17:56:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-9fb35608-a952-4dca-958f-c489f86da4db req-f452cee5-4969-4d30-9ffb-d754901c7a00 tempest-TestInstancesWithCinderVolumes-1921145433 None] Deleting attachment e1a84604-2117-454c-8fc4-23a90ed85cf7. {{(pid=87068) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 17:56:54 devstack sudo[100261]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.442s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:54 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:56:54 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running periodic task VolumeManager._thread_info {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 17:56:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] thread count: 28 {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 17:56:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] thread info: [<_MainThread(MainThread, started 133940619505792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 17:56:54 devstack sudo[100254]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d9fe54d5-a84a-4cf8-9956-4c4882b8b432 tempest-VolumesSnapshotTestJSON-187705537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7b3b271c-4b28-4fef-b704-3f054ca43c89.e47745dd-23c7-4b51-bbd6-0895b5ee67ff" returned: 0 in 0.788s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d9fe54d5-a84a-4cf8-9956-4c4882b8b432 tempest-VolumesSnapshotTestJSON-187705537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7b3b271c-4b28-4fef-b704-3f054ca43c89.e47745dd-23c7-4b51-bbd6-0895b5ee67ff {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:55 devstack sudo[100267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7b3b271c-4b28-4fef-b704-3f054ca43c89.e47745dd-23c7-4b51-bbd6-0895b5ee67ff Nov 06 17:56:55 devstack sudo[100267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:55 devstack sudo[100267]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d9fe54d5-a84a-4cf8-9956-4c4882b8b432 tempest-VolumesSnapshotTestJSON-187705537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7b3b271c-4b28-4fef-b704-3f054ca43c89.e47745dd-23c7-4b51-bbd6-0895b5ee67ff" returned: 0 in 0.387s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d9fe54d5-a84a-4cf8-9956-4c4882b8b432 tempest-VolumesSnapshotTestJSON-187705537 None] Lock "cinder-quobyte-e47745dd-23c7-4b51-bbd6-0895b5ee67ff" released by "_delete_snapshot" :: held 2.830s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:56:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d9fe54d5-a84a-4cf8-9956-4c4882b8b432 tempest-VolumesSnapshotTestJSON-187705537 None] Lock "cinder-quobyte-7b3b271c-4b28-4fef-b704-3f054ca43c89" released by "delete_snapshot" :: held 2.882s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:56:55 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-d9fe54d5-a84a-4cf8-9956-4c4882b8b432 tempest-VolumesSnapshotTestJSON-187705537 None] Created reservations ['5f400b07-eaf0-4609-81e1-affcf258870c', 'de8b4346-1565-4d9d-b557-c2da21ca8b43', '697fcfc3-6c8e-4ec8-bc3c-50a225cfeb64', '3640d9b3-8728-4d0c-9ca7-6ffca36681f5'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:56:55 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-d9fe54d5-a84a-4cf8-9956-4c4882b8b432 tempest-VolumesSnapshotTestJSON-187705537 None] Delete snapshot completed successfully. Nov 06 17:56:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d9fe54d5-a84a-4cf8-9956-4c4882b8b432 tempest-VolumesSnapshotTestJSON-187705537 None] Lock "cinder-e47745dd-23c7-4b51-bbd6-0895b5ee67ff-delete_snapshot" released by "delete_snapshot" :: held 3.096s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:56:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-fc5c84ac-2b9b-43f3-88e8-6af57cba675a tempest-VolumesSnapshotTestJSON-187705537 None] Acquiring lock "cinder-7b3b271c-4b28-4fef-b704-3f054ca43c89-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:56:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-fc5c84ac-2b9b-43f3-88e8-6af57cba675a tempest-VolumesSnapshotTestJSON-187705537 None] Lock "cinder-7b3b271c-4b28-4fef-b704-3f054ca43c89-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:56:56 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-fc5c84ac-2b9b-43f3-88e8-6af57cba675a tempest-VolumesSnapshotTestJSON-187705537 None] Acquiring lock "cinder-quobyte-7b3b271c-4b28-4fef-b704-3f054ca43c89" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:56:56 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-fc5c84ac-2b9b-43f3-88e8-6af57cba675a tempest-VolumesSnapshotTestJSON-187705537 None] Lock "cinder-quobyte-7b3b271c-4b28-4fef-b704-3f054ca43c89" acquired by "delete_volume" :: waited 0.021s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:56:56 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-16d15101-a28a-46bc-8991-aeb4636e3dfe tempest-TestInstancesWithCinderVolumes-1921145433 None] Acquiring lock "cinder-cb615f18-3857-432d-9177-ff47aa9eb95f-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:56:56 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-16d15101-a28a-46bc-8991-aeb4636e3dfe tempest-TestInstancesWithCinderVolumes-1921145433 None] Lock "cinder-cb615f18-3857-432d-9177-ff47aa9eb95f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:56:56 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d0487f-1bc9-4ef8-a131-deca7f443020]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:56:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fc5c84ac-2b9b-43f3-88e8-6af57cba675a tempest-VolumesSnapshotTestJSON-187705537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7b3b271c-4b28-4fef-b704-3f054ca43c89 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:56 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-16d15101-a28a-46bc-8991-aeb4636e3dfe tempest-TestInstancesWithCinderVolumes-1921145433 None] Acquiring lock "cinder-quobyte-cb615f18-3857-432d-9177-ff47aa9eb95f" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:56:56 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-16d15101-a28a-46bc-8991-aeb4636e3dfe tempest-TestInstancesWithCinderVolumes-1921145433 None] Lock "cinder-quobyte-cb615f18-3857-432d-9177-ff47aa9eb95f" acquired by "delete_volume" :: waited 0.017s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:56:56 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5c503f-216a-49b0-8a7d-38fd397bda78]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:56:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-16d15101-a28a-46bc-8991-aeb4636e3dfe tempest-TestInstancesWithCinderVolumes-1921145433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-cb615f18-3857-432d-9177-ff47aa9eb95f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:56 devstack sudo[100270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7b3b271c-4b28-4fef-b704-3f054ca43c89 Nov 06 17:56:56 devstack sudo[100270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:56 devstack sudo[100271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-cb615f18-3857-432d-9177-ff47aa9eb95f Nov 06 17:56:56 devstack sudo[100271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:56 devstack sudo[100270]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fc5c84ac-2b9b-43f3-88e8-6af57cba675a tempest-VolumesSnapshotTestJSON-187705537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7b3b271c-4b28-4fef-b704-3f054ca43c89" returned: 0 in 0.489s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fc5c84ac-2b9b-43f3-88e8-6af57cba675a tempest-VolumesSnapshotTestJSON-187705537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7b3b271c-4b28-4fef-b704-3f054ca43c89 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:56 devstack sudo[100279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7b3b271c-4b28-4fef-b704-3f054ca43c89 Nov 06 17:56:56 devstack sudo[100279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:56 devstack sudo[100271]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-16d15101-a28a-46bc-8991-aeb4636e3dfe tempest-TestInstancesWithCinderVolumes-1921145433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-cb615f18-3857-432d-9177-ff47aa9eb95f" returned: 0 in 0.562s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-16d15101-a28a-46bc-8991-aeb4636e3dfe tempest-TestInstancesWithCinderVolumes-1921145433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-cb615f18-3857-432d-9177-ff47aa9eb95f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:56 devstack sudo[100287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-cb615f18-3857-432d-9177-ff47aa9eb95f Nov 06 17:56:56 devstack sudo[100287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:56 devstack sudo[100279]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fc5c84ac-2b9b-43f3-88e8-6af57cba675a tempest-VolumesSnapshotTestJSON-187705537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7b3b271c-4b28-4fef-b704-3f054ca43c89" returned: 0 in 0.350s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-fc5c84ac-2b9b-43f3-88e8-6af57cba675a tempest-VolumesSnapshotTestJSON-187705537 None] Lock "cinder-quobyte-7b3b271c-4b28-4fef-b704-3f054ca43c89" released by "delete_volume" :: held 0.962s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:56:57 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-fc5c84ac-2b9b-43f3-88e8-6af57cba675a tempest-VolumesSnapshotTestJSON-187705537 None] Created reservations ['a910631a-ee6e-4731-92d3-3082fd9faa0b', '05dcfc65-4356-4adb-9cd7-fe261aa00cb0', '0358b460-1ecf-4cd8-ba34-45a1a57d6843', 'eaa60e4c-a2ce-46f7-8e3a-40c2283f1947'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:56:57 devstack sudo[100287]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fc5c84ac-2b9b-43f3-88e8-6af57cba675a tempest-VolumesSnapshotTestJSON-187705537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:56:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fc5c84ac-2b9b-43f3-88e8-6af57cba675a tempest-VolumesSnapshotTestJSON-187705537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:56:57 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fc5c84ac-2b9b-43f3-88e8-6af57cba675a tempest-VolumesSnapshotTestJSON-187705537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:56:57 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fc5c84ac-2b9b-43f3-88e8-6af57cba675a tempest-VolumesSnapshotTestJSON-187705537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:56:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fc5c84ac-2b9b-43f3-88e8-6af57cba675a tempest-VolumesSnapshotTestJSON-187705537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:56:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fc5c84ac-2b9b-43f3-88e8-6af57cba675a tempest-VolumesSnapshotTestJSON-187705537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-16d15101-a28a-46bc-8991-aeb4636e3dfe tempest-TestInstancesWithCinderVolumes-1921145433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-cb615f18-3857-432d-9177-ff47aa9eb95f" returned: 0 in 0.489s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-16d15101-a28a-46bc-8991-aeb4636e3dfe tempest-TestInstancesWithCinderVolumes-1921145433 None] Lock "cinder-quobyte-cb615f18-3857-432d-9177-ff47aa9eb95f" released by "delete_volume" :: held 1.121s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:56:57 devstack sudo[100301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:56:57 devstack sudo[100301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:57 devstack cinder-volume[87068]: WARNING cinder.quota [None req-16d15101-a28a-46bc-8991-aeb4636e3dfe tempest-TestInstancesWithCinderVolumes-1921145433 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-610811509-636451134 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-610811509-636451134, it is now deprecated. Please use the default quota class for default quota. Nov 06 17:56:57 devstack cinder-volume[87068]: WARNING cinder.quota [None req-16d15101-a28a-46bc-8991-aeb4636e3dfe tempest-TestInstancesWithCinderVolumes-1921145433 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-610811509-636451134 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-610811509-636451134, it is now deprecated. Please use the default quota class for default quota. Nov 06 17:56:57 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-16d15101-a28a-46bc-8991-aeb4636e3dfe tempest-TestInstancesWithCinderVolumes-1921145433 None] Created reservations ['e02709eb-e998-4e60-8651-f798670111c5', 'cceb091b-a450-4666-8ef5-ad46cf464727', 'e8c1bf91-98e0-423a-8ca6-581d539e5b23', 'b91a535c-54c3-4b86-98d0-162b8cf640b4'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:56:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-16d15101-a28a-46bc-8991-aeb4636e3dfe tempest-TestInstancesWithCinderVolumes-1921145433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:56:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-16d15101-a28a-46bc-8991-aeb4636e3dfe tempest-TestInstancesWithCinderVolumes-1921145433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:56:57 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-16d15101-a28a-46bc-8991-aeb4636e3dfe tempest-TestInstancesWithCinderVolumes-1921145433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:56:57 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-16d15101-a28a-46bc-8991-aeb4636e3dfe tempest-TestInstancesWithCinderVolumes-1921145433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:56:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-16d15101-a28a-46bc-8991-aeb4636e3dfe tempest-TestInstancesWithCinderVolumes-1921145433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:56:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-16d15101-a28a-46bc-8991-aeb4636e3dfe tempest-TestInstancesWithCinderVolumes-1921145433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:57 devstack sudo[100301]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fc5c84ac-2b9b-43f3-88e8-6af57cba675a tempest-VolumesSnapshotTestJSON-187705537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.373s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:57 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-fc5c84ac-2b9b-43f3-88e8-6af57cba675a tempest-VolumesSnapshotTestJSON-187705537 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:56:57 devstack sudo[100306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:56:57 devstack sudo[100306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:57 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-fc5c84ac-2b9b-43f3-88e8-6af57cba675a tempest-VolumesSnapshotTestJSON-187705537 None] Deleted volume successfully. Nov 06 17:56:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-fc5c84ac-2b9b-43f3-88e8-6af57cba675a tempest-VolumesSnapshotTestJSON-187705537 None] Lock "cinder-7b3b271c-4b28-4fef-b704-3f054ca43c89-delete_volume" released by "delete_volume" :: held 1.763s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:56:57 devstack sudo[100306]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-16d15101-a28a-46bc-8991-aeb4636e3dfe tempest-TestInstancesWithCinderVolumes-1921145433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.328s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:57 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-16d15101-a28a-46bc-8991-aeb4636e3dfe tempest-TestInstancesWithCinderVolumes-1921145433 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:56:57 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-16d15101-a28a-46bc-8991-aeb4636e3dfe tempest-TestInstancesWithCinderVolumes-1921145433 None] Deleted volume successfully. Nov 06 17:56:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-16d15101-a28a-46bc-8991-aeb4636e3dfe tempest-TestInstancesWithCinderVolumes-1921145433 None] Lock "cinder-cb615f18-3857-432d-9177-ff47aa9eb95f-delete_volume" released by "delete_volume" :: held 1.866s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:56:58 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-552348c7-7190-4367-b659-17e22eefb18a tempest-VolumesSnapshotTestJSON-187705537 None] Acquiring lock "cinder-822f6ad8-4f03-465b-a1d8-77ff6133e7dd-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:56:58 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-552348c7-7190-4367-b659-17e22eefb18a tempest-VolumesSnapshotTestJSON-187705537 None] Lock "cinder-822f6ad8-4f03-465b-a1d8-77ff6133e7dd-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:56:58 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-552348c7-7190-4367-b659-17e22eefb18a tempest-VolumesSnapshotTestJSON-187705537 None] Acquiring lock "cinder-quobyte-822f6ad8-4f03-465b-a1d8-77ff6133e7dd" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:56:58 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-552348c7-7190-4367-b659-17e22eefb18a tempest-VolumesSnapshotTestJSON-187705537 None] Lock "cinder-quobyte-822f6ad8-4f03-465b-a1d8-77ff6133e7dd" acquired by "delete_volume" :: waited 0.027s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:56:58 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b02b39f-5e8d-4066-9c84-4d23d16faba5]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:56:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-552348c7-7190-4367-b659-17e22eefb18a tempest-VolumesSnapshotTestJSON-187705537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-822f6ad8-4f03-465b-a1d8-77ff6133e7dd {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:58 devstack sudo[100309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-822f6ad8-4f03-465b-a1d8-77ff6133e7dd Nov 06 17:56:58 devstack sudo[100309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:59 devstack sudo[100309]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-552348c7-7190-4367-b659-17e22eefb18a tempest-VolumesSnapshotTestJSON-187705537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-822f6ad8-4f03-465b-a1d8-77ff6133e7dd" returned: 0 in 0.563s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-552348c7-7190-4367-b659-17e22eefb18a tempest-VolumesSnapshotTestJSON-187705537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-822f6ad8-4f03-465b-a1d8-77ff6133e7dd {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:59 devstack sudo[100315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-822f6ad8-4f03-465b-a1d8-77ff6133e7dd Nov 06 17:56:59 devstack sudo[100315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:56:59 devstack sudo[100315]: pam_unix(sudo:session): session closed for user root Nov 06 17:56:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-552348c7-7190-4367-b659-17e22eefb18a tempest-VolumesSnapshotTestJSON-187705537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-822f6ad8-4f03-465b-a1d8-77ff6133e7dd" returned: 0 in 0.408s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:56:59 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-552348c7-7190-4367-b659-17e22eefb18a tempest-VolumesSnapshotTestJSON-187705537 None] Lock "cinder-quobyte-822f6ad8-4f03-465b-a1d8-77ff6133e7dd" released by "delete_volume" :: held 1.081s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:56:59 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-552348c7-7190-4367-b659-17e22eefb18a tempest-VolumesSnapshotTestJSON-187705537 None] Created reservations ['7dbe9048-a151-41ca-ae63-f6cb4020e7c6', '82e93a85-245d-4e5f-a6e6-f4b434a50d14', '49fd0383-875d-40c0-9373-b39a60e5529f', '72b21f27-e860-4eef-a86f-74d655484f28'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:56:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-552348c7-7190-4367-b659-17e22eefb18a tempest-VolumesSnapshotTestJSON-187705537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:56:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-552348c7-7190-4367-b659-17e22eefb18a tempest-VolumesSnapshotTestJSON-187705537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:56:59 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-552348c7-7190-4367-b659-17e22eefb18a tempest-VolumesSnapshotTestJSON-187705537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:56:59 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-552348c7-7190-4367-b659-17e22eefb18a tempest-VolumesSnapshotTestJSON-187705537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:56:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-552348c7-7190-4367-b659-17e22eefb18a tempest-VolumesSnapshotTestJSON-187705537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:56:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-552348c7-7190-4367-b659-17e22eefb18a tempest-VolumesSnapshotTestJSON-187705537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:56:59 devstack sudo[100318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:56:59 devstack sudo[100318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-552348c7-7190-4367-b659-17e22eefb18a tempest-VolumesSnapshotTestJSON-187705537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.337s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:00 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-552348c7-7190-4367-b659-17e22eefb18a tempest-VolumesSnapshotTestJSON-187705537 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:57:00 devstack sudo[100318]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:00 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-552348c7-7190-4367-b659-17e22eefb18a tempest-VolumesSnapshotTestJSON-187705537 None] Deleted volume successfully. Nov 06 17:57:00 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-552348c7-7190-4367-b659-17e22eefb18a tempest-VolumesSnapshotTestJSON-187705537 None] Lock "cinder-822f6ad8-4f03-465b-a1d8-77ff6133e7dd-delete_volume" released by "delete_volume" :: held 1.773s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:57:09 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:UPDATE=110,cinder:SELECT=81,cinder:INSERT=27,cinder:DELETE=8 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 17:57:10 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=101,cinder:INSERT=27,cinder:UPDATE=109,cinder:DELETE=8 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 17:57:14 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-25a7ec0d-5b9d-4ec5-81d6-461b635d7ebd tempest-VolumesSnapshotListTestJSON-1611781330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:57:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-25a7ec0d-5b9d-4ec5-81d6-461b635d7ebd tempest-VolumesSnapshotListTestJSON-1611781330 None] Flow 'volume_create_manager' (21982aa2-db8e-4b0a-959b-c71865565bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:57:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-25a7ec0d-5b9d-4ec5-81d6-461b635d7ebd tempest-VolumesSnapshotListTestJSON-1611781330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd4ce5b1-9929-41ed-851f-ef5e5cd6b574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:57:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-25a7ec0d-5b9d-4ec5-81d6-461b635d7ebd tempest-VolumesSnapshotListTestJSON-1611781330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd4ce5b1-9929-41ed-851f-ef5e5cd6b574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-336203278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fac1ef4-9838-4a2c-a743-0a7b28ba7874,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='016cf20d401842258cb58b158e47c29b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:57:15Z,use_quota=True,user_id='449c02abb2104d41a21b0e4df3c24862',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:57:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-25a7ec0d-5b9d-4ec5-81d6-461b635d7ebd tempest-VolumesSnapshotListTestJSON-1611781330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6366c474-c937-42be-b46d-f9e284d7a290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:57:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-25a7ec0d-5b9d-4ec5-81d6-461b635d7ebd tempest-VolumesSnapshotListTestJSON-1611781330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6366c474-c937-42be-b46d-f9e284d7a290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:57:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-25a7ec0d-5b9d-4ec5-81d6-461b635d7ebd tempest-VolumesSnapshotListTestJSON-1611781330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e01e5853-87c1-40b3-afd6-87368b84ff9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:57:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-25a7ec0d-5b9d-4ec5-81d6-461b635d7ebd tempest-VolumesSnapshotListTestJSON-1611781330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e01e5853-87c1-40b3-afd6-87368b84ff9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fac1ef4-9838-4a2c-a743-0a7b28ba7874', 'volume_name': 'volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:57:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-25a7ec0d-5b9d-4ec5-81d6-461b635d7ebd tempest-VolumesSnapshotListTestJSON-1611781330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ef1cd7c-3975-420d-8519-dde4e9062507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:57:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-25a7ec0d-5b9d-4ec5-81d6-461b635d7ebd tempest-VolumesSnapshotListTestJSON-1611781330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ef1cd7c-3975-420d-8519-dde4e9062507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:57:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-25a7ec0d-5b9d-4ec5-81d6-461b635d7ebd tempest-VolumesSnapshotListTestJSON-1611781330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b859cf5c-f7a4-44da-a89b-f5e0fc29daf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:57:14 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-25a7ec0d-5b9d-4ec5-81d6-461b635d7ebd tempest-VolumesSnapshotListTestJSON-1611781330 None] Volume 4fac1ef4-9838-4a2c-a743-0a7b28ba7874: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874', 'volume_size': 1} Nov 06 17:57:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-25a7ec0d-5b9d-4ec5-81d6-461b635d7ebd tempest-VolumesSnapshotListTestJSON-1611781330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:57:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-25a7ec0d-5b9d-4ec5-81d6-461b635d7ebd tempest-VolumesSnapshotListTestJSON-1611781330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:57:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-25a7ec0d-5b9d-4ec5-81d6-461b635d7ebd tempest-VolumesSnapshotListTestJSON-1611781330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-336203278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fac1ef4-9838-4a2c-a743-0a7b28ba7874,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='016cf20d401842258cb58b158e47c29b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:57:15Z,use_quota=True,user_id='449c02abb2104d41a21b0e4df3c24862',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:57:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-25a7ec0d-5b9d-4ec5-81d6-461b635d7ebd tempest-VolumesSnapshotListTestJSON-1611781330 None] Creating volume 4fac1ef4-9838-4a2c-a743-0a7b28ba7874 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:57:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-25a7ec0d-5b9d-4ec5-81d6-461b635d7ebd tempest-VolumesSnapshotListTestJSON-1611781330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:57:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-25a7ec0d-5b9d-4ec5-81d6-461b635d7ebd tempest-VolumesSnapshotListTestJSON-1611781330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:57:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-25a7ec0d-5b9d-4ec5-81d6-461b635d7ebd tempest-VolumesSnapshotListTestJSON-1611781330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:57:15 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-25a7ec0d-5b9d-4ec5-81d6-461b635d7ebd tempest-VolumesSnapshotListTestJSON-1611781330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:57:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-25a7ec0d-5b9d-4ec5-81d6-461b635d7ebd tempest-VolumesSnapshotListTestJSON-1611781330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:57:15 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-25a7ec0d-5b9d-4ec5-81d6-461b635d7ebd tempest-VolumesSnapshotListTestJSON-1611781330 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:57:15 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-25a7ec0d-5b9d-4ec5-81d6-461b635d7ebd tempest-VolumesSnapshotListTestJSON-1611781330 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:57:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-25a7ec0d-5b9d-4ec5-81d6-461b635d7ebd tempest-VolumesSnapshotListTestJSON-1611781330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:15 devstack sudo[100425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874 1073741824 Nov 06 17:57:15 devstack sudo[100425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:15 devstack sudo[100425]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-25a7ec0d-5b9d-4ec5-81d6-461b635d7ebd tempest-VolumesSnapshotListTestJSON-1611781330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874 1073741824" returned: 0 in 0.544s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-25a7ec0d-5b9d-4ec5-81d6-461b635d7ebd tempest-VolumesSnapshotListTestJSON-1611781330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:15 devstack sudo[100431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874 Nov 06 17:57:15 devstack sudo[100431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:15 devstack sudo[100431]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-25a7ec0d-5b9d-4ec5-81d6-461b635d7ebd tempest-VolumesSnapshotListTestJSON-1611781330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874" returned: 0 in 0.307s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:15 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-25a7ec0d-5b9d-4ec5-81d6-461b635d7ebd tempest-VolumesSnapshotListTestJSON-1611781330 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:57:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-25a7ec0d-5b9d-4ec5-81d6-461b635d7ebd tempest-VolumesSnapshotListTestJSON-1611781330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:57:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-25a7ec0d-5b9d-4ec5-81d6-461b635d7ebd tempest-VolumesSnapshotListTestJSON-1611781330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b859cf5c-f7a4-44da-a89b-f5e0fc29daf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:57:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-25a7ec0d-5b9d-4ec5-81d6-461b635d7ebd tempest-VolumesSnapshotListTestJSON-1611781330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51623486-08a1-4803-8978-b02d28eb64fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:57:15 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-25a7ec0d-5b9d-4ec5-81d6-461b635d7ebd tempest-VolumesSnapshotListTestJSON-1611781330 None] Volume volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874 (4fac1ef4-9838-4a2c-a743-0a7b28ba7874): created successfully Nov 06 17:57:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-25a7ec0d-5b9d-4ec5-81d6-461b635d7ebd tempest-VolumesSnapshotListTestJSON-1611781330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51623486-08a1-4803-8978-b02d28eb64fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:57:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-25a7ec0d-5b9d-4ec5-81d6-461b635d7ebd tempest-VolumesSnapshotListTestJSON-1611781330 None] Flow 'volume_create_manager' (21982aa2-db8e-4b0a-959b-c71865565bb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:57:15 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-25a7ec0d-5b9d-4ec5-81d6-461b635d7ebd tempest-VolumesSnapshotListTestJSON-1611781330 None] Created volume successfully. Nov 06 17:57:16 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-efb91d6a-dff0-4c86-ae6e-0d10a6d1153b tempest-VolumesMetadataTest-1493618100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:57:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-efb91d6a-dff0-4c86-ae6e-0d10a6d1153b tempest-VolumesMetadataTest-1493618100 None] Flow 'volume_create_manager' (52e455e6-511f-4ecf-9b01-7c6efc9a0070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:57:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-efb91d6a-dff0-4c86-ae6e-0d10a6d1153b tempest-VolumesMetadataTest-1493618100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f3fc917-bfd9-428e-a0aa-012259552fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:57:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-efb91d6a-dff0-4c86-ae6e-0d10a6d1153b tempest-VolumesMetadataTest-1493618100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f3fc917-bfd9-428e-a0aa-012259552fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:57:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-747434360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e166f5ae-4337-4e68-80ad-6ae1e70e264d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aabeb3adafa6462281fd8222e755e7a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:57:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:57:16Z,use_quota=True,user_id='b7f59b0b324c4494aa5f0ef271076dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:57:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-efb91d6a-dff0-4c86-ae6e-0d10a6d1153b tempest-VolumesMetadataTest-1493618100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24a50e5a-8ae2-4503-87de-bbf8598c1edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:57:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-efb91d6a-dff0-4c86-ae6e-0d10a6d1153b tempest-VolumesMetadataTest-1493618100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24a50e5a-8ae2-4503-87de-bbf8598c1edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:57:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-efb91d6a-dff0-4c86-ae6e-0d10a6d1153b tempest-VolumesMetadataTest-1493618100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d90b20ae-a34c-4e4d-937e-28182cddd312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:57:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-efb91d6a-dff0-4c86-ae6e-0d10a6d1153b tempest-VolumesMetadataTest-1493618100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d90b20ae-a34c-4e4d-937e-28182cddd312) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e166f5ae-4337-4e68-80ad-6ae1e70e264d', 'volume_name': 'volume-e166f5ae-4337-4e68-80ad-6ae1e70e264d', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:57:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-efb91d6a-dff0-4c86-ae6e-0d10a6d1153b tempest-VolumesMetadataTest-1493618100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c289347f-c273-4070-a415-17519d34f114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:57:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-efb91d6a-dff0-4c86-ae6e-0d10a6d1153b tempest-VolumesMetadataTest-1493618100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c289347f-c273-4070-a415-17519d34f114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:57:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-efb91d6a-dff0-4c86-ae6e-0d10a6d1153b tempest-VolumesMetadataTest-1493618100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (043dcda4-6ddd-4f5e-b7d9-bd37558a6ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:57:16 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-efb91d6a-dff0-4c86-ae6e-0d10a6d1153b tempest-VolumesMetadataTest-1493618100 None] Volume e166f5ae-4337-4e68-80ad-6ae1e70e264d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e166f5ae-4337-4e68-80ad-6ae1e70e264d', 'volume_size': 1} Nov 06 17:57:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-efb91d6a-dff0-4c86-ae6e-0d10a6d1153b tempest-VolumesMetadataTest-1493618100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:57:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-efb91d6a-dff0-4c86-ae6e-0d10a6d1153b tempest-VolumesMetadataTest-1493618100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:57:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-efb91d6a-dff0-4c86-ae6e-0d10a6d1153b tempest-VolumesMetadataTest-1493618100 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:57:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-747434360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e166f5ae-4337-4e68-80ad-6ae1e70e264d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aabeb3adafa6462281fd8222e755e7a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:57:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:57:16Z,use_quota=True,user_id='b7f59b0b324c4494aa5f0ef271076dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:57:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-efb91d6a-dff0-4c86-ae6e-0d10a6d1153b tempest-VolumesMetadataTest-1493618100 None] Creating volume e166f5ae-4337-4e68-80ad-6ae1e70e264d {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:57:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-efb91d6a-dff0-4c86-ae6e-0d10a6d1153b tempest-VolumesMetadataTest-1493618100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:57:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-efb91d6a-dff0-4c86-ae6e-0d10a6d1153b tempest-VolumesMetadataTest-1493618100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:57:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-efb91d6a-dff0-4c86-ae6e-0d10a6d1153b tempest-VolumesMetadataTest-1493618100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:57:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-efb91d6a-dff0-4c86-ae6e-0d10a6d1153b tempest-VolumesMetadataTest-1493618100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:57:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-efb91d6a-dff0-4c86-ae6e-0d10a6d1153b tempest-VolumesMetadataTest-1493618100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:57:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-efb91d6a-dff0-4c86-ae6e-0d10a6d1153b tempest-VolumesMetadataTest-1493618100 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:57:16 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-efb91d6a-dff0-4c86-ae6e-0d10a6d1153b tempest-VolumesMetadataTest-1493618100 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:57:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-efb91d6a-dff0-4c86-ae6e-0d10a6d1153b tempest-VolumesMetadataTest-1493618100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e166f5ae-4337-4e68-80ad-6ae1e70e264d 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:16 devstack sudo[100434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e166f5ae-4337-4e68-80ad-6ae1e70e264d 1073741824 Nov 06 17:57:16 devstack sudo[100434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:16 devstack sudo[100434]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-efb91d6a-dff0-4c86-ae6e-0d10a6d1153b tempest-VolumesMetadataTest-1493618100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e166f5ae-4337-4e68-80ad-6ae1e70e264d 1073741824" returned: 0 in 0.475s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-efb91d6a-dff0-4c86-ae6e-0d10a6d1153b tempest-VolumesMetadataTest-1493618100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e166f5ae-4337-4e68-80ad-6ae1e70e264d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:16 devstack sudo[100440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e166f5ae-4337-4e68-80ad-6ae1e70e264d Nov 06 17:57:16 devstack sudo[100440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:16 devstack sudo[100440]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-efb91d6a-dff0-4c86-ae6e-0d10a6d1153b tempest-VolumesMetadataTest-1493618100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e166f5ae-4337-4e68-80ad-6ae1e70e264d" returned: 0 in 0.267s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-efb91d6a-dff0-4c86-ae6e-0d10a6d1153b tempest-VolumesMetadataTest-1493618100 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:57:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-efb91d6a-dff0-4c86-ae6e-0d10a6d1153b tempest-VolumesMetadataTest-1493618100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:57:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-efb91d6a-dff0-4c86-ae6e-0d10a6d1153b tempest-VolumesMetadataTest-1493618100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (043dcda4-6ddd-4f5e-b7d9-bd37558a6ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e166f5ae-4337-4e68-80ad-6ae1e70e264d', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:57:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-efb91d6a-dff0-4c86-ae6e-0d10a6d1153b tempest-VolumesMetadataTest-1493618100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e472629-3806-4978-bdfa-7a4e75b3206b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:57:17 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-efb91d6a-dff0-4c86-ae6e-0d10a6d1153b tempest-VolumesMetadataTest-1493618100 None] Volume volume-e166f5ae-4337-4e68-80ad-6ae1e70e264d (e166f5ae-4337-4e68-80ad-6ae1e70e264d): created successfully Nov 06 17:57:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-efb91d6a-dff0-4c86-ae6e-0d10a6d1153b tempest-VolumesMetadataTest-1493618100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e472629-3806-4978-bdfa-7a4e75b3206b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:57:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-efb91d6a-dff0-4c86-ae6e-0d10a6d1153b tempest-VolumesMetadataTest-1493618100 None] Flow 'volume_create_manager' (52e455e6-511f-4ecf-9b01-7c6efc9a0070) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:57:17 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-efb91d6a-dff0-4c86-ae6e-0d10a6d1153b tempest-VolumesMetadataTest-1493618100 None] Created volume successfully. Nov 06 17:57:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-81c68a18-f7ea-455b-8f12-f0c913d94ba3 tempest-VolumesSnapshotListTestJSON-1611781330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:57:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-81c68a18-f7ea-455b-8f12-f0c913d94ba3 tempest-VolumesSnapshotListTestJSON-1611781330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:57:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-81c68a18-f7ea-455b-8f12-f0c913d94ba3 tempest-VolumesSnapshotListTestJSON-1611781330 None] Creating offline snapshot a38d6e41-30df-419a-aa01-a087d24e3b72 of volume 4fac1ef4-9838-4a2c-a743-0a7b28ba7874 {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 17:57:17 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[76408074-fbed-4a85-9e06-3a467ec0e78e]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:57:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-81c68a18-f7ea-455b-8f12-f0c913d94ba3 tempest-VolumesSnapshotListTestJSON-1611781330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:17 devstack sudo[100443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874 Nov 06 17:57:17 devstack sudo[100443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:17 devstack sudo[100443]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-81c68a18-f7ea-455b-8f12-f0c913d94ba3 tempest-VolumesSnapshotListTestJSON-1611781330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874" returned: 0 in 0.445s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-81c68a18-f7ea-455b-8f12-f0c913d94ba3 tempest-VolumesSnapshotListTestJSON-1611781330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.a38d6e41-30df-419a-aa01-a087d24e3b72 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:17 devstack sudo[100448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.a38d6e41-30df-419a-aa01-a087d24e3b72 1G Nov 06 17:57:17 devstack sudo[100448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:18 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-7a56b688-93db-4c30-bc69-8a3e09faec9c tempest-VolumesMetadataTest-1493618100 None] Acquiring lock "cinder-e166f5ae-4337-4e68-80ad-6ae1e70e264d-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:57:18 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-7a56b688-93db-4c30-bc69-8a3e09faec9c tempest-VolumesMetadataTest-1493618100 None] Lock "cinder-e166f5ae-4337-4e68-80ad-6ae1e70e264d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:57:18 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-7a56b688-93db-4c30-bc69-8a3e09faec9c tempest-VolumesMetadataTest-1493618100 None] Acquiring lock "cinder-quobyte-e166f5ae-4337-4e68-80ad-6ae1e70e264d" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:57:18 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-7a56b688-93db-4c30-bc69-8a3e09faec9c tempest-VolumesMetadataTest-1493618100 None] Lock "cinder-quobyte-e166f5ae-4337-4e68-80ad-6ae1e70e264d" acquired by "delete_volume" :: waited 0.028s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:57:18 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9731cf-0036-4616-b349-cada83c7e7f6]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:57:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7a56b688-93db-4c30-bc69-8a3e09faec9c tempest-VolumesMetadataTest-1493618100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e166f5ae-4337-4e68-80ad-6ae1e70e264d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:18 devstack sudo[100448]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-81c68a18-f7ea-455b-8f12-f0c913d94ba3 tempest-VolumesSnapshotListTestJSON-1611781330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.a38d6e41-30df-419a-aa01-a087d24e3b72 1G" returned: 0 in 0.567s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-81c68a18-f7ea-455b-8f12-f0c913d94ba3 tempest-VolumesSnapshotListTestJSON-1611781330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.a38d6e41-30df-419a-aa01-a087d24e3b72 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:18 devstack sudo[100455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.a38d6e41-30df-419a-aa01-a087d24e3b72 Nov 06 17:57:18 devstack sudo[100455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:18 devstack sudo[100454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e166f5ae-4337-4e68-80ad-6ae1e70e264d Nov 06 17:57:18 devstack sudo[100454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:18 devstack sudo[100455]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-81c68a18-f7ea-455b-8f12-f0c913d94ba3 tempest-VolumesSnapshotListTestJSON-1611781330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.a38d6e41-30df-419a-aa01-a087d24e3b72" returned: 0 in 0.333s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:18 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-81c68a18-f7ea-455b-8f12-f0c913d94ba3 tempest-VolumesSnapshotListTestJSON-1611781330 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.a38d6e41-30df-419a-aa01-a087d24e3b72 is being set with open permissions: ugo+rw Nov 06 17:57:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-81c68a18-f7ea-455b-8f12-f0c913d94ba3 tempest-VolumesSnapshotListTestJSON-1611781330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.a38d6e41-30df-419a-aa01-a087d24e3b72 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:18 devstack sudo[100463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.a38d6e41-30df-419a-aa01-a087d24e3b72 Nov 06 17:57:18 devstack sudo[100463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:18 devstack sudo[100454]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7a56b688-93db-4c30-bc69-8a3e09faec9c tempest-VolumesMetadataTest-1493618100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e166f5ae-4337-4e68-80ad-6ae1e70e264d" returned: 0 in 0.458s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7a56b688-93db-4c30-bc69-8a3e09faec9c tempest-VolumesMetadataTest-1493618100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e166f5ae-4337-4e68-80ad-6ae1e70e264d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:18 devstack sudo[100466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e166f5ae-4337-4e68-80ad-6ae1e70e264d Nov 06 17:57:18 devstack sudo[100466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:18 devstack sudo[100463]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-81c68a18-f7ea-455b-8f12-f0c913d94ba3 tempest-VolumesSnapshotListTestJSON-1611781330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.a38d6e41-30df-419a-aa01-a087d24e3b72" returned: 0 in 0.292s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-81c68a18-f7ea-455b-8f12-f0c913d94ba3 tempest-VolumesSnapshotListTestJSON-1611781330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:19 devstack sudo[100469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.info Nov 06 17:57:19 devstack sudo[100469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:19 devstack sudo[100466]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7a56b688-93db-4c30-bc69-8a3e09faec9c tempest-VolumesMetadataTest-1493618100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e166f5ae-4337-4e68-80ad-6ae1e70e264d" returned: 0 in 0.331s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:19 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-7a56b688-93db-4c30-bc69-8a3e09faec9c tempest-VolumesMetadataTest-1493618100 None] Lock "cinder-quobyte-e166f5ae-4337-4e68-80ad-6ae1e70e264d" released by "delete_volume" :: held 0.853s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:57:19 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-7a56b688-93db-4c30-bc69-8a3e09faec9c tempest-VolumesMetadataTest-1493618100 None] Created reservations ['7127b96a-9cb8-43c8-a8fd-f1396052e0c1', 'beadba64-9490-4696-97fa-71c107e9f24b', '09e14d90-7765-4a2b-8a26-8443388d836a', '3eacd6be-2dcd-4043-b56a-665e830ba519'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:57:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7a56b688-93db-4c30-bc69-8a3e09faec9c tempest-VolumesMetadataTest-1493618100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:57:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7a56b688-93db-4c30-bc69-8a3e09faec9c tempest-VolumesMetadataTest-1493618100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:57:19 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7a56b688-93db-4c30-bc69-8a3e09faec9c tempest-VolumesMetadataTest-1493618100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:57:19 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7a56b688-93db-4c30-bc69-8a3e09faec9c tempest-VolumesMetadataTest-1493618100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:57:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7a56b688-93db-4c30-bc69-8a3e09faec9c tempest-VolumesMetadataTest-1493618100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:57:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7a56b688-93db-4c30-bc69-8a3e09faec9c tempest-VolumesMetadataTest-1493618100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:19 devstack sudo[100473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:57:19 devstack sudo[100473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:19 devstack sudo[100469]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-81c68a18-f7ea-455b-8f12-f0c913d94ba3 tempest-VolumesSnapshotListTestJSON-1611781330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.info" returned: 0 in 0.379s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:19 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-81c68a18-f7ea-455b-8f12-f0c913d94ba3 tempest-VolumesSnapshotListTestJSON-1611781330 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.info is being set with open permissions: ugo+rw Nov 06 17:57:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-81c68a18-f7ea-455b-8f12-f0c913d94ba3 tempest-VolumesSnapshotListTestJSON-1611781330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:19 devstack sudo[100475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.info Nov 06 17:57:19 devstack sudo[100475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:19 devstack sudo[100473]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7a56b688-93db-4c30-bc69-8a3e09faec9c tempest-VolumesMetadataTest-1493618100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.356s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:19 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-7a56b688-93db-4c30-bc69-8a3e09faec9c tempest-VolumesMetadataTest-1493618100 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:57:19 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-7a56b688-93db-4c30-bc69-8a3e09faec9c tempest-VolumesMetadataTest-1493618100 None] Deleted volume successfully. Nov 06 17:57:19 devstack sudo[100475]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-81c68a18-f7ea-455b-8f12-f0c913d94ba3 tempest-VolumesSnapshotListTestJSON-1611781330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.info" returned: 0 in 0.336s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-81c68a18-f7ea-455b-8f12-f0c913d94ba3 tempest-VolumesSnapshotListTestJSON-1611781330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.472s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:57:19 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-7a56b688-93db-4c30-bc69-8a3e09faec9c tempest-VolumesMetadataTest-1493618100 None] Lock "cinder-e166f5ae-4337-4e68-80ad-6ae1e70e264d-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:57:19 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-81c68a18-f7ea-455b-8f12-f0c913d94ba3 tempest-VolumesSnapshotListTestJSON-1611781330 None] Create snapshot completed successfully Nov 06 17:57:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d299d4fc-626c-433b-8a29-db352f7718b2 tempest-VolumesSnapshotListTestJSON-1611781330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:57:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d299d4fc-626c-433b-8a29-db352f7718b2 tempest-VolumesSnapshotListTestJSON-1611781330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:57:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-d299d4fc-626c-433b-8a29-db352f7718b2 tempest-VolumesSnapshotListTestJSON-1611781330 None] Creating offline snapshot ba366892-53a3-4216-b695-181af7be7b5b of volume 4fac1ef4-9838-4a2c-a743-0a7b28ba7874 {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 17:57:20 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[414f2a9f-89bf-4b29-a0fe-ba4ea31eacb8]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:57:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d299d4fc-626c-433b-8a29-db352f7718b2 tempest-VolumesSnapshotListTestJSON-1611781330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.a38d6e41-30df-419a-aa01-a087d24e3b72 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:20 devstack sudo[100480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.a38d6e41-30df-419a-aa01-a087d24e3b72 Nov 06 17:57:20 devstack sudo[100480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:21 devstack sudo[100480]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d299d4fc-626c-433b-8a29-db352f7718b2 tempest-VolumesSnapshotListTestJSON-1611781330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.a38d6e41-30df-419a-aa01-a087d24e3b72" returned: 0 in 0.447s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:21 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-d299d4fc-626c-433b-8a29-db352f7718b2 tempest-VolumesSnapshotListTestJSON-1611781330 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 17:57:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d299d4fc-626c-433b-8a29-db352f7718b2 tempest-VolumesSnapshotListTestJSON-1611781330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.a38d6e41-30df-419a-aa01-a087d24e3b72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.ba366892-53a3-4216-b695-181af7be7b5b 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:21 devstack sudo[100486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.a38d6e41-30df-419a-aa01-a087d24e3b72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.ba366892-53a3-4216-b695-181af7be7b5b 1G Nov 06 17:57:21 devstack sudo[100486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:21 devstack sudo[100486]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d299d4fc-626c-433b-8a29-db352f7718b2 tempest-VolumesSnapshotListTestJSON-1611781330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.a38d6e41-30df-419a-aa01-a087d24e3b72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.ba366892-53a3-4216-b695-181af7be7b5b 1G" returned: 0 in 0.625s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d299d4fc-626c-433b-8a29-db352f7718b2 tempest-VolumesSnapshotListTestJSON-1611781330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.a38d6e41-30df-419a-aa01-a087d24e3b72 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.ba366892-53a3-4216-b695-181af7be7b5b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:21 devstack sudo[100492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.a38d6e41-30df-419a-aa01-a087d24e3b72 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.ba366892-53a3-4216-b695-181af7be7b5b Nov 06 17:57:21 devstack sudo[100492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:22 devstack sudo[100492]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d299d4fc-626c-433b-8a29-db352f7718b2 tempest-VolumesSnapshotListTestJSON-1611781330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.a38d6e41-30df-419a-aa01-a087d24e3b72 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.ba366892-53a3-4216-b695-181af7be7b5b" returned: 0 in 0.466s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:22 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-d299d4fc-626c-433b-8a29-db352f7718b2 tempest-VolumesSnapshotListTestJSON-1611781330 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.ba366892-53a3-4216-b695-181af7be7b5b is being set with open permissions: ugo+rw Nov 06 17:57:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d299d4fc-626c-433b-8a29-db352f7718b2 tempest-VolumesSnapshotListTestJSON-1611781330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.ba366892-53a3-4216-b695-181af7be7b5b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:22 devstack sudo[100497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.ba366892-53a3-4216-b695-181af7be7b5b Nov 06 17:57:22 devstack sudo[100497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:22 devstack sudo[100497]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d299d4fc-626c-433b-8a29-db352f7718b2 tempest-VolumesSnapshotListTestJSON-1611781330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.ba366892-53a3-4216-b695-181af7be7b5b" returned: 0 in 0.286s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d299d4fc-626c-433b-8a29-db352f7718b2 tempest-VolumesSnapshotListTestJSON-1611781330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.984s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:57:22 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-d299d4fc-626c-433b-8a29-db352f7718b2 tempest-VolumesSnapshotListTestJSON-1611781330 None] Create snapshot completed successfully Nov 06 17:57:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-dfcf29dc-f5a5-42da-ae51-defb8fbd43de tempest-VolumesSnapshotListTestJSON-1611781330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:57:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-dfcf29dc-f5a5-42da-ae51-defb8fbd43de tempest-VolumesSnapshotListTestJSON-1611781330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:57:23 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-dfcf29dc-f5a5-42da-ae51-defb8fbd43de tempest-VolumesSnapshotListTestJSON-1611781330 None] Creating offline snapshot 1e901e03-88e0-46d5-8364-8952cebd476f of volume 4fac1ef4-9838-4a2c-a743-0a7b28ba7874 {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 17:57:23 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9ea804-1aba-41e8-813a-0020e6e59c93]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:57:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-dfcf29dc-f5a5-42da-ae51-defb8fbd43de tempest-VolumesSnapshotListTestJSON-1611781330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.ba366892-53a3-4216-b695-181af7be7b5b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:23 devstack sudo[100500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.ba366892-53a3-4216-b695-181af7be7b5b Nov 06 17:57:23 devstack sudo[100500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:23 devstack sudo[100500]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-dfcf29dc-f5a5-42da-ae51-defb8fbd43de tempest-VolumesSnapshotListTestJSON-1611781330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.ba366892-53a3-4216-b695-181af7be7b5b" returned: 0 in 0.640s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:23 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-dfcf29dc-f5a5-42da-ae51-defb8fbd43de tempest-VolumesSnapshotListTestJSON-1611781330 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 17:57:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-dfcf29dc-f5a5-42da-ae51-defb8fbd43de tempest-VolumesSnapshotListTestJSON-1611781330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.ba366892-53a3-4216-b695-181af7be7b5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.1e901e03-88e0-46d5-8364-8952cebd476f 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:23 devstack sudo[100505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.ba366892-53a3-4216-b695-181af7be7b5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.1e901e03-88e0-46d5-8364-8952cebd476f 1G Nov 06 17:57:23 devstack sudo[100505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:24 devstack sudo[100505]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-dfcf29dc-f5a5-42da-ae51-defb8fbd43de tempest-VolumesSnapshotListTestJSON-1611781330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.ba366892-53a3-4216-b695-181af7be7b5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.1e901e03-88e0-46d5-8364-8952cebd476f 1G" returned: 0 in 0.670s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-dfcf29dc-f5a5-42da-ae51-defb8fbd43de tempest-VolumesSnapshotListTestJSON-1611781330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.ba366892-53a3-4216-b695-181af7be7b5b -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.1e901e03-88e0-46d5-8364-8952cebd476f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:24 devstack sudo[100511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.ba366892-53a3-4216-b695-181af7be7b5b -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.1e901e03-88e0-46d5-8364-8952cebd476f Nov 06 17:57:24 devstack sudo[100511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:24 devstack sudo[100511]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-dfcf29dc-f5a5-42da-ae51-defb8fbd43de tempest-VolumesSnapshotListTestJSON-1611781330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.ba366892-53a3-4216-b695-181af7be7b5b -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.1e901e03-88e0-46d5-8364-8952cebd476f" returned: 0 in 0.394s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:24 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-dfcf29dc-f5a5-42da-ae51-defb8fbd43de tempest-VolumesSnapshotListTestJSON-1611781330 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.1e901e03-88e0-46d5-8364-8952cebd476f is being set with open permissions: ugo+rw Nov 06 17:57:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-dfcf29dc-f5a5-42da-ae51-defb8fbd43de tempest-VolumesSnapshotListTestJSON-1611781330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.1e901e03-88e0-46d5-8364-8952cebd476f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:24 devstack sudo[100517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.1e901e03-88e0-46d5-8364-8952cebd476f Nov 06 17:57:24 devstack sudo[100517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:25 devstack sudo[100517]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-dfcf29dc-f5a5-42da-ae51-defb8fbd43de tempest-VolumesSnapshotListTestJSON-1611781330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.1e901e03-88e0-46d5-8364-8952cebd476f" returned: 0 in 0.306s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-dfcf29dc-f5a5-42da-ae51-defb8fbd43de tempest-VolumesSnapshotListTestJSON-1611781330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.175s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:57:25 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-dfcf29dc-f5a5-42da-ae51-defb8fbd43de tempest-VolumesSnapshotListTestJSON-1611781330 None] Create snapshot completed successfully Nov 06 17:57:26 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-350e0dfc-a415-4b78-a1b6-a74448dec718 tempest-VolumesTransfersV357Test-1040090716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:57:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-350e0dfc-a415-4b78-a1b6-a74448dec718 tempest-VolumesTransfersV357Test-1040090716 None] Flow 'volume_create_manager' (08dfe908-cb16-4b8d-b180-40d77b1c61ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:57:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-350e0dfc-a415-4b78-a1b6-a74448dec718 tempest-VolumesTransfersV357Test-1040090716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86c6fa9d-681c-460e-861f-43fb5f28e476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:57:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-350e0dfc-a415-4b78-a1b6-a74448dec718 tempest-VolumesTransfersV357Test-1040090716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86c6fa9d-681c-460e-861f-43fb5f28e476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:57:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2145212247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e8771f1-6406-4137-94d1-c879927aebe9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b9c448552f1478ba9a3ae491ce445c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:57:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:57:26Z,use_quota=True,user_id='e59c9139e8e44f46b427d885c5e5d7c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:57:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-350e0dfc-a415-4b78-a1b6-a74448dec718 tempest-VolumesTransfersV357Test-1040090716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b49a6023-65fc-4511-a6c4-5c7f82064c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:57:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-350e0dfc-a415-4b78-a1b6-a74448dec718 tempest-VolumesTransfersV357Test-1040090716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b49a6023-65fc-4511-a6c4-5c7f82064c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:57:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-350e0dfc-a415-4b78-a1b6-a74448dec718 tempest-VolumesTransfersV357Test-1040090716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3bfe451-a991-479a-a808-d38e8947dbc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:57:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-350e0dfc-a415-4b78-a1b6-a74448dec718 tempest-VolumesTransfersV357Test-1040090716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3bfe451-a991-479a-a808-d38e8947dbc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e8771f1-6406-4137-94d1-c879927aebe9', 'volume_name': 'volume-6e8771f1-6406-4137-94d1-c879927aebe9', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:57:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-350e0dfc-a415-4b78-a1b6-a74448dec718 tempest-VolumesTransfersV357Test-1040090716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fa505bd-b0d8-4680-87e4-ca7f4e3b3aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:57:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-350e0dfc-a415-4b78-a1b6-a74448dec718 tempest-VolumesTransfersV357Test-1040090716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fa505bd-b0d8-4680-87e4-ca7f4e3b3aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:57:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-350e0dfc-a415-4b78-a1b6-a74448dec718 tempest-VolumesTransfersV357Test-1040090716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e86375df-5e9c-4094-83b3-6f375bd25526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:57:26 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-350e0dfc-a415-4b78-a1b6-a74448dec718 tempest-VolumesTransfersV357Test-1040090716 None] Volume 6e8771f1-6406-4137-94d1-c879927aebe9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e8771f1-6406-4137-94d1-c879927aebe9', 'volume_size': 1} Nov 06 17:57:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-350e0dfc-a415-4b78-a1b6-a74448dec718 tempest-VolumesTransfersV357Test-1040090716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:57:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-350e0dfc-a415-4b78-a1b6-a74448dec718 tempest-VolumesTransfersV357Test-1040090716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:57:26 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-350e0dfc-a415-4b78-a1b6-a74448dec718 tempest-VolumesTransfersV357Test-1040090716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:57:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2145212247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e8771f1-6406-4137-94d1-c879927aebe9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b9c448552f1478ba9a3ae491ce445c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:57:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:57:26Z,use_quota=True,user_id='e59c9139e8e44f46b427d885c5e5d7c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:57:26 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-350e0dfc-a415-4b78-a1b6-a74448dec718 tempest-VolumesTransfersV357Test-1040090716 None] Creating volume 6e8771f1-6406-4137-94d1-c879927aebe9 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:57:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-350e0dfc-a415-4b78-a1b6-a74448dec718 tempest-VolumesTransfersV357Test-1040090716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:57:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-350e0dfc-a415-4b78-a1b6-a74448dec718 tempest-VolumesTransfersV357Test-1040090716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:57:26 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-350e0dfc-a415-4b78-a1b6-a74448dec718 tempest-VolumesTransfersV357Test-1040090716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:57:26 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-350e0dfc-a415-4b78-a1b6-a74448dec718 tempest-VolumesTransfersV357Test-1040090716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:57:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-350e0dfc-a415-4b78-a1b6-a74448dec718 tempest-VolumesTransfersV357Test-1040090716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:57:26 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-350e0dfc-a415-4b78-a1b6-a74448dec718 tempest-VolumesTransfersV357Test-1040090716 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:57:26 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-350e0dfc-a415-4b78-a1b6-a74448dec718 tempest-VolumesTransfersV357Test-1040090716 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:57:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-350e0dfc-a415-4b78-a1b6-a74448dec718 tempest-VolumesTransfersV357Test-1040090716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6e8771f1-6406-4137-94d1-c879927aebe9 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:26 devstack sudo[100520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6e8771f1-6406-4137-94d1-c879927aebe9 1073741824 Nov 06 17:57:26 devstack sudo[100520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:26 devstack sudo[100520]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-350e0dfc-a415-4b78-a1b6-a74448dec718 tempest-VolumesTransfersV357Test-1040090716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6e8771f1-6406-4137-94d1-c879927aebe9 1073741824" returned: 0 in 0.655s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-350e0dfc-a415-4b78-a1b6-a74448dec718 tempest-VolumesTransfersV357Test-1040090716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6e8771f1-6406-4137-94d1-c879927aebe9 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:26 devstack sudo[100525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6e8771f1-6406-4137-94d1-c879927aebe9 Nov 06 17:57:26 devstack sudo[100525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:27 devstack sudo[100525]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-350e0dfc-a415-4b78-a1b6-a74448dec718 tempest-VolumesTransfersV357Test-1040090716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6e8771f1-6406-4137-94d1-c879927aebe9" returned: 0 in 0.317s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-350e0dfc-a415-4b78-a1b6-a74448dec718 tempest-VolumesTransfersV357Test-1040090716 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:57:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-350e0dfc-a415-4b78-a1b6-a74448dec718 tempest-VolumesTransfersV357Test-1040090716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:57:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-350e0dfc-a415-4b78-a1b6-a74448dec718 tempest-VolumesTransfersV357Test-1040090716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e86375df-5e9c-4094-83b3-6f375bd25526) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e8771f1-6406-4137-94d1-c879927aebe9', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:57:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-350e0dfc-a415-4b78-a1b6-a74448dec718 tempest-VolumesTransfersV357Test-1040090716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f63918c9-b8a5-4ee3-822c-be386485570b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:57:27 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-350e0dfc-a415-4b78-a1b6-a74448dec718 tempest-VolumesTransfersV357Test-1040090716 None] Volume volume-6e8771f1-6406-4137-94d1-c879927aebe9 (6e8771f1-6406-4137-94d1-c879927aebe9): created successfully Nov 06 17:57:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-350e0dfc-a415-4b78-a1b6-a74448dec718 tempest-VolumesTransfersV357Test-1040090716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f63918c9-b8a5-4ee3-822c-be386485570b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:57:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-350e0dfc-a415-4b78-a1b6-a74448dec718 tempest-VolumesTransfersV357Test-1040090716 None] Flow 'volume_create_manager' (08dfe908-cb16-4b8d-b180-40d77b1c61ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:57:27 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-350e0dfc-a415-4b78-a1b6-a74448dec718 tempest-VolumesTransfersV357Test-1040090716 None] Created volume successfully. Nov 06 17:57:27 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d4c79dbf-21fa-41cc-81c3-87565dc08909 tempest-VolumesSnapshotListTestJSON-1611781330 None] Acquiring lock "cinder-1e901e03-88e0-46d5-8364-8952cebd476f-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:57:27 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d4c79dbf-21fa-41cc-81c3-87565dc08909 tempest-VolumesSnapshotListTestJSON-1611781330 None] Lock "cinder-1e901e03-88e0-46d5-8364-8952cebd476f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:57:27 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d4c79dbf-21fa-41cc-81c3-87565dc08909 tempest-VolumesSnapshotListTestJSON-1611781330 None] Acquiring lock "cinder-quobyte-4fac1ef4-9838-4a2c-a743-0a7b28ba7874" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:57:27 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d4c79dbf-21fa-41cc-81c3-87565dc08909 tempest-VolumesSnapshotListTestJSON-1611781330 None] Lock "cinder-quobyte-4fac1ef4-9838-4a2c-a743-0a7b28ba7874" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:57:27 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d4c79dbf-21fa-41cc-81c3-87565dc08909 tempest-VolumesSnapshotListTestJSON-1611781330 None] Acquiring lock "cinder-quobyte-1e901e03-88e0-46d5-8364-8952cebd476f" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:57:27 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d4c79dbf-21fa-41cc-81c3-87565dc08909 tempest-VolumesSnapshotListTestJSON-1611781330 None] Lock "cinder-quobyte-1e901e03-88e0-46d5-8364-8952cebd476f" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:57:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-d4c79dbf-21fa-41cc-81c3-87565dc08909 tempest-VolumesSnapshotListTestJSON-1611781330 None] Deleting offline snapshot 1e901e03-88e0-46d5-8364-8952cebd476f of volume 4fac1ef4-9838-4a2c-a743-0a7b28ba7874 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 17:57:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-d4c79dbf-21fa-41cc-81c3-87565dc08909 tempest-VolumesSnapshotListTestJSON-1611781330 None] snapshot_file for this snap is: volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.1e901e03-88e0-46d5-8364-8952cebd476f {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 17:57:27 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fbd2306-699f-4d6d-bd7f-e584e0fce7cf]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:57:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d4c79dbf-21fa-41cc-81c3-87565dc08909 tempest-VolumesSnapshotListTestJSON-1611781330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.1e901e03-88e0-46d5-8364-8952cebd476f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:27 devstack sudo[100528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.1e901e03-88e0-46d5-8364-8952cebd476f Nov 06 17:57:27 devstack sudo[100528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:28 devstack sudo[100528]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d4c79dbf-21fa-41cc-81c3-87565dc08909 tempest-VolumesSnapshotListTestJSON-1611781330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.1e901e03-88e0-46d5-8364-8952cebd476f" returned: 0 in 0.406s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-d4c79dbf-21fa-41cc-81c3-87565dc08909 tempest-VolumesSnapshotListTestJSON-1611781330 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 17:57:28 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7fa6834-f3f7-4c7b-ac72-0b6aeedd59ad]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:57:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d4c79dbf-21fa-41cc-81c3-87565dc08909 tempest-VolumesSnapshotListTestJSON-1611781330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.ba366892-53a3-4216-b695-181af7be7b5b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:28 devstack sudo[100533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.ba366892-53a3-4216-b695-181af7be7b5b Nov 06 17:57:28 devstack sudo[100533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:28 devstack sudo[100533]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d4c79dbf-21fa-41cc-81c3-87565dc08909 tempest-VolumesSnapshotListTestJSON-1611781330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.ba366892-53a3-4216-b695-181af7be7b5b" returned: 0 in 0.514s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-d4c79dbf-21fa-41cc-81c3-87565dc08909 tempest-VolumesSnapshotListTestJSON-1611781330 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 17:57:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d4c79dbf-21fa-41cc-81c3-87565dc08909 tempest-VolumesSnapshotListTestJSON-1611781330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.1e901e03-88e0-46d5-8364-8952cebd476f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:28 devstack sudo[100539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.1e901e03-88e0-46d5-8364-8952cebd476f Nov 06 17:57:28 devstack sudo[100539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:28 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-3ef7cc3c-ae38-4254-a6c6-5bc093b4802a tempest-VolumesTransfersV357Test-1932635771 None] Transfer volume completed successfully. Nov 06 17:57:29 devstack sudo[100539]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d4c79dbf-21fa-41cc-81c3-87565dc08909 tempest-VolumesSnapshotListTestJSON-1611781330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.1e901e03-88e0-46d5-8364-8952cebd476f" returned: 0 in 0.656s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d4c79dbf-21fa-41cc-81c3-87565dc08909 tempest-VolumesSnapshotListTestJSON-1611781330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.1e901e03-88e0-46d5-8364-8952cebd476f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:29 devstack sudo[100546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.1e901e03-88e0-46d5-8364-8952cebd476f Nov 06 17:57:29 devstack sudo[100546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:29 devstack sudo[100546]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:29 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-61b30c2a-a58a-4c36-ba05-56d4c245fd6e tempest-VolumesTransfersV357Test-1892506575 None] Acquiring lock "cinder-6e8771f1-6406-4137-94d1-c879927aebe9-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:57:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d4c79dbf-21fa-41cc-81c3-87565dc08909 tempest-VolumesSnapshotListTestJSON-1611781330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.1e901e03-88e0-46d5-8364-8952cebd476f" returned: 0 in 0.380s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:29 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d4c79dbf-21fa-41cc-81c3-87565dc08909 tempest-VolumesSnapshotListTestJSON-1611781330 None] Lock "cinder-quobyte-1e901e03-88e0-46d5-8364-8952cebd476f" released by "_delete_snapshot" :: held 2.109s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:57:29 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-61b30c2a-a58a-4c36-ba05-56d4c245fd6e tempest-VolumesTransfersV357Test-1892506575 None] Lock "cinder-6e8771f1-6406-4137-94d1-c879927aebe9-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:57:29 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d4c79dbf-21fa-41cc-81c3-87565dc08909 tempest-VolumesSnapshotListTestJSON-1611781330 None] Lock "cinder-quobyte-4fac1ef4-9838-4a2c-a743-0a7b28ba7874" released by "delete_snapshot" :: held 2.173s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:57:29 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-61b30c2a-a58a-4c36-ba05-56d4c245fd6e tempest-VolumesTransfersV357Test-1892506575 None] Acquiring lock "cinder-quobyte-6e8771f1-6406-4137-94d1-c879927aebe9" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:57:29 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-61b30c2a-a58a-4c36-ba05-56d4c245fd6e tempest-VolumesTransfersV357Test-1892506575 None] Lock "cinder-quobyte-6e8771f1-6406-4137-94d1-c879927aebe9" acquired by "delete_volume" :: waited 0.025s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:57:29 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[789b0762-0bca-4aaf-a4d7-27c148256984]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:57:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-61b30c2a-a58a-4c36-ba05-56d4c245fd6e tempest-VolumesTransfersV357Test-1892506575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6e8771f1-6406-4137-94d1-c879927aebe9 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:29 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-d4c79dbf-21fa-41cc-81c3-87565dc08909 tempest-VolumesSnapshotListTestJSON-1611781330 None] Created reservations ['402227df-e805-450b-b970-8e8bfcfd8ae8', '88ae147d-7d98-42eb-8321-cf6ccbdd5da4', 'f5f336b7-b180-45ed-a69f-7487d5424446', '12958a36-b812-48e8-83b9-565d60fc7b44'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:57:30 devstack sudo[100549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6e8771f1-6406-4137-94d1-c879927aebe9 Nov 06 17:57:30 devstack sudo[100549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:30 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-d4c79dbf-21fa-41cc-81c3-87565dc08909 tempest-VolumesSnapshotListTestJSON-1611781330 None] Delete snapshot completed successfully. Nov 06 17:57:30 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d4c79dbf-21fa-41cc-81c3-87565dc08909 tempest-VolumesSnapshotListTestJSON-1611781330 None] Lock "cinder-1e901e03-88e0-46d5-8364-8952cebd476f-delete_snapshot" released by "delete_snapshot" :: held 2.459s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:57:30 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-600c762d-aef7-4ced-8300-fd420996606b tempest-TestServerVolumeAttachScenarioOldVersion-1477057444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:57:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-600c762d-aef7-4ced-8300-fd420996606b tempest-TestServerVolumeAttachScenarioOldVersion-1477057444 None] Flow 'volume_create_manager' (e325c510-aa71-4c75-9171-7834e511748a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:57:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-600c762d-aef7-4ced-8300-fd420996606b tempest-TestServerVolumeAttachScenarioOldVersion-1477057444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6274edf-237e-470f-be50-36f374894eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:57:30 devstack sudo[100549]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-61b30c2a-a58a-4c36-ba05-56d4c245fd6e tempest-VolumesTransfersV357Test-1892506575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6e8771f1-6406-4137-94d1-c879927aebe9" returned: 0 in 0.487s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-61b30c2a-a58a-4c36-ba05-56d4c245fd6e tempest-VolumesTransfersV357Test-1892506575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6e8771f1-6406-4137-94d1-c879927aebe9 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-600c762d-aef7-4ced-8300-fd420996606b tempest-TestServerVolumeAttachScenarioOldVersion-1477057444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6274edf-237e-470f-be50-36f374894eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:57:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-114796357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33fdfde8-1690-4d55-ba64-c6bfb59e7a54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94d5b72d7559491da06bd0443859f5bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:57:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:57:30Z,use_quota=True,user_id='e60d07b5f80843baaacf5aac9d9dbfee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:57:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-600c762d-aef7-4ced-8300-fd420996606b tempest-TestServerVolumeAttachScenarioOldVersion-1477057444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00104c8e-6c07-4245-9270-555ee2510251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:57:30 devstack sudo[100554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6e8771f1-6406-4137-94d1-c879927aebe9 Nov 06 17:57:30 devstack sudo[100554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-600c762d-aef7-4ced-8300-fd420996606b tempest-TestServerVolumeAttachScenarioOldVersion-1477057444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00104c8e-6c07-4245-9270-555ee2510251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:57:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-600c762d-aef7-4ced-8300-fd420996606b tempest-TestServerVolumeAttachScenarioOldVersion-1477057444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (595a84e3-378c-4587-8faf-b753d1e65171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:57:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-600c762d-aef7-4ced-8300-fd420996606b tempest-TestServerVolumeAttachScenarioOldVersion-1477057444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (595a84e3-378c-4587-8faf-b753d1e65171) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33fdfde8-1690-4d55-ba64-c6bfb59e7a54', 'volume_name': 'volume-33fdfde8-1690-4d55-ba64-c6bfb59e7a54', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:57:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-600c762d-aef7-4ced-8300-fd420996606b tempest-TestServerVolumeAttachScenarioOldVersion-1477057444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7af730c-e81d-4870-a17f-56889a71ed08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:57:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-600c762d-aef7-4ced-8300-fd420996606b tempest-TestServerVolumeAttachScenarioOldVersion-1477057444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7af730c-e81d-4870-a17f-56889a71ed08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:57:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-600c762d-aef7-4ced-8300-fd420996606b tempest-TestServerVolumeAttachScenarioOldVersion-1477057444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4c1d243-a1a5-4d14-abf4-f545c837babb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:57:30 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-600c762d-aef7-4ced-8300-fd420996606b tempest-TestServerVolumeAttachScenarioOldVersion-1477057444 None] Volume 33fdfde8-1690-4d55-ba64-c6bfb59e7a54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33fdfde8-1690-4d55-ba64-c6bfb59e7a54', 'volume_size': 1} Nov 06 17:57:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-600c762d-aef7-4ced-8300-fd420996606b tempest-TestServerVolumeAttachScenarioOldVersion-1477057444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:57:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-600c762d-aef7-4ced-8300-fd420996606b tempest-TestServerVolumeAttachScenarioOldVersion-1477057444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:57:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-600c762d-aef7-4ced-8300-fd420996606b tempest-TestServerVolumeAttachScenarioOldVersion-1477057444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:57:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-114796357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33fdfde8-1690-4d55-ba64-c6bfb59e7a54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94d5b72d7559491da06bd0443859f5bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:57:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:57:30Z,use_quota=True,user_id='e60d07b5f80843baaacf5aac9d9dbfee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:57:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-600c762d-aef7-4ced-8300-fd420996606b tempest-TestServerVolumeAttachScenarioOldVersion-1477057444 None] Creating volume 33fdfde8-1690-4d55-ba64-c6bfb59e7a54 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:57:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-600c762d-aef7-4ced-8300-fd420996606b tempest-TestServerVolumeAttachScenarioOldVersion-1477057444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:57:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-600c762d-aef7-4ced-8300-fd420996606b tempest-TestServerVolumeAttachScenarioOldVersion-1477057444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:57:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-600c762d-aef7-4ced-8300-fd420996606b tempest-TestServerVolumeAttachScenarioOldVersion-1477057444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:57:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-600c762d-aef7-4ced-8300-fd420996606b tempest-TestServerVolumeAttachScenarioOldVersion-1477057444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:57:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-600c762d-aef7-4ced-8300-fd420996606b tempest-TestServerVolumeAttachScenarioOldVersion-1477057444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:57:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-600c762d-aef7-4ced-8300-fd420996606b tempest-TestServerVolumeAttachScenarioOldVersion-1477057444 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:57:30 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-600c762d-aef7-4ced-8300-fd420996606b tempest-TestServerVolumeAttachScenarioOldVersion-1477057444 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:57:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-600c762d-aef7-4ced-8300-fd420996606b tempest-TestServerVolumeAttachScenarioOldVersion-1477057444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-33fdfde8-1690-4d55-ba64-c6bfb59e7a54 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:30 devstack sudo[100556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-33fdfde8-1690-4d55-ba64-c6bfb59e7a54 1073741824 Nov 06 17:57:30 devstack sudo[100556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:30 devstack sudo[100554]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-61b30c2a-a58a-4c36-ba05-56d4c245fd6e tempest-VolumesTransfersV357Test-1892506575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6e8771f1-6406-4137-94d1-c879927aebe9" returned: 0 in 0.281s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:30 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-61b30c2a-a58a-4c36-ba05-56d4c245fd6e tempest-VolumesTransfersV357Test-1892506575 None] Lock "cinder-quobyte-6e8771f1-6406-4137-94d1-c879927aebe9" released by "delete_volume" :: held 0.837s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:57:30 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-61b30c2a-a58a-4c36-ba05-56d4c245fd6e tempest-VolumesTransfersV357Test-1892506575 None] Created reservations ['375199e8-990c-444b-8844-b34f15472a93', '8d3c4309-1261-44f3-9dd1-93da96b7a379', '0afb32ef-858a-42b5-8026-2d6de436b760', '66ff04dd-d51f-4531-9a02-59e0e2f9bd65'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:57:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-61b30c2a-a58a-4c36-ba05-56d4c245fd6e tempest-VolumesTransfersV357Test-1892506575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:57:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-61b30c2a-a58a-4c36-ba05-56d4c245fd6e tempest-VolumesTransfersV357Test-1892506575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:57:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-61b30c2a-a58a-4c36-ba05-56d4c245fd6e tempest-VolumesTransfersV357Test-1892506575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:57:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-61b30c2a-a58a-4c36-ba05-56d4c245fd6e tempest-VolumesTransfersV357Test-1892506575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:57:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-61b30c2a-a58a-4c36-ba05-56d4c245fd6e tempest-VolumesTransfersV357Test-1892506575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:57:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-61b30c2a-a58a-4c36-ba05-56d4c245fd6e tempest-VolumesTransfersV357Test-1892506575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:30 devstack sudo[100563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:57:30 devstack sudo[100563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:30 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-fe09f421-dbf7-4ba3-a254-98979fb2845f tempest-VolumesSnapshotListTestJSON-1611781330 None] Acquiring lock "cinder-ba366892-53a3-4216-b695-181af7be7b5b-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:57:31 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-fe09f421-dbf7-4ba3-a254-98979fb2845f tempest-VolumesSnapshotListTestJSON-1611781330 None] Lock "cinder-ba366892-53a3-4216-b695-181af7be7b5b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:57:31 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-fe09f421-dbf7-4ba3-a254-98979fb2845f tempest-VolumesSnapshotListTestJSON-1611781330 None] Acquiring lock "cinder-quobyte-4fac1ef4-9838-4a2c-a743-0a7b28ba7874" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:57:31 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-fe09f421-dbf7-4ba3-a254-98979fb2845f tempest-VolumesSnapshotListTestJSON-1611781330 None] Lock "cinder-quobyte-4fac1ef4-9838-4a2c-a743-0a7b28ba7874" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:57:31 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-fe09f421-dbf7-4ba3-a254-98979fb2845f tempest-VolumesSnapshotListTestJSON-1611781330 None] Acquiring lock "cinder-quobyte-ba366892-53a3-4216-b695-181af7be7b5b" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:57:31 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-fe09f421-dbf7-4ba3-a254-98979fb2845f tempest-VolumesSnapshotListTestJSON-1611781330 None] Lock "cinder-quobyte-ba366892-53a3-4216-b695-181af7be7b5b" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:57:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-fe09f421-dbf7-4ba3-a254-98979fb2845f tempest-VolumesSnapshotListTestJSON-1611781330 None] Deleting offline snapshot ba366892-53a3-4216-b695-181af7be7b5b of volume 4fac1ef4-9838-4a2c-a743-0a7b28ba7874 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 17:57:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-fe09f421-dbf7-4ba3-a254-98979fb2845f tempest-VolumesSnapshotListTestJSON-1611781330 None] snapshot_file for this snap is: volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.ba366892-53a3-4216-b695-181af7be7b5b {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 17:57:31 devstack sudo[100556]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:31 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f28bb6-e1de-4170-8251-bc608848375c]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:57:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fe09f421-dbf7-4ba3-a254-98979fb2845f tempest-VolumesSnapshotListTestJSON-1611781330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.ba366892-53a3-4216-b695-181af7be7b5b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-600c762d-aef7-4ced-8300-fd420996606b tempest-TestServerVolumeAttachScenarioOldVersion-1477057444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-33fdfde8-1690-4d55-ba64-c6bfb59e7a54 1073741824" returned: 0 in 0.691s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-600c762d-aef7-4ced-8300-fd420996606b tempest-TestServerVolumeAttachScenarioOldVersion-1477057444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-33fdfde8-1690-4d55-ba64-c6bfb59e7a54 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:31 devstack sudo[100567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-33fdfde8-1690-4d55-ba64-c6bfb59e7a54 Nov 06 17:57:31 devstack sudo[100567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:31 devstack sudo[100563]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-61b30c2a-a58a-4c36-ba05-56d4c245fd6e tempest-VolumesTransfersV357Test-1892506575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.454s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:31 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-61b30c2a-a58a-4c36-ba05-56d4c245fd6e tempest-VolumesTransfersV357Test-1892506575 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:57:31 devstack sudo[100565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.ba366892-53a3-4216-b695-181af7be7b5b Nov 06 17:57:31 devstack sudo[100565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:31 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-61b30c2a-a58a-4c36-ba05-56d4c245fd6e tempest-VolumesTransfersV357Test-1892506575 None] Deleted volume successfully. Nov 06 17:57:31 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-61b30c2a-a58a-4c36-ba05-56d4c245fd6e tempest-VolumesTransfersV357Test-1892506575 None] Lock "cinder-6e8771f1-6406-4137-94d1-c879927aebe9-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:57:31 devstack sudo[100567]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-600c762d-aef7-4ced-8300-fd420996606b tempest-TestServerVolumeAttachScenarioOldVersion-1477057444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-33fdfde8-1690-4d55-ba64-c6bfb59e7a54" returned: 0 in 0.393s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-600c762d-aef7-4ced-8300-fd420996606b tempest-TestServerVolumeAttachScenarioOldVersion-1477057444 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:57:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-600c762d-aef7-4ced-8300-fd420996606b tempest-TestServerVolumeAttachScenarioOldVersion-1477057444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:57:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-600c762d-aef7-4ced-8300-fd420996606b tempest-TestServerVolumeAttachScenarioOldVersion-1477057444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4c1d243-a1a5-4d14-abf4-f545c837babb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33fdfde8-1690-4d55-ba64-c6bfb59e7a54', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:57:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-600c762d-aef7-4ced-8300-fd420996606b tempest-TestServerVolumeAttachScenarioOldVersion-1477057444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2bd3faf-e173-402a-86de-e7ea0f52ab4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:57:31 devstack sudo[100565]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fe09f421-dbf7-4ba3-a254-98979fb2845f tempest-VolumesSnapshotListTestJSON-1611781330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.ba366892-53a3-4216-b695-181af7be7b5b" returned: 0 in 0.534s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-fe09f421-dbf7-4ba3-a254-98979fb2845f tempest-VolumesSnapshotListTestJSON-1611781330 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 17:57:31 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-600c762d-aef7-4ced-8300-fd420996606b tempest-TestServerVolumeAttachScenarioOldVersion-1477057444 None] Volume volume-33fdfde8-1690-4d55-ba64-c6bfb59e7a54 (33fdfde8-1690-4d55-ba64-c6bfb59e7a54): created successfully Nov 06 17:57:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-600c762d-aef7-4ced-8300-fd420996606b tempest-TestServerVolumeAttachScenarioOldVersion-1477057444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2bd3faf-e173-402a-86de-e7ea0f52ab4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:57:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-600c762d-aef7-4ced-8300-fd420996606b tempest-TestServerVolumeAttachScenarioOldVersion-1477057444 None] Flow 'volume_create_manager' (e325c510-aa71-4c75-9171-7834e511748a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:57:31 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[045cdb43-31ae-4e0f-bd82-7471f9464b7e]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:57:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fe09f421-dbf7-4ba3-a254-98979fb2845f tempest-VolumesSnapshotListTestJSON-1611781330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.a38d6e41-30df-419a-aa01-a087d24e3b72 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:31 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-600c762d-aef7-4ced-8300-fd420996606b tempest-TestServerVolumeAttachScenarioOldVersion-1477057444 None] Created volume successfully. Nov 06 17:57:31 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1341b3e-f4f6-499f-9f53-a4af325e9ef8 tempest-VolumesTransfersV357Test-1040090716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:57:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c1341b3e-f4f6-499f-9f53-a4af325e9ef8 tempest-VolumesTransfersV357Test-1040090716 None] Flow 'volume_create_manager' (5eaa6301-9709-4d93-9aa7-1dc40229def1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:57:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c1341b3e-f4f6-499f-9f53-a4af325e9ef8 tempest-VolumesTransfersV357Test-1040090716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed682756-deb6-4183-801d-4156cd8c98b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:57:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c1341b3e-f4f6-499f-9f53-a4af325e9ef8 tempest-VolumesTransfersV357Test-1040090716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed682756-deb6-4183-801d-4156cd8c98b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-160375796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7f1db68-ffe4-40cd-b1e8-36e724c23284,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b9c448552f1478ba9a3ae491ce445c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:57:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:57:32Z,use_quota=True,user_id='e59c9139e8e44f46b427d885c5e5d7c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:57:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c1341b3e-f4f6-499f-9f53-a4af325e9ef8 tempest-VolumesTransfersV357Test-1040090716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f285273-72ca-4260-a0ec-4393e4d08c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:57:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c1341b3e-f4f6-499f-9f53-a4af325e9ef8 tempest-VolumesTransfersV357Test-1040090716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f285273-72ca-4260-a0ec-4393e4d08c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:57:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c1341b3e-f4f6-499f-9f53-a4af325e9ef8 tempest-VolumesTransfersV357Test-1040090716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bb6b6d0-6ac2-4fe4-95dc-083588492484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:57:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c1341b3e-f4f6-499f-9f53-a4af325e9ef8 tempest-VolumesTransfersV357Test-1040090716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bb6b6d0-6ac2-4fe4-95dc-083588492484) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7f1db68-ffe4-40cd-b1e8-36e724c23284', 'volume_name': 'volume-e7f1db68-ffe4-40cd-b1e8-36e724c23284', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:57:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c1341b3e-f4f6-499f-9f53-a4af325e9ef8 tempest-VolumesTransfersV357Test-1040090716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f12327bf-4ad3-416f-9990-8e8f5394dc1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:57:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c1341b3e-f4f6-499f-9f53-a4af325e9ef8 tempest-VolumesTransfersV357Test-1040090716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f12327bf-4ad3-416f-9990-8e8f5394dc1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:57:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c1341b3e-f4f6-499f-9f53-a4af325e9ef8 tempest-VolumesTransfersV357Test-1040090716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3ac94db-560f-4181-8a13-3406bf75da4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:57:31 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-c1341b3e-f4f6-499f-9f53-a4af325e9ef8 tempest-VolumesTransfersV357Test-1040090716 None] Volume e7f1db68-ffe4-40cd-b1e8-36e724c23284: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7f1db68-ffe4-40cd-b1e8-36e724c23284', 'volume_size': 1} Nov 06 17:57:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c1341b3e-f4f6-499f-9f53-a4af325e9ef8 tempest-VolumesTransfersV357Test-1040090716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:57:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c1341b3e-f4f6-499f-9f53-a4af325e9ef8 tempest-VolumesTransfersV357Test-1040090716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:57:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c1341b3e-f4f6-499f-9f53-a4af325e9ef8 tempest-VolumesTransfersV357Test-1040090716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-160375796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7f1db68-ffe4-40cd-b1e8-36e724c23284,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b9c448552f1478ba9a3ae491ce445c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:57:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:57:32Z,use_quota=True,user_id='e59c9139e8e44f46b427d885c5e5d7c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:57:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-c1341b3e-f4f6-499f-9f53-a4af325e9ef8 tempest-VolumesTransfersV357Test-1040090716 None] Creating volume e7f1db68-ffe4-40cd-b1e8-36e724c23284 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:57:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c1341b3e-f4f6-499f-9f53-a4af325e9ef8 tempest-VolumesTransfersV357Test-1040090716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:57:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c1341b3e-f4f6-499f-9f53-a4af325e9ef8 tempest-VolumesTransfersV357Test-1040090716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:57:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c1341b3e-f4f6-499f-9f53-a4af325e9ef8 tempest-VolumesTransfersV357Test-1040090716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:57:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c1341b3e-f4f6-499f-9f53-a4af325e9ef8 tempest-VolumesTransfersV357Test-1040090716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:57:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c1341b3e-f4f6-499f-9f53-a4af325e9ef8 tempest-VolumesTransfersV357Test-1040090716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:57:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c1341b3e-f4f6-499f-9f53-a4af325e9ef8 tempest-VolumesTransfersV357Test-1040090716 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:57:31 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-c1341b3e-f4f6-499f-9f53-a4af325e9ef8 tempest-VolumesTransfersV357Test-1040090716 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:57:31 devstack sudo[100574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.a38d6e41-30df-419a-aa01-a087d24e3b72 Nov 06 17:57:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c1341b3e-f4f6-499f-9f53-a4af325e9ef8 tempest-VolumesTransfersV357Test-1040090716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e7f1db68-ffe4-40cd-b1e8-36e724c23284 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:31 devstack sudo[100574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:31 devstack sudo[100576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e7f1db68-ffe4-40cd-b1e8-36e724c23284 1073741824 Nov 06 17:57:31 devstack sudo[100576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:32 devstack sudo[100574]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fe09f421-dbf7-4ba3-a254-98979fb2845f tempest-VolumesSnapshotListTestJSON-1611781330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.a38d6e41-30df-419a-aa01-a087d24e3b72" returned: 0 in 0.480s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-fe09f421-dbf7-4ba3-a254-98979fb2845f tempest-VolumesSnapshotListTestJSON-1611781330 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 17:57:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fe09f421-dbf7-4ba3-a254-98979fb2845f tempest-VolumesSnapshotListTestJSON-1611781330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.ba366892-53a3-4216-b695-181af7be7b5b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:32 devstack sudo[100584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.ba366892-53a3-4216-b695-181af7be7b5b Nov 06 17:57:32 devstack sudo[100584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:32 devstack sudo[100576]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c1341b3e-f4f6-499f-9f53-a4af325e9ef8 tempest-VolumesTransfersV357Test-1040090716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e7f1db68-ffe4-40cd-b1e8-36e724c23284 1073741824" returned: 0 in 0.632s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c1341b3e-f4f6-499f-9f53-a4af325e9ef8 tempest-VolumesTransfersV357Test-1040090716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e7f1db68-ffe4-40cd-b1e8-36e724c23284 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:32 devstack sudo[100593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e7f1db68-ffe4-40cd-b1e8-36e724c23284 Nov 06 17:57:32 devstack sudo[100593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:32 devstack sudo[100584]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fe09f421-dbf7-4ba3-a254-98979fb2845f tempest-VolumesSnapshotListTestJSON-1611781330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.ba366892-53a3-4216-b695-181af7be7b5b" returned: 0 in 0.608s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fe09f421-dbf7-4ba3-a254-98979fb2845f tempest-VolumesSnapshotListTestJSON-1611781330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.ba366892-53a3-4216-b695-181af7be7b5b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:32 devstack sudo[100595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.ba366892-53a3-4216-b695-181af7be7b5b Nov 06 17:57:32 devstack sudo[100595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:32 devstack sudo[100593]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c1341b3e-f4f6-499f-9f53-a4af325e9ef8 tempest-VolumesTransfersV357Test-1040090716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e7f1db68-ffe4-40cd-b1e8-36e724c23284" returned: 0 in 0.387s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c1341b3e-f4f6-499f-9f53-a4af325e9ef8 tempest-VolumesTransfersV357Test-1040090716 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:57:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c1341b3e-f4f6-499f-9f53-a4af325e9ef8 tempest-VolumesTransfersV357Test-1040090716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:57:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c1341b3e-f4f6-499f-9f53-a4af325e9ef8 tempest-VolumesTransfersV357Test-1040090716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3ac94db-560f-4181-8a13-3406bf75da4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7f1db68-ffe4-40cd-b1e8-36e724c23284', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:57:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c1341b3e-f4f6-499f-9f53-a4af325e9ef8 tempest-VolumesTransfersV357Test-1040090716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c65a19c1-96ef-44f0-a09c-49df3f94ef5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:57:32 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-c1341b3e-f4f6-499f-9f53-a4af325e9ef8 tempest-VolumesTransfersV357Test-1040090716 None] Volume volume-e7f1db68-ffe4-40cd-b1e8-36e724c23284 (e7f1db68-ffe4-40cd-b1e8-36e724c23284): created successfully Nov 06 17:57:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c1341b3e-f4f6-499f-9f53-a4af325e9ef8 tempest-VolumesTransfersV357Test-1040090716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c65a19c1-96ef-44f0-a09c-49df3f94ef5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:57:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c1341b3e-f4f6-499f-9f53-a4af325e9ef8 tempest-VolumesTransfersV357Test-1040090716 None] Flow 'volume_create_manager' (5eaa6301-9709-4d93-9aa7-1dc40229def1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:57:33 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-c1341b3e-f4f6-499f-9f53-a4af325e9ef8 tempest-VolumesTransfersV357Test-1040090716 None] Created volume successfully. Nov 06 17:57:33 devstack sudo[100595]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fe09f421-dbf7-4ba3-a254-98979fb2845f tempest-VolumesSnapshotListTestJSON-1611781330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.ba366892-53a3-4216-b695-181af7be7b5b" returned: 0 in 0.371s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:33 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-fe09f421-dbf7-4ba3-a254-98979fb2845f tempest-VolumesSnapshotListTestJSON-1611781330 None] Lock "cinder-quobyte-ba366892-53a3-4216-b695-181af7be7b5b" released by "_delete_snapshot" :: held 2.157s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:57:33 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-fe09f421-dbf7-4ba3-a254-98979fb2845f tempest-VolumesSnapshotListTestJSON-1611781330 None] Lock "cinder-quobyte-4fac1ef4-9838-4a2c-a743-0a7b28ba7874" released by "delete_snapshot" :: held 2.190s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:57:33 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-fe09f421-dbf7-4ba3-a254-98979fb2845f tempest-VolumesSnapshotListTestJSON-1611781330 None] Created reservations ['0bdf2161-db74-49a9-9a24-63df9bd78842', '73ee45dc-71df-4638-b5bc-717a787ae466', '40872bdc-9ffc-400e-8eb3-613b2a15d7be', '7fd54b93-8f94-4ce4-8b75-198ec6827764'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:57:33 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-fe09f421-dbf7-4ba3-a254-98979fb2845f tempest-VolumesSnapshotListTestJSON-1611781330 None] Delete snapshot completed successfully. Nov 06 17:57:33 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-fe09f421-dbf7-4ba3-a254-98979fb2845f tempest-VolumesSnapshotListTestJSON-1611781330 None] Lock "cinder-ba366892-53a3-4216-b695-181af7be7b5b-delete_snapshot" released by "delete_snapshot" :: held 2.383s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:57:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-3c561891-7206-43ff-84d7-b77279e737c3 req-302ac7b6-cac0-4868-a767-d1291ae08e81 tempest-TestServerVolumeAttachScenarioOldVersion-1477057444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:57:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-3c561891-7206-43ff-84d7-b77279e737c3 req-302ac7b6-cac0-4868-a767-d1291ae08e81 tempest-TestServerVolumeAttachScenarioOldVersion-1477057444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:57:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-3c561891-7206-43ff-84d7-b77279e737c3 req-302ac7b6-cac0-4868-a767-d1291ae08e81 tempest-TestServerVolumeAttachScenarioOldVersion-1477057444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:57:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-3c561891-7206-43ff-84d7-b77279e737c3 req-302ac7b6-cac0-4868-a767-d1291ae08e81 tempest-TestServerVolumeAttachScenarioOldVersion-1477057444 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072', 'name': 'volume-33fdfde8-1690-4d55-ba64-c6bfb59e7a54', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e07d2e55-c42e-4766-bbac-eb3d29094010', 'enforce_multipath': True} {{(pid=87068) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 17:57:33 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-3c561891-7206-43ff-84d7-b77279e737c3 req-302ac7b6-cac0-4868-a767-d1291ae08e81 tempest-TestServerVolumeAttachScenarioOldVersion-1477057444 None] attachment_update completed successfully. Nov 06 17:57:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c98eda0f-6fe6-420d-917f-62dc12cdb009 tempest-VolumesSnapshotListTestJSON-1611781330 None] Acquiring lock "cinder-a38d6e41-30df-419a-aa01-a087d24e3b72-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:57:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c98eda0f-6fe6-420d-917f-62dc12cdb009 tempest-VolumesSnapshotListTestJSON-1611781330 None] Lock "cinder-a38d6e41-30df-419a-aa01-a087d24e3b72-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:57:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c98eda0f-6fe6-420d-917f-62dc12cdb009 tempest-VolumesSnapshotListTestJSON-1611781330 None] Acquiring lock "cinder-quobyte-4fac1ef4-9838-4a2c-a743-0a7b28ba7874" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:57:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c98eda0f-6fe6-420d-917f-62dc12cdb009 tempest-VolumesSnapshotListTestJSON-1611781330 None] Lock "cinder-quobyte-4fac1ef4-9838-4a2c-a743-0a7b28ba7874" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:57:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c98eda0f-6fe6-420d-917f-62dc12cdb009 tempest-VolumesSnapshotListTestJSON-1611781330 None] Acquiring lock "cinder-quobyte-a38d6e41-30df-419a-aa01-a087d24e3b72" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:57:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6ad5f199-9404-4aa1-b20d-90b730d42812 tempest-VolumesTransfersV357Test-1892506575 None] Acquiring lock "cinder-e7f1db68-ffe4-40cd-b1e8-36e724c23284-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:57:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c98eda0f-6fe6-420d-917f-62dc12cdb009 tempest-VolumesSnapshotListTestJSON-1611781330 None] Lock "cinder-quobyte-a38d6e41-30df-419a-aa01-a087d24e3b72" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:57:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-c98eda0f-6fe6-420d-917f-62dc12cdb009 tempest-VolumesSnapshotListTestJSON-1611781330 None] Deleting offline snapshot a38d6e41-30df-419a-aa01-a087d24e3b72 of volume 4fac1ef4-9838-4a2c-a743-0a7b28ba7874 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 17:57:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-c98eda0f-6fe6-420d-917f-62dc12cdb009 tempest-VolumesSnapshotListTestJSON-1611781330 None] snapshot_file for this snap is: volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.a38d6e41-30df-419a-aa01-a087d24e3b72 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 17:57:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6ad5f199-9404-4aa1-b20d-90b730d42812 tempest-VolumesTransfersV357Test-1892506575 None] Lock "cinder-e7f1db68-ffe4-40cd-b1e8-36e724c23284-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:57:34 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e683823-6170-4199-97fd-8006bf29af2c]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:57:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c98eda0f-6fe6-420d-917f-62dc12cdb009 tempest-VolumesSnapshotListTestJSON-1611781330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.a38d6e41-30df-419a-aa01-a087d24e3b72 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6ad5f199-9404-4aa1-b20d-90b730d42812 tempest-VolumesTransfersV357Test-1892506575 None] Acquiring lock "cinder-quobyte-e7f1db68-ffe4-40cd-b1e8-36e724c23284" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:57:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6ad5f199-9404-4aa1-b20d-90b730d42812 tempest-VolumesTransfersV357Test-1892506575 None] Lock "cinder-quobyte-e7f1db68-ffe4-40cd-b1e8-36e724c23284" acquired by "delete_volume" :: waited 0.023s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:57:34 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72931b8-a039-4605-b3ba-777a2978d00e]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:57:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6ad5f199-9404-4aa1-b20d-90b730d42812 tempest-VolumesTransfersV357Test-1892506575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e7f1db68-ffe4-40cd-b1e8-36e724c23284 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:34 devstack sudo[101023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.a38d6e41-30df-419a-aa01-a087d24e3b72 Nov 06 17:57:34 devstack sudo[101023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:34 devstack sudo[101024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e7f1db68-ffe4-40cd-b1e8-36e724c23284 Nov 06 17:57:34 devstack sudo[101024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:34 devstack sudo[101023]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c98eda0f-6fe6-420d-917f-62dc12cdb009 tempest-VolumesSnapshotListTestJSON-1611781330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.a38d6e41-30df-419a-aa01-a087d24e3b72" returned: 0 in 0.463s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-c98eda0f-6fe6-420d-917f-62dc12cdb009 tempest-VolumesSnapshotListTestJSON-1611781330 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 17:57:35 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1717e6d1-1714-4f1a-ab66-9aab887766d0]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:57:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c98eda0f-6fe6-420d-917f-62dc12cdb009 tempest-VolumesSnapshotListTestJSON-1611781330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:35 devstack sudo[101024]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6ad5f199-9404-4aa1-b20d-90b730d42812 tempest-VolumesTransfersV357Test-1892506575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e7f1db68-ffe4-40cd-b1e8-36e724c23284" returned: 0 in 0.481s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6ad5f199-9404-4aa1-b20d-90b730d42812 tempest-VolumesTransfersV357Test-1892506575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e7f1db68-ffe4-40cd-b1e8-36e724c23284 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:35 devstack sudo[101034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e7f1db68-ffe4-40cd-b1e8-36e724c23284 Nov 06 17:57:35 devstack sudo[101034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:35 devstack sudo[101032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874 Nov 06 17:57:35 devstack sudo[101032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:35 devstack sudo[101034]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6ad5f199-9404-4aa1-b20d-90b730d42812 tempest-VolumesTransfersV357Test-1892506575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e7f1db68-ffe4-40cd-b1e8-36e724c23284" returned: 0 in 0.298s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6ad5f199-9404-4aa1-b20d-90b730d42812 tempest-VolumesTransfersV357Test-1892506575 None] Lock "cinder-quobyte-e7f1db68-ffe4-40cd-b1e8-36e724c23284" released by "delete_volume" :: held 0.857s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:57:35 devstack sudo[101032]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c98eda0f-6fe6-420d-917f-62dc12cdb009 tempest-VolumesSnapshotListTestJSON-1611781330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874" returned: 0 in 0.477s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c98eda0f-6fe6-420d-917f-62dc12cdb009 tempest-VolumesSnapshotListTestJSON-1611781330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.a38d6e41-30df-419a-aa01-a087d24e3b72 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:35 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-6ad5f199-9404-4aa1-b20d-90b730d42812 tempest-VolumesTransfersV357Test-1892506575 None] Created reservations ['ee374eb1-03fb-4427-a2cf-b8340abf8d37', 'a6869a48-f26f-4508-88d9-d85a8610b1cb', '892c26f9-3b68-4942-b5d4-86fd68194980', '94c8a704-b057-4575-81b9-ec117f8ccaab'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:57:35 devstack sudo[101041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.a38d6e41-30df-419a-aa01-a087d24e3b72 Nov 06 17:57:35 devstack sudo[101041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6ad5f199-9404-4aa1-b20d-90b730d42812 tempest-VolumesTransfersV357Test-1892506575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:57:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6ad5f199-9404-4aa1-b20d-90b730d42812 tempest-VolumesTransfersV357Test-1892506575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:57:35 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-6ad5f199-9404-4aa1-b20d-90b730d42812 tempest-VolumesTransfersV357Test-1892506575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:57:35 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-6ad5f199-9404-4aa1-b20d-90b730d42812 tempest-VolumesTransfersV357Test-1892506575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:57:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6ad5f199-9404-4aa1-b20d-90b730d42812 tempest-VolumesTransfersV357Test-1892506575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:57:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6ad5f199-9404-4aa1-b20d-90b730d42812 tempest-VolumesTransfersV357Test-1892506575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:35 devstack sudo[101043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:57:35 devstack sudo[101043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:35 devstack sudo[101043]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6ad5f199-9404-4aa1-b20d-90b730d42812 tempest-VolumesTransfersV357Test-1892506575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.309s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:35 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-6ad5f199-9404-4aa1-b20d-90b730d42812 tempest-VolumesTransfersV357Test-1892506575 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:57:35 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-6ad5f199-9404-4aa1-b20d-90b730d42812 tempest-VolumesTransfersV357Test-1892506575 None] Deleted volume successfully. Nov 06 17:57:36 devstack sudo[101041]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c98eda0f-6fe6-420d-917f-62dc12cdb009 tempest-VolumesSnapshotListTestJSON-1611781330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.a38d6e41-30df-419a-aa01-a087d24e3b72" returned: 0 in 0.501s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c98eda0f-6fe6-420d-917f-62dc12cdb009 tempest-VolumesSnapshotListTestJSON-1611781330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.a38d6e41-30df-419a-aa01-a087d24e3b72 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6ad5f199-9404-4aa1-b20d-90b730d42812 tempest-VolumesTransfersV357Test-1892506575 None] Lock "cinder-e7f1db68-ffe4-40cd-b1e8-36e724c23284-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:57:36 devstack sudo[101049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.a38d6e41-30df-419a-aa01-a087d24e3b72 Nov 06 17:57:36 devstack sudo[101049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:36 devstack sudo[101049]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c98eda0f-6fe6-420d-917f-62dc12cdb009 tempest-VolumesSnapshotListTestJSON-1611781330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874.a38d6e41-30df-419a-aa01-a087d24e3b72" returned: 0 in 0.279s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c98eda0f-6fe6-420d-917f-62dc12cdb009 tempest-VolumesSnapshotListTestJSON-1611781330 None] Lock "cinder-quobyte-a38d6e41-30df-419a-aa01-a087d24e3b72" released by "_delete_snapshot" :: held 1.926s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:57:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c98eda0f-6fe6-420d-917f-62dc12cdb009 tempest-VolumesSnapshotListTestJSON-1611781330 None] Lock "cinder-quobyte-4fac1ef4-9838-4a2c-a743-0a7b28ba7874" released by "delete_snapshot" :: held 1.959s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:57:36 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-c98eda0f-6fe6-420d-917f-62dc12cdb009 tempest-VolumesSnapshotListTestJSON-1611781330 None] Created reservations ['e949ccd9-66f1-496c-bfd4-52e101531638', '4169b71a-4069-433d-9cb5-99b8089f9869', '3ba9fee7-0c97-45e2-b584-3ecfedc7b024', 'c1b7e94e-38eb-4398-9cb3-cd0ec4f91e57'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:57:36 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-c98eda0f-6fe6-420d-917f-62dc12cdb009 tempest-VolumesSnapshotListTestJSON-1611781330 None] Delete snapshot completed successfully. Nov 06 17:57:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c98eda0f-6fe6-420d-917f-62dc12cdb009 tempest-VolumesSnapshotListTestJSON-1611781330 None] Lock "cinder-a38d6e41-30df-419a-aa01-a087d24e3b72-delete_snapshot" released by "delete_snapshot" :: held 2.137s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:57:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-707d5f6e-2c47-4b87-a66d-ab8be41336cb tempest-VolumesSnapshotListTestJSON-1611781330 None] Acquiring lock "cinder-4fac1ef4-9838-4a2c-a743-0a7b28ba7874-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:57:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-707d5f6e-2c47-4b87-a66d-ab8be41336cb tempest-VolumesSnapshotListTestJSON-1611781330 None] Lock "cinder-4fac1ef4-9838-4a2c-a743-0a7b28ba7874-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:57:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-707d5f6e-2c47-4b87-a66d-ab8be41336cb tempest-VolumesSnapshotListTestJSON-1611781330 None] Acquiring lock "cinder-quobyte-4fac1ef4-9838-4a2c-a743-0a7b28ba7874" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:57:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-707d5f6e-2c47-4b87-a66d-ab8be41336cb tempest-VolumesSnapshotListTestJSON-1611781330 None] Lock "cinder-quobyte-4fac1ef4-9838-4a2c-a743-0a7b28ba7874" acquired by "delete_volume" :: waited 0.017s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:57:36 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d1f055-aec3-45cf-b62d-434c0a18f80b]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:57:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-707d5f6e-2c47-4b87-a66d-ab8be41336cb tempest-VolumesSnapshotListTestJSON-1611781330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:36 devstack sudo[101052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874 Nov 06 17:57:36 devstack sudo[101052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:37 devstack sudo[101052]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-707d5f6e-2c47-4b87-a66d-ab8be41336cb tempest-VolumesSnapshotListTestJSON-1611781330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874" returned: 0 in 0.619s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-707d5f6e-2c47-4b87-a66d-ab8be41336cb tempest-VolumesSnapshotListTestJSON-1611781330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:37 devstack sudo[101058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874 Nov 06 17:57:37 devstack sudo[101058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:37 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-1c8dee88-f90b-4140-9eee-1a075c25341e req-d43c7a1c-f8fe-4baf-8953-8ede8d81063f tempest-TestServerVolumeAttachScenarioOldVersion-1477057444 None] Terminate volume connection completed successfully. Nov 06 17:57:37 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-1c8dee88-f90b-4140-9eee-1a075c25341e req-d43c7a1c-f8fe-4baf-8953-8ede8d81063f tempest-TestServerVolumeAttachScenarioOldVersion-1477057444 None] Deleting attachment e07d2e55-c42e-4766-bbac-eb3d29094010. {{(pid=87068) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 17:57:37 devstack sudo[101058]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-707d5f6e-2c47-4b87-a66d-ab8be41336cb tempest-VolumesSnapshotListTestJSON-1611781330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-4fac1ef4-9838-4a2c-a743-0a7b28ba7874" returned: 0 in 0.428s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-707d5f6e-2c47-4b87-a66d-ab8be41336cb tempest-VolumesSnapshotListTestJSON-1611781330 None] Lock "cinder-quobyte-4fac1ef4-9838-4a2c-a743-0a7b28ba7874" released by "delete_volume" :: held 1.148s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:57:37 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-707d5f6e-2c47-4b87-a66d-ab8be41336cb tempest-VolumesSnapshotListTestJSON-1611781330 None] Created reservations ['cd8336e9-fe22-439d-862e-9ac1ecdc2d3a', '92667729-3858-424f-b5a6-5a5d49c0b118', '524099ef-a64b-4a0e-8f57-3cacbd6fc305', 'af8a8b8a-42dc-41eb-8a35-4fc9a70efbb7'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:57:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-707d5f6e-2c47-4b87-a66d-ab8be41336cb tempest-VolumesSnapshotListTestJSON-1611781330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:57:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-707d5f6e-2c47-4b87-a66d-ab8be41336cb tempest-VolumesSnapshotListTestJSON-1611781330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:57:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-707d5f6e-2c47-4b87-a66d-ab8be41336cb tempest-VolumesSnapshotListTestJSON-1611781330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:57:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-707d5f6e-2c47-4b87-a66d-ab8be41336cb tempest-VolumesSnapshotListTestJSON-1611781330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:57:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-707d5f6e-2c47-4b87-a66d-ab8be41336cb tempest-VolumesSnapshotListTestJSON-1611781330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:57:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-707d5f6e-2c47-4b87-a66d-ab8be41336cb tempest-VolumesSnapshotListTestJSON-1611781330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:38 devstack sudo[101087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:57:38 devstack sudo[101087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:38 devstack sudo[101087]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-707d5f6e-2c47-4b87-a66d-ab8be41336cb tempest-VolumesSnapshotListTestJSON-1611781330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.280s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:38 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-707d5f6e-2c47-4b87-a66d-ab8be41336cb tempest-VolumesSnapshotListTestJSON-1611781330 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:57:38 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-707d5f6e-2c47-4b87-a66d-ab8be41336cb tempest-VolumesSnapshotListTestJSON-1611781330 None] Deleted volume successfully. Nov 06 17:57:38 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-707d5f6e-2c47-4b87-a66d-ab8be41336cb tempest-VolumesSnapshotListTestJSON-1611781330 None] Lock "cinder-4fac1ef4-9838-4a2c-a743-0a7b28ba7874-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:57:38 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f3acfd02-3d8c-41ae-b49c-e986bb077328 tempest-TestServerVolumeAttachScenarioOldVersion-1477057444 None] Acquiring lock "cinder-33fdfde8-1690-4d55-ba64-c6bfb59e7a54-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:57:38 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f3acfd02-3d8c-41ae-b49c-e986bb077328 tempest-TestServerVolumeAttachScenarioOldVersion-1477057444 None] Lock "cinder-33fdfde8-1690-4d55-ba64-c6bfb59e7a54-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:57:38 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f3acfd02-3d8c-41ae-b49c-e986bb077328 tempest-TestServerVolumeAttachScenarioOldVersion-1477057444 None] Acquiring lock "cinder-quobyte-33fdfde8-1690-4d55-ba64-c6bfb59e7a54" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:57:38 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f3acfd02-3d8c-41ae-b49c-e986bb077328 tempest-TestServerVolumeAttachScenarioOldVersion-1477057444 None] Lock "cinder-quobyte-33fdfde8-1690-4d55-ba64-c6bfb59e7a54" acquired by "delete_volume" :: waited 0.020s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:57:38 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e7b12e-08d0-4b4d-a528-6e8cb541012f]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:57:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f3acfd02-3d8c-41ae-b49c-e986bb077328 tempest-TestServerVolumeAttachScenarioOldVersion-1477057444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-33fdfde8-1690-4d55-ba64-c6bfb59e7a54 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:38 devstack sudo[101090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-33fdfde8-1690-4d55-ba64-c6bfb59e7a54 Nov 06 17:57:38 devstack sudo[101090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:39 devstack sudo[101090]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f3acfd02-3d8c-41ae-b49c-e986bb077328 tempest-TestServerVolumeAttachScenarioOldVersion-1477057444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-33fdfde8-1690-4d55-ba64-c6bfb59e7a54" returned: 0 in 0.573s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f3acfd02-3d8c-41ae-b49c-e986bb077328 tempest-TestServerVolumeAttachScenarioOldVersion-1477057444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-33fdfde8-1690-4d55-ba64-c6bfb59e7a54 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:39 devstack sudo[101095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-33fdfde8-1690-4d55-ba64-c6bfb59e7a54 Nov 06 17:57:39 devstack sudo[101095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:39 devstack sudo[101095]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f3acfd02-3d8c-41ae-b49c-e986bb077328 tempest-TestServerVolumeAttachScenarioOldVersion-1477057444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-33fdfde8-1690-4d55-ba64-c6bfb59e7a54" returned: 0 in 0.395s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:39 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f3acfd02-3d8c-41ae-b49c-e986bb077328 tempest-TestServerVolumeAttachScenarioOldVersion-1477057444 None] Lock "cinder-quobyte-33fdfde8-1690-4d55-ba64-c6bfb59e7a54" released by "delete_volume" :: held 1.035s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:57:39 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-f3acfd02-3d8c-41ae-b49c-e986bb077328 tempest-TestServerVolumeAttachScenarioOldVersion-1477057444 None] Created reservations ['4f8525e6-1b87-4b2f-a92c-c9d3c90a7b18', 'bcff2f71-613d-42d0-b89e-a1fb28be1d0d', 'fa5d213e-1a44-454d-939e-d42864aacc48', 'cbcb6f76-c165-4819-aea7-ddb264e73f8c'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:57:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f3acfd02-3d8c-41ae-b49c-e986bb077328 tempest-TestServerVolumeAttachScenarioOldVersion-1477057444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:57:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f3acfd02-3d8c-41ae-b49c-e986bb077328 tempest-TestServerVolumeAttachScenarioOldVersion-1477057444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:57:39 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f3acfd02-3d8c-41ae-b49c-e986bb077328 tempest-TestServerVolumeAttachScenarioOldVersion-1477057444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:57:39 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f3acfd02-3d8c-41ae-b49c-e986bb077328 tempest-TestServerVolumeAttachScenarioOldVersion-1477057444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:57:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f3acfd02-3d8c-41ae-b49c-e986bb077328 tempest-TestServerVolumeAttachScenarioOldVersion-1477057444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:57:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f3acfd02-3d8c-41ae-b49c-e986bb077328 tempest-TestServerVolumeAttachScenarioOldVersion-1477057444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:39 devstack sudo[101098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:57:39 devstack sudo[101098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:40 devstack sudo[101098]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f3acfd02-3d8c-41ae-b49c-e986bb077328 tempest-TestServerVolumeAttachScenarioOldVersion-1477057444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.336s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:40 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-f3acfd02-3d8c-41ae-b49c-e986bb077328 tempest-TestServerVolumeAttachScenarioOldVersion-1477057444 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:57:40 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-f3acfd02-3d8c-41ae-b49c-e986bb077328 tempest-TestServerVolumeAttachScenarioOldVersion-1477057444 None] Deleted volume successfully. Nov 06 17:57:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f3acfd02-3d8c-41ae-b49c-e986bb077328 tempest-TestServerVolumeAttachScenarioOldVersion-1477057444 None] Lock "cinder-33fdfde8-1690-4d55-ba64-c6bfb59e7a54-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:57:49 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f01824e-38b8-43c6-89a4-99ee1f4e471b tempest-VolumesCloneNegativeTest-1794031547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:57:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4f01824e-38b8-43c6-89a4-99ee1f4e471b tempest-VolumesCloneNegativeTest-1794031547 None] Flow 'volume_create_manager' (68a4e1be-41bd-4a26-be86-6647f1bc1844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:57:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4f01824e-38b8-43c6-89a4-99ee1f4e471b tempest-VolumesCloneNegativeTest-1794031547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a1fc5a0-f179-45bf-8cd5-35c6d6e29bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:57:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4f01824e-38b8-43c6-89a4-99ee1f4e471b tempest-VolumesCloneNegativeTest-1794031547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a1fc5a0-f179-45bf-8cd5-35c6d6e29bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:57:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-269493930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13c13126-4c20-43bc-a76f-3d26dcbc0cd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46883f9275dc43248a1d4492b562e39b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:57:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:57:49Z,use_quota=True,user_id='47d05a49fb694c6e99bcc355c8bd23d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:57:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4f01824e-38b8-43c6-89a4-99ee1f4e471b tempest-VolumesCloneNegativeTest-1794031547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24d61b79-6416-4645-96ea-bde0ffb0f3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:57:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4f01824e-38b8-43c6-89a4-99ee1f4e471b tempest-VolumesCloneNegativeTest-1794031547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24d61b79-6416-4645-96ea-bde0ffb0f3d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:57:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4f01824e-38b8-43c6-89a4-99ee1f4e471b tempest-VolumesCloneNegativeTest-1794031547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38779d8a-fce6-44c0-b5c4-f95602f58600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:57:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4f01824e-38b8-43c6-89a4-99ee1f4e471b tempest-VolumesCloneNegativeTest-1794031547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38779d8a-fce6-44c0-b5c4-f95602f58600) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13c13126-4c20-43bc-a76f-3d26dcbc0cd1', 'volume_name': 'volume-13c13126-4c20-43bc-a76f-3d26dcbc0cd1', 'volume_size': 2}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:57:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4f01824e-38b8-43c6-89a4-99ee1f4e471b tempest-VolumesCloneNegativeTest-1794031547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93af0d3d-f127-4fa2-b7f2-f580500f9a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:57:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4f01824e-38b8-43c6-89a4-99ee1f4e471b tempest-VolumesCloneNegativeTest-1794031547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93af0d3d-f127-4fa2-b7f2-f580500f9a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:57:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4f01824e-38b8-43c6-89a4-99ee1f4e471b tempest-VolumesCloneNegativeTest-1794031547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1b393a7-28e5-4abb-8b15-ffff92b1d325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:57:49 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-4f01824e-38b8-43c6-89a4-99ee1f4e471b tempest-VolumesCloneNegativeTest-1794031547 None] Volume 13c13126-4c20-43bc-a76f-3d26dcbc0cd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13c13126-4c20-43bc-a76f-3d26dcbc0cd1', 'volume_size': 2} Nov 06 17:57:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4f01824e-38b8-43c6-89a4-99ee1f4e471b tempest-VolumesCloneNegativeTest-1794031547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:57:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4f01824e-38b8-43c6-89a4-99ee1f4e471b tempest-VolumesCloneNegativeTest-1794031547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:57:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4f01824e-38b8-43c6-89a4-99ee1f4e471b tempest-VolumesCloneNegativeTest-1794031547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:57:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-269493930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13c13126-4c20-43bc-a76f-3d26dcbc0cd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46883f9275dc43248a1d4492b562e39b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:57:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:57:49Z,use_quota=True,user_id='47d05a49fb694c6e99bcc355c8bd23d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:57:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-4f01824e-38b8-43c6-89a4-99ee1f4e471b tempest-VolumesCloneNegativeTest-1794031547 None] Creating volume 13c13126-4c20-43bc-a76f-3d26dcbc0cd1 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:57:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4f01824e-38b8-43c6-89a4-99ee1f4e471b tempest-VolumesCloneNegativeTest-1794031547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:57:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4f01824e-38b8-43c6-89a4-99ee1f4e471b tempest-VolumesCloneNegativeTest-1794031547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:57:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4f01824e-38b8-43c6-89a4-99ee1f4e471b tempest-VolumesCloneNegativeTest-1794031547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:57:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4f01824e-38b8-43c6-89a4-99ee1f4e471b tempest-VolumesCloneNegativeTest-1794031547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:57:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4f01824e-38b8-43c6-89a4-99ee1f4e471b tempest-VolumesCloneNegativeTest-1794031547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:57:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4f01824e-38b8-43c6-89a4-99ee1f4e471b tempest-VolumesCloneNegativeTest-1794031547 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:57:49 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-4f01824e-38b8-43c6-89a4-99ee1f4e471b tempest-VolumesCloneNegativeTest-1794031547 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:57:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4f01824e-38b8-43c6-89a4-99ee1f4e471b tempest-VolumesCloneNegativeTest-1794031547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-13c13126-4c20-43bc-a76f-3d26dcbc0cd1 2147483648 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:49 devstack sudo[101128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-13c13126-4c20-43bc-a76f-3d26dcbc0cd1 2147483648 Nov 06 17:57:49 devstack sudo[101128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:49 devstack sudo[101128]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4f01824e-38b8-43c6-89a4-99ee1f4e471b tempest-VolumesCloneNegativeTest-1794031547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-13c13126-4c20-43bc-a76f-3d26dcbc0cd1 2147483648" returned: 0 in 0.607s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4f01824e-38b8-43c6-89a4-99ee1f4e471b tempest-VolumesCloneNegativeTest-1794031547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-13c13126-4c20-43bc-a76f-3d26dcbc0cd1 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:49 devstack sudo[101135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-13c13126-4c20-43bc-a76f-3d26dcbc0cd1 Nov 06 17:57:49 devstack sudo[101135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:50 devstack sudo[101135]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4f01824e-38b8-43c6-89a4-99ee1f4e471b tempest-VolumesCloneNegativeTest-1794031547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-13c13126-4c20-43bc-a76f-3d26dcbc0cd1" returned: 0 in 0.339s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:50 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4f01824e-38b8-43c6-89a4-99ee1f4e471b tempest-VolumesCloneNegativeTest-1794031547 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:57:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4f01824e-38b8-43c6-89a4-99ee1f4e471b tempest-VolumesCloneNegativeTest-1794031547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:57:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4f01824e-38b8-43c6-89a4-99ee1f4e471b tempest-VolumesCloneNegativeTest-1794031547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1b393a7-28e5-4abb-8b15-ffff92b1d325) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13c13126-4c20-43bc-a76f-3d26dcbc0cd1', 'volume_size': 2}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:57:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4f01824e-38b8-43c6-89a4-99ee1f4e471b tempest-VolumesCloneNegativeTest-1794031547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a17e89ce-414e-4b7f-86d7-446697e6c477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:57:50 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-4f01824e-38b8-43c6-89a4-99ee1f4e471b tempest-VolumesCloneNegativeTest-1794031547 None] Volume volume-13c13126-4c20-43bc-a76f-3d26dcbc0cd1 (13c13126-4c20-43bc-a76f-3d26dcbc0cd1): created successfully Nov 06 17:57:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4f01824e-38b8-43c6-89a4-99ee1f4e471b tempest-VolumesCloneNegativeTest-1794031547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a17e89ce-414e-4b7f-86d7-446697e6c477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:57:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4f01824e-38b8-43c6-89a4-99ee1f4e471b tempest-VolumesCloneNegativeTest-1794031547 None] Flow 'volume_create_manager' (68a4e1be-41bd-4a26-be86-6647f1bc1844) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:57:50 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-4f01824e-38b8-43c6-89a4-99ee1f4e471b tempest-VolumesCloneNegativeTest-1794031547 None] Created volume successfully. Nov 06 17:57:51 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-48abb5d6-52c0-41e7-9798-f61ff5dfd99c tempest-VolumesCloneNegativeTest-1794031547 None] Acquiring lock "cinder-13c13126-4c20-43bc-a76f-3d26dcbc0cd1-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:57:51 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-48abb5d6-52c0-41e7-9798-f61ff5dfd99c tempest-VolumesCloneNegativeTest-1794031547 None] Lock "cinder-13c13126-4c20-43bc-a76f-3d26dcbc0cd1-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:57:51 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-48abb5d6-52c0-41e7-9798-f61ff5dfd99c tempest-VolumesCloneNegativeTest-1794031547 None] Acquiring lock "cinder-quobyte-13c13126-4c20-43bc-a76f-3d26dcbc0cd1" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:57:51 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-48abb5d6-52c0-41e7-9798-f61ff5dfd99c tempest-VolumesCloneNegativeTest-1794031547 None] Lock "cinder-quobyte-13c13126-4c20-43bc-a76f-3d26dcbc0cd1" acquired by "delete_volume" :: waited 0.015s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:57:51 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4607a9-2c31-4848-9765-9ccb98637a41]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:57:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-48abb5d6-52c0-41e7-9798-f61ff5dfd99c tempest-VolumesCloneNegativeTest-1794031547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-13c13126-4c20-43bc-a76f-3d26dcbc0cd1 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:51 devstack sudo[101141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-13c13126-4c20-43bc-a76f-3d26dcbc0cd1 Nov 06 17:57:51 devstack sudo[101141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:51 devstack sudo[101141]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-48abb5d6-52c0-41e7-9798-f61ff5dfd99c tempest-VolumesCloneNegativeTest-1794031547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-13c13126-4c20-43bc-a76f-3d26dcbc0cd1" returned: 0 in 0.445s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-48abb5d6-52c0-41e7-9798-f61ff5dfd99c tempest-VolumesCloneNegativeTest-1794031547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-13c13126-4c20-43bc-a76f-3d26dcbc0cd1 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:51 devstack sudo[101180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-13c13126-4c20-43bc-a76f-3d26dcbc0cd1 Nov 06 17:57:51 devstack sudo[101180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:52 devstack sudo[101180]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-48abb5d6-52c0-41e7-9798-f61ff5dfd99c tempest-VolumesCloneNegativeTest-1794031547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-13c13126-4c20-43bc-a76f-3d26dcbc0cd1" returned: 0 in 0.314s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:52 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-48abb5d6-52c0-41e7-9798-f61ff5dfd99c tempest-VolumesCloneNegativeTest-1794031547 None] Lock "cinder-quobyte-13c13126-4c20-43bc-a76f-3d26dcbc0cd1" released by "delete_volume" :: held 0.821s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:57:52 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-48abb5d6-52c0-41e7-9798-f61ff5dfd99c tempest-VolumesCloneNegativeTest-1794031547 None] Created reservations ['8a53bb43-ce6c-4795-a53c-1925e4439346', '22214ef9-32f6-46c5-9391-471358255fa2', '1929364c-1f19-4333-8a7a-af0322316b36', '8501a266-285e-4f0a-aeb7-730793302d0c'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:57:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-48abb5d6-52c0-41e7-9798-f61ff5dfd99c tempest-VolumesCloneNegativeTest-1794031547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:57:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-48abb5d6-52c0-41e7-9798-f61ff5dfd99c tempest-VolumesCloneNegativeTest-1794031547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:57:52 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-48abb5d6-52c0-41e7-9798-f61ff5dfd99c tempest-VolumesCloneNegativeTest-1794031547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:57:52 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-48abb5d6-52c0-41e7-9798-f61ff5dfd99c tempest-VolumesCloneNegativeTest-1794031547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:57:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-48abb5d6-52c0-41e7-9798-f61ff5dfd99c tempest-VolumesCloneNegativeTest-1794031547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:57:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-48abb5d6-52c0-41e7-9798-f61ff5dfd99c tempest-VolumesCloneNegativeTest-1794031547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:52 devstack sudo[101191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:57:52 devstack sudo[101191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:52 devstack sudo[101191]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-48abb5d6-52c0-41e7-9798-f61ff5dfd99c tempest-VolumesCloneNegativeTest-1794031547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.390s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:52 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-48abb5d6-52c0-41e7-9798-f61ff5dfd99c tempest-VolumesCloneNegativeTest-1794031547 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:57:52 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-48abb5d6-52c0-41e7-9798-f61ff5dfd99c tempest-VolumesCloneNegativeTest-1794031547 None] Deleted volume successfully. Nov 06 17:57:52 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-48abb5d6-52c0-41e7-9798-f61ff5dfd99c tempest-VolumesCloneNegativeTest-1794031547 None] Lock "cinder-13c13126-4c20-43bc-a76f-3d26dcbc0cd1-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:57:54 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 17:57:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:57:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:57:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:57:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:57:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:57:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:54 devstack sudo[101195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:57:54 devstack sudo[101195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:54 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:57:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] Flow 'volume_create_manager' (55bc5c77-aae4-42a4-90b0-ff2ce8daeec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:57:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc143cbf-d4a3-4920-8aa8-cc302fcde624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:57:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc143cbf-d4a3-4920-8aa8-cc302fcde624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:57:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-843749878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd08e637-308b-4596-9cbc-f569b9f1102a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57dae179230b4fd2bc674aeb15e32c37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:57:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:57:55Z,use_quota=True,user_id='ad6934387da04c97a933fea9f443b7c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:57:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d232f6f-51f7-48e1-855d-12458c882c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:57:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d232f6f-51f7-48e1-855d-12458c882c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:57:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (959da6dc-0738-4f96-8529-936d37ce5843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:57:54 devstack cinder-volume[87068]: DEBUG cinder.image.glance [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] Creating Keystone auth plugin from conf {{(pid=87068) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 17:57:54 devstack sudo[101195]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.367s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:54 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:57:54 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running periodic task VolumeManager._thread_info {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 17:57:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] thread count: 28 {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 17:57:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] thread info: [<_MainThread(MainThread, started 133940619505792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 17:57:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (959da6dc-0738-4f96-8529-936d37ce5843) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cd08e637-308b-4596-9cbc-f569b9f1102a', 'volume_name': 'volume-cd08e637-308b-4596-9cbc-f569b9f1102a', 'volume_size': 1, 'image_id': '514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '344c8ba807084eedb5afd931913d7a80', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'created_at': datetime.datetime(2026, 11, 6, 16, 39, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 16, 39, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/514846ea-e0c6-4037-8ba4-bcd35ce3fba9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:57:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49c25f10-c398-442b-b9b0-5180ddddbeb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:57:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49c25f10-c398-442b-b9b0-5180ddddbeb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:57:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a26567c-4237-463a-9402-c5d001ef39d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:57:55 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] Volume cd08e637-308b-4596-9cbc-f569b9f1102a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cd08e637-308b-4596-9cbc-f569b9f1102a', 'volume_size': 1, 'image_id': '514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '344c8ba807084eedb5afd931913d7a80', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'created_at': datetime.datetime(2026, 11, 6, 16, 39, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 16, 39, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/514846ea-e0c6-4037-8ba4-bcd35ce3fba9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 17:57:55 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] Trying to clone cd08e637-308b-4596-9cbc-f569b9f1102a from image 514846ea-e0c6-4037-8ba4-bcd35ce3fba9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'metadata': {}}]). {{(pid=87068) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 17:57:55 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_5__9kryudevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87068) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 06 17:57:55 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] Image download 20.69 MB at 20.69 MB/s Nov 06 17:57:55 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53d4831-6862-47c8-8e4b-6b9dccfbfeb8]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:57:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_5__9kryudevstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:55 devstack sudo[101199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_5__9kryudevstack@QuobyteHD Nov 06 17:57:55 devstack sudo[101199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:56 devstack sudo[101199]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_5__9kryudevstack@QuobyteHD" returned: 0 in 0.379s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:56 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] Temporary image 514846ea-e0c6-4037-8ba4-bcd35ce3fba9 is fetched for user ad6934387da04c97a933fea9f443b7c8. {{(pid=87068) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 06 17:57:56 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed23dadd-e59e-4b7b-8243-263d8a90494a]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:57:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_5__9kryudevstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:56 devstack sudo[101205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_5__9kryudevstack@QuobyteHD Nov 06 17:57:56 devstack sudo[101205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:56 devstack sudo[101205]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_5__9kryudevstack@QuobyteHD" returned: 0 in 0.384s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:57:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:57:56 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:57:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-843749878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd08e637-308b-4596-9cbc-f569b9f1102a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57dae179230b4fd2bc674aeb15e32c37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:57:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:57:55Z,use_quota=True,user_id='ad6934387da04c97a933fea9f443b7c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:57:56 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] Creating volume cd08e637-308b-4596-9cbc-f569b9f1102a {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:57:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:57:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:57:56 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:57:56 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:57:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:57:56 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:57:56 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:57:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-cd08e637-308b-4596-9cbc-f569b9f1102a 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:56 devstack sudo[101212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-cd08e637-308b-4596-9cbc-f569b9f1102a 1073741824 Nov 06 17:57:56 devstack sudo[101212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:57 devstack sudo[101212]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-cd08e637-308b-4596-9cbc-f569b9f1102a 1073741824" returned: 0 in 0.577s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-cd08e637-308b-4596-9cbc-f569b9f1102a {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:57 devstack sudo[101218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-cd08e637-308b-4596-9cbc-f569b9f1102a Nov 06 17:57:57 devstack sudo[101218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:57 devstack sudo[101218]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-cd08e637-308b-4596-9cbc-f569b9f1102a" returned: 0 in 0.347s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:57 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:57:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:57:57 devstack cinder-volume[87068]: DEBUG cinder.volume.volume_utils [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] Attempting download of 514846ea-e0c6-4037-8ba4-bcd35ce3fba9 ((None, [{'url': 'file:///opt/stack/data/glance/images/514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'metadata': {}}])) to volume cd08e637-308b-4596-9cbc-f569b9f1102a. {{(pid=87068) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 17:57:57 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f03f0f-18b8-45cf-8552-2de156202557]: (4, 'raw') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:57:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_hawsrmt_ {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:57 devstack sudo[101222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_hawsrmt_ Nov 06 17:57:57 devstack sudo[101222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:58 devstack sudo[101222]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_hawsrmt_" returned: 0 in 0.541s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_hawsrmt_ {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:58 devstack sudo[101226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_hawsrmt_ Nov 06 17:57:58 devstack sudo[101226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:58 devstack sudo[101226]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_hawsrmt_" returned: 1 in 0.431s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_hawsrmt_' failed. Not Retrying. {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 17:57:58 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ed26ce-4c0e-462b-974b-b8b168ca5e7d]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:57:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_5__9kryudevstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:58 devstack sudo[101230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_5__9kryudevstack@QuobyteHD Nov 06 17:57:58 devstack sudo[101230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:57:59 devstack sudo[101230]: pam_unix(sudo:session): session closed for user root Nov 06 17:57:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_5__9kryudevstack@QuobyteHD" returned: 0 in 0.437s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:57:59 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] 514846ea-e0c6-4037-8ba4-bcd35ce3fba9 was qcow2, converting to qcow2 {{(pid=87068) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 06 17:57:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_5__9kryudevstack@QuobyteHD /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-cd08e637-308b-4596-9cbc-f569b9f1102a {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:57:59 devstack sudo[101235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_5__9kryudevstack@QuobyteHD /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-cd08e637-308b-4596-9cbc-f569b9f1102a Nov 06 17:57:59 devstack sudo[101235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:58:01 devstack sudo[101235]: pam_unix(sudo:session): session closed for user root Nov 06 17:58:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_5__9kryudevstack@QuobyteHD /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-cd08e637-308b-4596-9cbc-f569b9f1102a" returned: 0 in 2.516s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:58:01 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_514846ea-e0c6-4037-8ba4-bcd35ce3fba9_5__9kryudevstack@QuobyteHD, size 112.00 MB, duration 2.52 sec, destination /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-cd08e637-308b-4596-9cbc-f569b9f1102a {{(pid=87068) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 17:58:01 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] Converted 112.00 MB image at 44.48 MB/s Nov 06 17:58:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-cd08e637-308b-4596-9cbc-f569b9f1102a 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:58:01 devstack sudo[101245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-cd08e637-308b-4596-9cbc-f569b9f1102a 1G Nov 06 17:58:01 devstack sudo[101245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:58:01 devstack sudo[101245]: pam_unix(sudo:session): session closed for user root Nov 06 17:58:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-cd08e637-308b-4596-9cbc-f569b9f1102a 1G" returned: 0 in 0.383s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:58:01 devstack cinder-volume[87068]: DEBUG cinder.volume.volume_utils [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] Downloaded image 514846ea-e0c6-4037-8ba4-bcd35ce3fba9 ((None, [{'url': 'file:///opt/stack/data/glance/images/514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'metadata': {}}])) to volume cd08e637-308b-4596-9cbc-f569b9f1102a successfully. {{(pid=87068) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 17:58:01 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] Temporary image 514846ea-e0c6-4037-8ba4-bcd35ce3fba9 for user ad6934387da04c97a933fea9f443b7c8 is deleted. {{(pid=87068) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 06 17:58:01 devstack cinder-volume[87068]: DEBUG cinder.volume.volume_utils [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] Marking volume cd08e637-308b-4596-9cbc-f569b9f1102a as bootable. {{(pid=87068) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 17:58:01 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] Copying metadata from image 514846ea-e0c6-4037-8ba4-bcd35ce3fba9 to cd08e637-308b-4596-9cbc-f569b9f1102a. {{(pid=87068) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 17:58:01 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] Creating volume glance metadata for volume cd08e637-308b-4596-9cbc-f569b9f1102a backed by image 514846ea-e0c6-4037-8ba4-bcd35ce3fba9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87068) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 17:58:02 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a26567c-4237-463a-9402-c5d001ef39d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd08e637-308b-4596-9cbc-f569b9f1102a', 'volume_size': 1, 'image_id': '514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '344c8ba807084eedb5afd931913d7a80', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '514846ea-e0c6-4037-8ba4-bcd35ce3fba9', 'created_at': datetime.datetime(2026, 11, 6, 16, 39, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 16, 39, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/514846ea-e0c6-4037-8ba4-bcd35ce3fba9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:58:02 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06cecb49-c26e-4dfd-8329-d5fe511d1f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:58:02 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] Volume volume-cd08e637-308b-4596-9cbc-f569b9f1102a (cd08e637-308b-4596-9cbc-f569b9f1102a): created successfully Nov 06 17:58:02 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06cecb49-c26e-4dfd-8329-d5fe511d1f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:58:02 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] Flow 'volume_create_manager' (55bc5c77-aae4-42a4-90b0-ff2ce8daeec7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:58:02 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-04999580-077c-4743-ba0d-ca478e241418 tempest-TestShelveInstance-897467448 None] Created volume successfully. Nov 06 17:58:12 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:UPDATE=85,cinder:SELECT=84,cinder:DELETE=9,cinder:INSERT=31 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 17:58:12 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=82,cinder:UPDATE=100,cinder:INSERT=26,cinder:DELETE=7 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 17:58:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-583a8f68-8598-4877-8ef5-50420f121966 req-07b4ac06-16fc-4046-86aa-55ca418ff21a tempest-TestShelveInstance-897467448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:58:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-583a8f68-8598-4877-8ef5-50420f121966 req-07b4ac06-16fc-4046-86aa-55ca418ff21a tempest-TestShelveInstance-897467448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:58:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-583a8f68-8598-4877-8ef5-50420f121966 req-07b4ac06-16fc-4046-86aa-55ca418ff21a tempest-TestShelveInstance-897467448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:58:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-583a8f68-8598-4877-8ef5-50420f121966 req-07b4ac06-16fc-4046-86aa-55ca418ff21a tempest-TestShelveInstance-897467448 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072', 'name': 'volume-cd08e637-308b-4596-9cbc-f569b9f1102a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7325b905-41cc-4a23-abec-c5c643aecff0', 'enforce_multipath': True} {{(pid=87068) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 17:58:14 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-583a8f68-8598-4877-8ef5-50420f121966 req-07b4ac06-16fc-4046-86aa-55ca418ff21a tempest-TestShelveInstance-897467448 None] attachment_update completed successfully. Nov 06 17:58:24 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 17:58:24 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=8 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 17:58:34 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-d18cc715-3448-4538-8144-411119cdfee4 tempest-TestStampPattern-1009226522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:58:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d18cc715-3448-4538-8144-411119cdfee4 tempest-TestStampPattern-1009226522 None] Flow 'volume_create_manager' (ccb9db76-fdcf-44c8-abdf-91e6a4f42412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:58:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d18cc715-3448-4538-8144-411119cdfee4 tempest-TestStampPattern-1009226522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (162df31e-fdb3-4bf8-ab0d-05e6ca034af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:58:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d18cc715-3448-4538-8144-411119cdfee4 tempest-TestStampPattern-1009226522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (162df31e-fdb3-4bf8-ab0d-05e6ca034af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:58:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1609778505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2b696d5-ed98-4c74-8324-5877f1541563,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0a3f5479a940fea7ae997e9a2596ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:58:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:58:35Z,use_quota=True,user_id='9577f90e511d4042831ac65642630443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:58:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d18cc715-3448-4538-8144-411119cdfee4 tempest-TestStampPattern-1009226522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (584f372d-5943-4966-912f-26454c4f926d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:58:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d18cc715-3448-4538-8144-411119cdfee4 tempest-TestStampPattern-1009226522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (584f372d-5943-4966-912f-26454c4f926d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:58:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d18cc715-3448-4538-8144-411119cdfee4 tempest-TestStampPattern-1009226522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ea82230-85b4-42a8-9e28-2e87bc469901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:58:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d18cc715-3448-4538-8144-411119cdfee4 tempest-TestStampPattern-1009226522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ea82230-85b4-42a8-9e28-2e87bc469901) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2b696d5-ed98-4c74-8324-5877f1541563', 'volume_name': 'volume-d2b696d5-ed98-4c74-8324-5877f1541563', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:58:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d18cc715-3448-4538-8144-411119cdfee4 tempest-TestStampPattern-1009226522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea6c281c-7fcb-4af7-b9d4-ba1a83cdc795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:58:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d18cc715-3448-4538-8144-411119cdfee4 tempest-TestStampPattern-1009226522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea6c281c-7fcb-4af7-b9d4-ba1a83cdc795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:58:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d18cc715-3448-4538-8144-411119cdfee4 tempest-TestStampPattern-1009226522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (533c01db-6a19-4a1f-aeb6-e2611205ab68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:58:34 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-d18cc715-3448-4538-8144-411119cdfee4 tempest-TestStampPattern-1009226522 None] Volume d2b696d5-ed98-4c74-8324-5877f1541563: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2b696d5-ed98-4c74-8324-5877f1541563', 'volume_size': 1} Nov 06 17:58:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d18cc715-3448-4538-8144-411119cdfee4 tempest-TestStampPattern-1009226522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:58:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d18cc715-3448-4538-8144-411119cdfee4 tempest-TestStampPattern-1009226522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:58:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d18cc715-3448-4538-8144-411119cdfee4 tempest-TestStampPattern-1009226522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:58:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1609778505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2b696d5-ed98-4c74-8324-5877f1541563,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0a3f5479a940fea7ae997e9a2596ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:58:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:58:35Z,use_quota=True,user_id='9577f90e511d4042831ac65642630443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:58:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-d18cc715-3448-4538-8144-411119cdfee4 tempest-TestStampPattern-1009226522 None] Creating volume d2b696d5-ed98-4c74-8324-5877f1541563 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:58:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d18cc715-3448-4538-8144-411119cdfee4 tempest-TestStampPattern-1009226522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:58:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d18cc715-3448-4538-8144-411119cdfee4 tempest-TestStampPattern-1009226522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:58:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d18cc715-3448-4538-8144-411119cdfee4 tempest-TestStampPattern-1009226522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:58:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d18cc715-3448-4538-8144-411119cdfee4 tempest-TestStampPattern-1009226522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:58:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d18cc715-3448-4538-8144-411119cdfee4 tempest-TestStampPattern-1009226522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:58:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d18cc715-3448-4538-8144-411119cdfee4 tempest-TestStampPattern-1009226522 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:58:34 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-d18cc715-3448-4538-8144-411119cdfee4 tempest-TestStampPattern-1009226522 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:58:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d18cc715-3448-4538-8144-411119cdfee4 tempest-TestStampPattern-1009226522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d2b696d5-ed98-4c74-8324-5877f1541563 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:58:35 devstack sudo[101746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d2b696d5-ed98-4c74-8324-5877f1541563 1073741824 Nov 06 17:58:35 devstack sudo[101746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:58:35 devstack sudo[101746]: pam_unix(sudo:session): session closed for user root Nov 06 17:58:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d18cc715-3448-4538-8144-411119cdfee4 tempest-TestStampPattern-1009226522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d2b696d5-ed98-4c74-8324-5877f1541563 1073741824" returned: 0 in 0.767s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:58:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d18cc715-3448-4538-8144-411119cdfee4 tempest-TestStampPattern-1009226522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d2b696d5-ed98-4c74-8324-5877f1541563 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:58:35 devstack sudo[101756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d2b696d5-ed98-4c74-8324-5877f1541563 Nov 06 17:58:35 devstack sudo[101756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:58:36 devstack sudo[101756]: pam_unix(sudo:session): session closed for user root Nov 06 17:58:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d18cc715-3448-4538-8144-411119cdfee4 tempest-TestStampPattern-1009226522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d2b696d5-ed98-4c74-8324-5877f1541563" returned: 0 in 0.590s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:58:36 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d18cc715-3448-4538-8144-411119cdfee4 tempest-TestStampPattern-1009226522 None] <== create_volume: return (1495ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:58:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d18cc715-3448-4538-8144-411119cdfee4 tempest-TestStampPattern-1009226522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.500s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:58:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d18cc715-3448-4538-8144-411119cdfee4 tempest-TestStampPattern-1009226522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (533c01db-6a19-4a1f-aeb6-e2611205ab68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2b696d5-ed98-4c74-8324-5877f1541563', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:58:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d18cc715-3448-4538-8144-411119cdfee4 tempest-TestStampPattern-1009226522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2264b588-d992-47b2-bfe9-aa5b7091b07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:58:36 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-d18cc715-3448-4538-8144-411119cdfee4 tempest-TestStampPattern-1009226522 None] Volume volume-d2b696d5-ed98-4c74-8324-5877f1541563 (d2b696d5-ed98-4c74-8324-5877f1541563): created successfully Nov 06 17:58:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d18cc715-3448-4538-8144-411119cdfee4 tempest-TestStampPattern-1009226522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2264b588-d992-47b2-bfe9-aa5b7091b07f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:58:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d18cc715-3448-4538-8144-411119cdfee4 tempest-TestStampPattern-1009226522 None] Flow 'volume_create_manager' (ccb9db76-fdcf-44c8-abdf-91e6a4f42412) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:58:36 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-d18cc715-3448-4538-8144-411119cdfee4 tempest-TestStampPattern-1009226522 None] Created volume successfully. Nov 06 17:58:44 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-8df587a5-db4f-4c97-ae20-5a694f18942b tempest-TestServerVolumeAttachmentScenario-2030177302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:58:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8df587a5-db4f-4c97-ae20-5a694f18942b tempest-TestServerVolumeAttachmentScenario-2030177302 None] Flow 'volume_create_manager' (1988c260-f91c-4b78-9870-9669da146eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:58:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8df587a5-db4f-4c97-ae20-5a694f18942b tempest-TestServerVolumeAttachmentScenario-2030177302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f459eac5-6f5b-4001-9e67-bc7895ba160b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:58:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8df587a5-db4f-4c97-ae20-5a694f18942b tempest-TestServerVolumeAttachmentScenario-2030177302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f459eac5-6f5b-4001-9e67-bc7895ba160b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:58:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1047669829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7023eb08-5967-48f3-b8f8-6c676447271b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93d618ee053f47aca6da0891ccf7655b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:58:44Z,use_quota=True,user_id='66e4b50a21d54dbf8dc248ee41e44f79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:58:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8df587a5-db4f-4c97-ae20-5a694f18942b tempest-TestServerVolumeAttachmentScenario-2030177302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afe54997-445d-445b-ade6-fac8fd2c9300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:58:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8df587a5-db4f-4c97-ae20-5a694f18942b tempest-TestServerVolumeAttachmentScenario-2030177302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afe54997-445d-445b-ade6-fac8fd2c9300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:58:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8df587a5-db4f-4c97-ae20-5a694f18942b tempest-TestServerVolumeAttachmentScenario-2030177302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f872ee6-da7b-462a-ac86-b8acccfb7eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:58:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8df587a5-db4f-4c97-ae20-5a694f18942b tempest-TestServerVolumeAttachmentScenario-2030177302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f872ee6-da7b-462a-ac86-b8acccfb7eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7023eb08-5967-48f3-b8f8-6c676447271b', 'volume_name': 'volume-7023eb08-5967-48f3-b8f8-6c676447271b', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:58:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8df587a5-db4f-4c97-ae20-5a694f18942b tempest-TestServerVolumeAttachmentScenario-2030177302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffe8d6b0-3dbd-4581-a318-058cd5f90310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:58:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8df587a5-db4f-4c97-ae20-5a694f18942b tempest-TestServerVolumeAttachmentScenario-2030177302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffe8d6b0-3dbd-4581-a318-058cd5f90310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:58:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8df587a5-db4f-4c97-ae20-5a694f18942b tempest-TestServerVolumeAttachmentScenario-2030177302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31eb2c9f-ddc2-41b7-a4cc-07b0f89a8c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:58:44 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-8df587a5-db4f-4c97-ae20-5a694f18942b tempest-TestServerVolumeAttachmentScenario-2030177302 None] Volume 7023eb08-5967-48f3-b8f8-6c676447271b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7023eb08-5967-48f3-b8f8-6c676447271b', 'volume_size': 1} Nov 06 17:58:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8df587a5-db4f-4c97-ae20-5a694f18942b tempest-TestServerVolumeAttachmentScenario-2030177302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:58:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8df587a5-db4f-4c97-ae20-5a694f18942b tempest-TestServerVolumeAttachmentScenario-2030177302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:58:44 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8df587a5-db4f-4c97-ae20-5a694f18942b tempest-TestServerVolumeAttachmentScenario-2030177302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:58:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1047669829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7023eb08-5967-48f3-b8f8-6c676447271b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93d618ee053f47aca6da0891ccf7655b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:58:44Z,use_quota=True,user_id='66e4b50a21d54dbf8dc248ee41e44f79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:58:44 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-8df587a5-db4f-4c97-ae20-5a694f18942b tempest-TestServerVolumeAttachmentScenario-2030177302 None] Creating volume 7023eb08-5967-48f3-b8f8-6c676447271b {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:58:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8df587a5-db4f-4c97-ae20-5a694f18942b tempest-TestServerVolumeAttachmentScenario-2030177302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:58:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8df587a5-db4f-4c97-ae20-5a694f18942b tempest-TestServerVolumeAttachmentScenario-2030177302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:58:44 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8df587a5-db4f-4c97-ae20-5a694f18942b tempest-TestServerVolumeAttachmentScenario-2030177302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:58:44 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8df587a5-db4f-4c97-ae20-5a694f18942b tempest-TestServerVolumeAttachmentScenario-2030177302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:58:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8df587a5-db4f-4c97-ae20-5a694f18942b tempest-TestServerVolumeAttachmentScenario-2030177302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:58:44 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8df587a5-db4f-4c97-ae20-5a694f18942b tempest-TestServerVolumeAttachmentScenario-2030177302 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:58:44 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-8df587a5-db4f-4c97-ae20-5a694f18942b tempest-TestServerVolumeAttachmentScenario-2030177302 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:58:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8df587a5-db4f-4c97-ae20-5a694f18942b tempest-TestServerVolumeAttachmentScenario-2030177302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7023eb08-5967-48f3-b8f8-6c676447271b 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:58:44 devstack sudo[101788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7023eb08-5967-48f3-b8f8-6c676447271b 1073741824 Nov 06 17:58:44 devstack sudo[101788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:58:45 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6514a56-7faf-4532-8044-e0ed162ec2bd tempest-TestServerVolumeAttachmentScenario-2030177302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:58:45 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c6514a56-7faf-4532-8044-e0ed162ec2bd tempest-TestServerVolumeAttachmentScenario-2030177302 None] Flow 'volume_create_manager' (4d758fdb-2d6d-4695-8c78-cddc0f7045f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:58:45 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c6514a56-7faf-4532-8044-e0ed162ec2bd tempest-TestServerVolumeAttachmentScenario-2030177302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89d8f217-6d8c-45bd-88bf-175adf7fc063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:58:45 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c6514a56-7faf-4532-8044-e0ed162ec2bd tempest-TestServerVolumeAttachmentScenario-2030177302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89d8f217-6d8c-45bd-88bf-175adf7fc063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:58:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-449390695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db31610c-a5f3-4c7b-90f7-28a6306df7ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93d618ee053f47aca6da0891ccf7655b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:58:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:58:45Z,use_quota=True,user_id='66e4b50a21d54dbf8dc248ee41e44f79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:58:45 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c6514a56-7faf-4532-8044-e0ed162ec2bd tempest-TestServerVolumeAttachmentScenario-2030177302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68dceb9c-e4f3-4406-95bd-e5749529b35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:58:45 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c6514a56-7faf-4532-8044-e0ed162ec2bd tempest-TestServerVolumeAttachmentScenario-2030177302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68dceb9c-e4f3-4406-95bd-e5749529b35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:58:45 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c6514a56-7faf-4532-8044-e0ed162ec2bd tempest-TestServerVolumeAttachmentScenario-2030177302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (180942e3-7b24-41f2-bcb3-df2095847cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:58:45 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c6514a56-7faf-4532-8044-e0ed162ec2bd tempest-TestServerVolumeAttachmentScenario-2030177302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (180942e3-7b24-41f2-bcb3-df2095847cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db31610c-a5f3-4c7b-90f7-28a6306df7ce', 'volume_name': 'volume-db31610c-a5f3-4c7b-90f7-28a6306df7ce', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:58:45 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c6514a56-7faf-4532-8044-e0ed162ec2bd tempest-TestServerVolumeAttachmentScenario-2030177302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e873e9d7-8d38-4078-8790-f416d796e167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:58:45 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c6514a56-7faf-4532-8044-e0ed162ec2bd tempest-TestServerVolumeAttachmentScenario-2030177302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e873e9d7-8d38-4078-8790-f416d796e167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:58:45 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c6514a56-7faf-4532-8044-e0ed162ec2bd tempest-TestServerVolumeAttachmentScenario-2030177302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38c098f4-a810-4187-9ea2-920ae0268c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:58:45 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-c6514a56-7faf-4532-8044-e0ed162ec2bd tempest-TestServerVolumeAttachmentScenario-2030177302 None] Volume db31610c-a5f3-4c7b-90f7-28a6306df7ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db31610c-a5f3-4c7b-90f7-28a6306df7ce', 'volume_size': 1} Nov 06 17:58:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c6514a56-7faf-4532-8044-e0ed162ec2bd tempest-TestServerVolumeAttachmentScenario-2030177302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:58:45 devstack sudo[101788]: pam_unix(sudo:session): session closed for user root Nov 06 17:58:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8df587a5-db4f-4c97-ae20-5a694f18942b tempest-TestServerVolumeAttachmentScenario-2030177302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7023eb08-5967-48f3-b8f8-6c676447271b 1073741824" returned: 0 in 1.014s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:58:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8df587a5-db4f-4c97-ae20-5a694f18942b tempest-TestServerVolumeAttachmentScenario-2030177302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7023eb08-5967-48f3-b8f8-6c676447271b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:58:45 devstack sudo[101795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7023eb08-5967-48f3-b8f8-6c676447271b Nov 06 17:58:45 devstack sudo[101795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:58:46 devstack sudo[101795]: pam_unix(sudo:session): session closed for user root Nov 06 17:58:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8df587a5-db4f-4c97-ae20-5a694f18942b tempest-TestServerVolumeAttachmentScenario-2030177302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7023eb08-5967-48f3-b8f8-6c676447271b" returned: 0 in 0.461s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:58:46 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8df587a5-db4f-4c97-ae20-5a694f18942b tempest-TestServerVolumeAttachmentScenario-2030177302 None] <== create_volume: return (1582ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:58:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8df587a5-db4f-4c97-ae20-5a694f18942b tempest-TestServerVolumeAttachmentScenario-2030177302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.597s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:58:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c6514a56-7faf-4532-8044-e0ed162ec2bd tempest-TestServerVolumeAttachmentScenario-2030177302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.579s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:58:46 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c6514a56-7faf-4532-8044-e0ed162ec2bd tempest-TestServerVolumeAttachmentScenario-2030177302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:58:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-449390695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db31610c-a5f3-4c7b-90f7-28a6306df7ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93d618ee053f47aca6da0891ccf7655b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:58:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:58:45Z,use_quota=True,user_id='66e4b50a21d54dbf8dc248ee41e44f79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:58:46 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-c6514a56-7faf-4532-8044-e0ed162ec2bd tempest-TestServerVolumeAttachmentScenario-2030177302 None] Creating volume db31610c-a5f3-4c7b-90f7-28a6306df7ce {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:58:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c6514a56-7faf-4532-8044-e0ed162ec2bd tempest-TestServerVolumeAttachmentScenario-2030177302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:58:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c6514a56-7faf-4532-8044-e0ed162ec2bd tempest-TestServerVolumeAttachmentScenario-2030177302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:58:46 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c6514a56-7faf-4532-8044-e0ed162ec2bd tempest-TestServerVolumeAttachmentScenario-2030177302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:58:46 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c6514a56-7faf-4532-8044-e0ed162ec2bd tempest-TestServerVolumeAttachmentScenario-2030177302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:58:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c6514a56-7faf-4532-8044-e0ed162ec2bd tempest-TestServerVolumeAttachmentScenario-2030177302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:58:46 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c6514a56-7faf-4532-8044-e0ed162ec2bd tempest-TestServerVolumeAttachmentScenario-2030177302 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:58:46 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-c6514a56-7faf-4532-8044-e0ed162ec2bd tempest-TestServerVolumeAttachmentScenario-2030177302 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:58:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c6514a56-7faf-4532-8044-e0ed162ec2bd tempest-TestServerVolumeAttachmentScenario-2030177302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-db31610c-a5f3-4c7b-90f7-28a6306df7ce 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:58:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8df587a5-db4f-4c97-ae20-5a694f18942b tempest-TestServerVolumeAttachmentScenario-2030177302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31eb2c9f-ddc2-41b7-a4cc-07b0f89a8c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7023eb08-5967-48f3-b8f8-6c676447271b', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:58:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8df587a5-db4f-4c97-ae20-5a694f18942b tempest-TestServerVolumeAttachmentScenario-2030177302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8510d183-3904-4b6e-86e7-1e7b9825f189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:58:46 devstack sudo[101799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-db31610c-a5f3-4c7b-90f7-28a6306df7ce 1073741824 Nov 06 17:58:46 devstack sudo[101799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:58:46 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-8df587a5-db4f-4c97-ae20-5a694f18942b tempest-TestServerVolumeAttachmentScenario-2030177302 None] Volume volume-7023eb08-5967-48f3-b8f8-6c676447271b (7023eb08-5967-48f3-b8f8-6c676447271b): created successfully Nov 06 17:58:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8df587a5-db4f-4c97-ae20-5a694f18942b tempest-TestServerVolumeAttachmentScenario-2030177302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8510d183-3904-4b6e-86e7-1e7b9825f189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:58:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8df587a5-db4f-4c97-ae20-5a694f18942b tempest-TestServerVolumeAttachmentScenario-2030177302 None] Flow 'volume_create_manager' (1988c260-f91c-4b78-9870-9669da146eee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:58:46 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-8df587a5-db4f-4c97-ae20-5a694f18942b tempest-TestServerVolumeAttachmentScenario-2030177302 None] Created volume successfully. Nov 06 17:58:46 devstack sudo[101799]: pam_unix(sudo:session): session closed for user root Nov 06 17:58:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c6514a56-7faf-4532-8044-e0ed162ec2bd tempest-TestServerVolumeAttachmentScenario-2030177302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-db31610c-a5f3-4c7b-90f7-28a6306df7ce 1073741824" returned: 0 in 0.817s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:58:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c6514a56-7faf-4532-8044-e0ed162ec2bd tempest-TestServerVolumeAttachmentScenario-2030177302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-db31610c-a5f3-4c7b-90f7-28a6306df7ce {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:58:47 devstack sudo[101820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-db31610c-a5f3-4c7b-90f7-28a6306df7ce Nov 06 17:58:47 devstack sudo[101820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:58:47 devstack sudo[101820]: pam_unix(sudo:session): session closed for user root Nov 06 17:58:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c6514a56-7faf-4532-8044-e0ed162ec2bd tempest-TestServerVolumeAttachmentScenario-2030177302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-db31610c-a5f3-4c7b-90f7-28a6306df7ce" returned: 0 in 0.459s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:58:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c6514a56-7faf-4532-8044-e0ed162ec2bd tempest-TestServerVolumeAttachmentScenario-2030177302 None] <== create_volume: return (1358ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:58:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c6514a56-7faf-4532-8044-e0ed162ec2bd tempest-TestServerVolumeAttachmentScenario-2030177302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.363s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:58:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c6514a56-7faf-4532-8044-e0ed162ec2bd tempest-TestServerVolumeAttachmentScenario-2030177302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38c098f4-a810-4187-9ea2-920ae0268c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db31610c-a5f3-4c7b-90f7-28a6306df7ce', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:58:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c6514a56-7faf-4532-8044-e0ed162ec2bd tempest-TestServerVolumeAttachmentScenario-2030177302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a28b37e-065d-4118-bf6b-d928fc923757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:58:47 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-c6514a56-7faf-4532-8044-e0ed162ec2bd tempest-TestServerVolumeAttachmentScenario-2030177302 None] Volume volume-db31610c-a5f3-4c7b-90f7-28a6306df7ce (db31610c-a5f3-4c7b-90f7-28a6306df7ce): created successfully Nov 06 17:58:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c6514a56-7faf-4532-8044-e0ed162ec2bd tempest-TestServerVolumeAttachmentScenario-2030177302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a28b37e-065d-4118-bf6b-d928fc923757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:58:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c6514a56-7faf-4532-8044-e0ed162ec2bd tempest-TestServerVolumeAttachmentScenario-2030177302 None] Flow 'volume_create_manager' (4d758fdb-2d6d-4695-8c78-cddc0f7045f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:58:47 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-c6514a56-7faf-4532-8044-e0ed162ec2bd tempest-TestServerVolumeAttachmentScenario-2030177302 None] Created volume successfully. Nov 06 17:58:54 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 17:58:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:58:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:58:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:58:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:58:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:58:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:58:54 devstack sudo[102020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:58:54 devstack sudo[102020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:58:55 devstack sudo[102020]: pam_unix(sudo:session): session closed for user root Nov 06 17:58:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 1.158s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:58:55 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:58:55 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running periodic task VolumeManager._thread_info {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 17:58:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] thread count: 28 {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 17:58:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] thread info: [<_MainThread(MainThread, started 133940619505792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 17:58:57 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=4,cinder:UPDATE=10,cinder:INSERT=1 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 17:58:57 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=8,cinder:UPDATE=8,cinder:INSERT=2,cinder:DELETE=3 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 17:59:04 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bbcf546-de8c-4c40-b394-7f9ee9d6b578 tempest-TestMinimumBasicScenario-544336845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:59:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6bbcf546-de8c-4c40-b394-7f9ee9d6b578 tempest-TestMinimumBasicScenario-544336845 None] Flow 'volume_create_manager' (555deb86-c0ce-4d74-a001-159556edbfd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:59:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6bbcf546-de8c-4c40-b394-7f9ee9d6b578 tempest-TestMinimumBasicScenario-544336845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa1181f3-c291-4731-8160-3e1fbab90d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:59:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6bbcf546-de8c-4c40-b394-7f9ee9d6b578 tempest-TestMinimumBasicScenario-544336845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa1181f3-c291-4731-8160-3e1fbab90d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:59:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-997613178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48304553-d973-4f0a-beff-28acd6123396,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f271569c8a55463f8ddf2685cd036da4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:59:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:59:04Z,use_quota=True,user_id='bd021652eb594a4f816c516cb1fdaa30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:59:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6bbcf546-de8c-4c40-b394-7f9ee9d6b578 tempest-TestMinimumBasicScenario-544336845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d210121-3039-4952-bc8e-4ba8db09b4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:59:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6bbcf546-de8c-4c40-b394-7f9ee9d6b578 tempest-TestMinimumBasicScenario-544336845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d210121-3039-4952-bc8e-4ba8db09b4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:59:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6bbcf546-de8c-4c40-b394-7f9ee9d6b578 tempest-TestMinimumBasicScenario-544336845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fbee7bf-7f4b-4a64-a359-5d303e1297cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:59:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6bbcf546-de8c-4c40-b394-7f9ee9d6b578 tempest-TestMinimumBasicScenario-544336845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fbee7bf-7f4b-4a64-a359-5d303e1297cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48304553-d973-4f0a-beff-28acd6123396', 'volume_name': 'volume-48304553-d973-4f0a-beff-28acd6123396', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:59:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6bbcf546-de8c-4c40-b394-7f9ee9d6b578 tempest-TestMinimumBasicScenario-544336845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71117060-8d30-4fdc-8c86-f546ca165cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:59:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6bbcf546-de8c-4c40-b394-7f9ee9d6b578 tempest-TestMinimumBasicScenario-544336845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71117060-8d30-4fdc-8c86-f546ca165cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:59:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6bbcf546-de8c-4c40-b394-7f9ee9d6b578 tempest-TestMinimumBasicScenario-544336845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (854c090a-a42c-472f-88fa-10a3f7134a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:59:04 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-6bbcf546-de8c-4c40-b394-7f9ee9d6b578 tempest-TestMinimumBasicScenario-544336845 None] Volume 48304553-d973-4f0a-beff-28acd6123396: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48304553-d973-4f0a-beff-28acd6123396', 'volume_size': 1} Nov 06 17:59:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6bbcf546-de8c-4c40-b394-7f9ee9d6b578 tempest-TestMinimumBasicScenario-544336845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:59:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6bbcf546-de8c-4c40-b394-7f9ee9d6b578 tempest-TestMinimumBasicScenario-544336845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:59:04 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-6bbcf546-de8c-4c40-b394-7f9ee9d6b578 tempest-TestMinimumBasicScenario-544336845 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:59:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-997613178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48304553-d973-4f0a-beff-28acd6123396,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f271569c8a55463f8ddf2685cd036da4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:59:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:59:04Z,use_quota=True,user_id='bd021652eb594a4f816c516cb1fdaa30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 17:59:04 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-6bbcf546-de8c-4c40-b394-7f9ee9d6b578 tempest-TestMinimumBasicScenario-544336845 None] Creating volume 48304553-d973-4f0a-beff-28acd6123396 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 17:59:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6bbcf546-de8c-4c40-b394-7f9ee9d6b578 tempest-TestMinimumBasicScenario-544336845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:59:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6bbcf546-de8c-4c40-b394-7f9ee9d6b578 tempest-TestMinimumBasicScenario-544336845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:59:04 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-6bbcf546-de8c-4c40-b394-7f9ee9d6b578 tempest-TestMinimumBasicScenario-544336845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:59:04 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-6bbcf546-de8c-4c40-b394-7f9ee9d6b578 tempest-TestMinimumBasicScenario-544336845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:59:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6bbcf546-de8c-4c40-b394-7f9ee9d6b578 tempest-TestMinimumBasicScenario-544336845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:59:04 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-6bbcf546-de8c-4c40-b394-7f9ee9d6b578 tempest-TestMinimumBasicScenario-544336845 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:59:04 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-6bbcf546-de8c-4c40-b394-7f9ee9d6b578 tempest-TestMinimumBasicScenario-544336845 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 17:59:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6bbcf546-de8c-4c40-b394-7f9ee9d6b578 tempest-TestMinimumBasicScenario-544336845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-48304553-d973-4f0a-beff-28acd6123396 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:59:04 devstack sudo[102092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-48304553-d973-4f0a-beff-28acd6123396 1073741824 Nov 06 17:59:04 devstack sudo[102092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:59:06 devstack sudo[102092]: pam_unix(sudo:session): session closed for user root Nov 06 17:59:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6bbcf546-de8c-4c40-b394-7f9ee9d6b578 tempest-TestMinimumBasicScenario-544336845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-48304553-d973-4f0a-beff-28acd6123396 1073741824" returned: 0 in 1.526s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:59:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6bbcf546-de8c-4c40-b394-7f9ee9d6b578 tempest-TestMinimumBasicScenario-544336845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-48304553-d973-4f0a-beff-28acd6123396 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:59:06 devstack sudo[102141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-48304553-d973-4f0a-beff-28acd6123396 Nov 06 17:59:06 devstack sudo[102141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:59:07 devstack sudo[102141]: pam_unix(sudo:session): session closed for user root Nov 06 17:59:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6bbcf546-de8c-4c40-b394-7f9ee9d6b578 tempest-TestMinimumBasicScenario-544336845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-48304553-d973-4f0a-beff-28acd6123396" returned: 0 in 0.844s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:59:07 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-6bbcf546-de8c-4c40-b394-7f9ee9d6b578 tempest-TestMinimumBasicScenario-544336845 None] <== create_volume: return (2487ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 17:59:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6bbcf546-de8c-4c40-b394-7f9ee9d6b578 tempest-TestMinimumBasicScenario-544336845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.494s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:59:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6bbcf546-de8c-4c40-b394-7f9ee9d6b578 tempest-TestMinimumBasicScenario-544336845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (854c090a-a42c-472f-88fa-10a3f7134a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48304553-d973-4f0a-beff-28acd6123396', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:59:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6bbcf546-de8c-4c40-b394-7f9ee9d6b578 tempest-TestMinimumBasicScenario-544336845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f8e7b82-99df-4217-a1fa-9a35e411c733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:59:07 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-6bbcf546-de8c-4c40-b394-7f9ee9d6b578 tempest-TestMinimumBasicScenario-544336845 None] Volume volume-48304553-d973-4f0a-beff-28acd6123396 (48304553-d973-4f0a-beff-28acd6123396): created successfully Nov 06 17:59:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6bbcf546-de8c-4c40-b394-7f9ee9d6b578 tempest-TestMinimumBasicScenario-544336845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f8e7b82-99df-4217-a1fa-9a35e411c733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:59:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6bbcf546-de8c-4c40-b394-7f9ee9d6b578 tempest-TestMinimumBasicScenario-544336845 None] Flow 'volume_create_manager' (555deb86-c0ce-4d74-a001-159556edbfd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:59:07 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-6bbcf546-de8c-4c40-b394-7f9ee9d6b578 tempest-TestMinimumBasicScenario-544336845 None] Created volume successfully. Nov 06 17:59:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-8db70bae-954e-47df-8c5a-7d8eb88c9dfa req-1943de03-44cd-4f41-a5ef-6accf1e0d61f tempest-TestMinimumBasicScenario-544336845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:59:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-8db70bae-954e-47df-8c5a-7d8eb88c9dfa req-1943de03-44cd-4f41-a5ef-6accf1e0d61f tempest-TestMinimumBasicScenario-544336845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:59:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-8db70bae-954e-47df-8c5a-7d8eb88c9dfa req-1943de03-44cd-4f41-a5ef-6accf1e0d61f tempest-TestMinimumBasicScenario-544336845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:59:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-8db70bae-954e-47df-8c5a-7d8eb88c9dfa req-1943de03-44cd-4f41-a5ef-6accf1e0d61f tempest-TestMinimumBasicScenario-544336845 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072', 'name': 'volume-48304553-d973-4f0a-beff-28acd6123396', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ebf48da8-ddcd-4f65-bd82-ff275cde7bd7', 'enforce_multipath': True} {{(pid=87068) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 17:59:11 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-8db70bae-954e-47df-8c5a-7d8eb88c9dfa req-1943de03-44cd-4f41-a5ef-6accf1e0d61f tempest-TestMinimumBasicScenario-544336845 None] attachment_update completed successfully. Nov 06 17:59:14 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-160cb7bc-081c-428e-bc15-87460dd6a5fa req-0e485ca2-f25e-4992-a45a-41d23424f069 tempest-TestShelveInstance-897467448 None] Terminate volume connection completed successfully. Nov 06 17:59:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-160cb7bc-081c-428e-bc15-87460dd6a5fa req-0e485ca2-f25e-4992-a45a-41d23424f069 tempest-TestShelveInstance-897467448 None] Deleting attachment 7325b905-41cc-4a23-abec-c5c643aecff0. {{(pid=87068) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 17:59:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-cc5819ad-df4f-4b96-ab07-7860bb3a5ecc req-fea088fb-5399-41ca-8fd8-70d57223d648 tempest-TestShelveInstance-897467448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:59:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-cc5819ad-df4f-4b96-ab07-7860bb3a5ecc req-fea088fb-5399-41ca-8fd8-70d57223d648 tempest-TestShelveInstance-897467448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:59:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-cc5819ad-df4f-4b96-ab07-7860bb3a5ecc req-fea088fb-5399-41ca-8fd8-70d57223d648 tempest-TestShelveInstance-897467448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:59:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-cc5819ad-df4f-4b96-ab07-7860bb3a5ecc req-fea088fb-5399-41ca-8fd8-70d57223d648 tempest-TestShelveInstance-897467448 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072', 'name': 'volume-cd08e637-308b-4596-9cbc-f569b9f1102a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c08add17-7b1b-46cc-9604-e6c0240c2b6d', 'enforce_multipath': True} {{(pid=87068) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 17:59:17 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-cc5819ad-df4f-4b96-ab07-7860bb3a5ecc req-fea088fb-5399-41ca-8fd8-70d57223d648 tempest-TestShelveInstance-897467448 None] attachment_update completed successfully. Nov 06 17:59:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-7d445139-e4cf-4e0f-bb3c-259a92b9820b req-e918e39d-b612-4f8f-9aca-743008c2767c tempest-TestStampPattern-1009226522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:59:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-7d445139-e4cf-4e0f-bb3c-259a92b9820b req-e918e39d-b612-4f8f-9aca-743008c2767c tempest-TestStampPattern-1009226522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:59:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-7d445139-e4cf-4e0f-bb3c-259a92b9820b req-e918e39d-b612-4f8f-9aca-743008c2767c tempest-TestStampPattern-1009226522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:59:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-7d445139-e4cf-4e0f-bb3c-259a92b9820b req-e918e39d-b612-4f8f-9aca-743008c2767c tempest-TestStampPattern-1009226522 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072', 'name': 'volume-d2b696d5-ed98-4c74-8324-5877f1541563', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '02aa015f-4809-4a9c-8f47-712bfb63f2df', 'enforce_multipath': True} {{(pid=87068) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 17:59:24 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-7d445139-e4cf-4e0f-bb3c-259a92b9820b req-e918e39d-b612-4f8f-9aca-743008c2767c tempest-TestStampPattern-1009226522 None] attachment_update completed successfully. Nov 06 17:59:29 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-dac93f2b-2188-4874-a9a4-dbf4edc49cf6 req-66a5378b-dd84-40d8-8dd6-6f46f9764a69 tempest-TestStampPattern-1009226522 None] Terminate volume connection completed successfully. Nov 06 17:59:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-dac93f2b-2188-4874-a9a4-dbf4edc49cf6 req-66a5378b-dd84-40d8-8dd6-6f46f9764a69 tempest-TestStampPattern-1009226522 None] Deleting attachment 02aa015f-4809-4a9c-8f47-712bfb63f2df. {{(pid=87068) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 17:59:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-488316ea-257e-49ea-982f-a45d69b42383 tempest-TestStampPattern-1009226522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:59:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-488316ea-257e-49ea-982f-a45d69b42383 tempest-TestStampPattern-1009226522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:59:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-488316ea-257e-49ea-982f-a45d69b42383 tempest-TestStampPattern-1009226522 None] Creating offline snapshot 328f139e-aab6-434e-b8de-253760d763ee of volume d2b696d5-ed98-4c74-8324-5877f1541563 {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 17:59:30 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[782a91d7-35f0-4266-aff6-031e5b4e2556]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:59:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-488316ea-257e-49ea-982f-a45d69b42383 tempest-TestStampPattern-1009226522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d2b696d5-ed98-4c74-8324-5877f1541563 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:59:30 devstack sudo[102439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d2b696d5-ed98-4c74-8324-5877f1541563 Nov 06 17:59:30 devstack sudo[102439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:59:31 devstack sudo[102439]: pam_unix(sudo:session): session closed for user root Nov 06 17:59:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-488316ea-257e-49ea-982f-a45d69b42383 tempest-TestStampPattern-1009226522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d2b696d5-ed98-4c74-8324-5877f1541563" returned: 0 in 0.437s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:59:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-488316ea-257e-49ea-982f-a45d69b42383 tempest-TestStampPattern-1009226522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d2b696d5-ed98-4c74-8324-5877f1541563,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d2b696d5-ed98-4c74-8324-5877f1541563.328f139e-aab6-434e-b8de-253760d763ee 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:59:31 devstack sudo[102449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d2b696d5-ed98-4c74-8324-5877f1541563,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d2b696d5-ed98-4c74-8324-5877f1541563.328f139e-aab6-434e-b8de-253760d763ee 1G Nov 06 17:59:31 devstack sudo[102449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:59:31 devstack sudo[102449]: pam_unix(sudo:session): session closed for user root Nov 06 17:59:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-488316ea-257e-49ea-982f-a45d69b42383 tempest-TestStampPattern-1009226522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d2b696d5-ed98-4c74-8324-5877f1541563,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d2b696d5-ed98-4c74-8324-5877f1541563.328f139e-aab6-434e-b8de-253760d763ee 1G" returned: 0 in 0.476s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:59:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-488316ea-257e-49ea-982f-a45d69b42383 tempest-TestStampPattern-1009226522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2b696d5-ed98-4c74-8324-5877f1541563 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d2b696d5-ed98-4c74-8324-5877f1541563.328f139e-aab6-434e-b8de-253760d763ee {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:59:31 devstack sudo[102472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2b696d5-ed98-4c74-8324-5877f1541563 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d2b696d5-ed98-4c74-8324-5877f1541563.328f139e-aab6-434e-b8de-253760d763ee Nov 06 17:59:31 devstack sudo[102472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:59:32 devstack sudo[102472]: pam_unix(sudo:session): session closed for user root Nov 06 17:59:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-488316ea-257e-49ea-982f-a45d69b42383 tempest-TestStampPattern-1009226522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2b696d5-ed98-4c74-8324-5877f1541563 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d2b696d5-ed98-4c74-8324-5877f1541563.328f139e-aab6-434e-b8de-253760d763ee" returned: 0 in 0.342s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:59:32 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-488316ea-257e-49ea-982f-a45d69b42383 tempest-TestStampPattern-1009226522 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d2b696d5-ed98-4c74-8324-5877f1541563.328f139e-aab6-434e-b8de-253760d763ee is being set with open permissions: ugo+rw Nov 06 17:59:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-488316ea-257e-49ea-982f-a45d69b42383 tempest-TestStampPattern-1009226522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d2b696d5-ed98-4c74-8324-5877f1541563.328f139e-aab6-434e-b8de-253760d763ee {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:59:32 devstack sudo[102478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d2b696d5-ed98-4c74-8324-5877f1541563.328f139e-aab6-434e-b8de-253760d763ee Nov 06 17:59:32 devstack sudo[102478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:59:32 devstack sudo[102478]: pam_unix(sudo:session): session closed for user root Nov 06 17:59:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-488316ea-257e-49ea-982f-a45d69b42383 tempest-TestStampPattern-1009226522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d2b696d5-ed98-4c74-8324-5877f1541563.328f139e-aab6-434e-b8de-253760d763ee" returned: 0 in 0.404s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:59:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-488316ea-257e-49ea-982f-a45d69b42383 tempest-TestStampPattern-1009226522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d2b696d5-ed98-4c74-8324-5877f1541563.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:59:32 devstack sudo[102481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d2b696d5-ed98-4c74-8324-5877f1541563.info Nov 06 17:59:32 devstack sudo[102481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:59:32 devstack sudo[102481]: pam_unix(sudo:session): session closed for user root Nov 06 17:59:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-488316ea-257e-49ea-982f-a45d69b42383 tempest-TestStampPattern-1009226522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d2b696d5-ed98-4c74-8324-5877f1541563.info" returned: 0 in 0.379s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:59:32 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-488316ea-257e-49ea-982f-a45d69b42383 tempest-TestStampPattern-1009226522 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d2b696d5-ed98-4c74-8324-5877f1541563.info is being set with open permissions: ugo+rw Nov 06 17:59:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-488316ea-257e-49ea-982f-a45d69b42383 tempest-TestStampPattern-1009226522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d2b696d5-ed98-4c74-8324-5877f1541563.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:59:33 devstack sudo[102486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d2b696d5-ed98-4c74-8324-5877f1541563.info Nov 06 17:59:33 devstack sudo[102486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:59:33 devstack sudo[102486]: pam_unix(sudo:session): session closed for user root Nov 06 17:59:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-488316ea-257e-49ea-982f-a45d69b42383 tempest-TestStampPattern-1009226522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d2b696d5-ed98-4c74-8324-5877f1541563.info" returned: 0 in 0.325s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:59:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-488316ea-257e-49ea-982f-a45d69b42383 tempest-TestStampPattern-1009226522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.506s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:59:33 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-488316ea-257e-49ea-982f-a45d69b42383 tempest-TestStampPattern-1009226522 None] Create snapshot completed successfully Nov 06 17:59:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-65c03172-2f57-4dff-a9d3-bdea31df2456 req-f1f74ca5-1dd4-4c05-afa1-45e019326d88 tempest-TestServerVolumeAttachmentScenario-2030177302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:59:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-65c03172-2f57-4dff-a9d3-bdea31df2456 req-f1f74ca5-1dd4-4c05-afa1-45e019326d88 tempest-TestServerVolumeAttachmentScenario-2030177302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:59:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-65c03172-2f57-4dff-a9d3-bdea31df2456 req-f1f74ca5-1dd4-4c05-afa1-45e019326d88 tempest-TestServerVolumeAttachmentScenario-2030177302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:59:35 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-65c03172-2f57-4dff-a9d3-bdea31df2456 req-f1f74ca5-1dd4-4c05-afa1-45e019326d88 tempest-TestServerVolumeAttachmentScenario-2030177302 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072', 'name': 'volume-7023eb08-5967-48f3-b8f8-6c676447271b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fef808c6-4351-400a-b5ed-611a7a30685d', 'enforce_multipath': True} {{(pid=87068) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 17:59:35 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-65c03172-2f57-4dff-a9d3-bdea31df2456 req-f1f74ca5-1dd4-4c05-afa1-45e019326d88 tempest-TestServerVolumeAttachmentScenario-2030177302 None] attachment_update completed successfully. Nov 06 17:59:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-d0c5a35a-006e-4bb8-86e6-f293346dc3a5 req-48513f07-14f5-47df-a146-cdcaad3b4462 tempest-TestServerVolumeAttachmentScenario-2030177302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:59:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-d0c5a35a-006e-4bb8-86e6-f293346dc3a5 req-48513f07-14f5-47df-a146-cdcaad3b4462 tempest-TestServerVolumeAttachmentScenario-2030177302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:59:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-d0c5a35a-006e-4bb8-86e6-f293346dc3a5 req-48513f07-14f5-47df-a146-cdcaad3b4462 tempest-TestServerVolumeAttachmentScenario-2030177302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:59:40 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-d0c5a35a-006e-4bb8-86e6-f293346dc3a5 req-48513f07-14f5-47df-a146-cdcaad3b4462 tempest-TestServerVolumeAttachmentScenario-2030177302 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072', 'name': 'volume-db31610c-a5f3-4c7b-90f7-28a6306df7ce', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e5467aee-7a9b-4c29-9ad0-095eb118d737', 'enforce_multipath': True} {{(pid=87068) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 17:59:40 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-d0c5a35a-006e-4bb8-86e6-f293346dc3a5 req-48513f07-14f5-47df-a146-cdcaad3b4462 tempest-TestServerVolumeAttachmentScenario-2030177302 None] attachment_update completed successfully. Nov 06 17:59:43 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-64eb1bc6-7a35-4b2c-9c7e-e70618ff2b6d req-d6957c85-c253-4328-875c-a064ccb1d361 tempest-TestServerVolumeAttachmentScenario-2030177302 None] Terminate volume connection completed successfully. Nov 06 17:59:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-64eb1bc6-7a35-4b2c-9c7e-e70618ff2b6d req-d6957c85-c253-4328-875c-a064ccb1d361 tempest-TestServerVolumeAttachmentScenario-2030177302 None] Deleting attachment e5467aee-7a9b-4c29-9ad0-095eb118d737. {{(pid=87068) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 17:59:43 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef108a8c-64b9-4f2d-a296-3d7c5abe2154 tempest-TestStampPattern-1009226522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 17:59:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ef108a8c-64b9-4f2d-a296-3d7c5abe2154 tempest-TestStampPattern-1009226522 None] Flow 'volume_create_manager' (5fca4405-76f1-48dd-9e28-def33d5d994e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:59:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ef108a8c-64b9-4f2d-a296-3d7c5abe2154 tempest-TestStampPattern-1009226522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7d909e6-224e-42a2-9f67-0f0e50c531c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:59:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ef108a8c-64b9-4f2d-a296-3d7c5abe2154 tempest-TestStampPattern-1009226522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7d909e6-224e-42a2-9f67-0f0e50c531c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T16:59:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1775832392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ec18362-c853-4736-a380-ba7690ba3000,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0a3f5479a940fea7ae997e9a2596ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T16:59:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=328f139e-aab6-434e-b8de-253760d763ee,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T16:59:44Z,use_quota=True,user_id='9577f90e511d4042831ac65642630443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:59:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ef108a8c-64b9-4f2d-a296-3d7c5abe2154 tempest-TestStampPattern-1009226522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a64828df-6905-4b94-9dd4-54c4be5b72f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:59:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ef108a8c-64b9-4f2d-a296-3d7c5abe2154 tempest-TestStampPattern-1009226522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a64828df-6905-4b94-9dd4-54c4be5b72f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:59:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ef108a8c-64b9-4f2d-a296-3d7c5abe2154 tempest-TestStampPattern-1009226522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (883be187-fc28-4c4c-b54c-4e7e9e9a457d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:59:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ef108a8c-64b9-4f2d-a296-3d7c5abe2154 tempest-TestStampPattern-1009226522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (883be187-fc28-4c4c-b54c-4e7e9e9a457d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7ec18362-c853-4736-a380-ba7690ba3000', 'volume_name': 'volume-7ec18362-c853-4736-a380-ba7690ba3000', 'volume_size': 1, 'snapshot_id': '328f139e-aab6-434e-b8de-253760d763ee'}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:59:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ef108a8c-64b9-4f2d-a296-3d7c5abe2154 tempest-TestStampPattern-1009226522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abd439b5-7d61-4746-9141-cdda85602bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:59:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ef108a8c-64b9-4f2d-a296-3d7c5abe2154 tempest-TestStampPattern-1009226522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abd439b5-7d61-4746-9141-cdda85602bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:59:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ef108a8c-64b9-4f2d-a296-3d7c5abe2154 tempest-TestStampPattern-1009226522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bce75aca-037c-4957-9a5e-43bcf4ade0c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:59:43 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-ef108a8c-64b9-4f2d-a296-3d7c5abe2154 tempest-TestStampPattern-1009226522 None] Volume 7ec18362-c853-4736-a380-ba7690ba3000: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7ec18362-c853-4736-a380-ba7690ba3000', 'volume_size': 1, 'snapshot_id': '328f139e-aab6-434e-b8de-253760d763ee'} Nov 06 17:59:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ef108a8c-64b9-4f2d-a296-3d7c5abe2154 tempest-TestStampPattern-1009226522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:59:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ef108a8c-64b9-4f2d-a296-3d7c5abe2154 tempest-TestStampPattern-1009226522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:59:43 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ef108a8c-64b9-4f2d-a296-3d7c5abe2154 tempest-TestStampPattern-1009226522 None] Acquiring lock "cinder-quobyte-328f139e-aab6-434e-b8de-253760d763ee-7ec18362-c853-4736-a380-ba7690ba3000" by "_create_volume_from_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:59:43 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ef108a8c-64b9-4f2d-a296-3d7c5abe2154 tempest-TestStampPattern-1009226522 None] Lock "cinder-quobyte-328f139e-aab6-434e-b8de-253760d763ee-7ec18362-c853-4736-a380-ba7690ba3000" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:59:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ef108a8c-64b9-4f2d-a296-3d7c5abe2154 tempest-TestStampPattern-1009226522 None] Creating volume 7ec18362-c853-4736-a380-ba7690ba3000 from snapshot 328f139e-aab6-434e-b8de-253760d763ee {{(pid=87068) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 17:59:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ef108a8c-64b9-4f2d-a296-3d7c5abe2154 tempest-TestStampPattern-1009226522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:59:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ef108a8c-64b9-4f2d-a296-3d7c5abe2154 tempest-TestStampPattern-1009226522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:59:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ef108a8c-64b9-4f2d-a296-3d7c5abe2154 tempest-TestStampPattern-1009226522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:59:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ef108a8c-64b9-4f2d-a296-3d7c5abe2154 tempest-TestStampPattern-1009226522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:59:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ef108a8c-64b9-4f2d-a296-3d7c5abe2154 tempest-TestStampPattern-1009226522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:59:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ef108a8c-64b9-4f2d-a296-3d7c5abe2154 tempest-TestStampPattern-1009226522 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 17:59:43 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ef108a8c-64b9-4f2d-a296-3d7c5abe2154 tempest-TestStampPattern-1009226522 None] Acquiring lock "cinder-quobyte-7ec18362-c853-4736-a380-ba7690ba3000" by "_copy_volume_from_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:59:43 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ef108a8c-64b9-4f2d-a296-3d7c5abe2154 tempest-TestStampPattern-1009226522 None] Lock "cinder-quobyte-7ec18362-c853-4736-a380-ba7690ba3000" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:59:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ef108a8c-64b9-4f2d-a296-3d7c5abe2154 tempest-TestStampPattern-1009226522 None] snapshot: 328f139e-aab6-434e-b8de-253760d763ee, volume: 7ec18362-c853-4736-a380-ba7690ba3000, {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 17:59:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ef108a8c-64b9-4f2d-a296-3d7c5abe2154 tempest-TestStampPattern-1009226522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:59:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ef108a8c-64b9-4f2d-a296-3d7c5abe2154 tempest-TestStampPattern-1009226522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:59:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ef108a8c-64b9-4f2d-a296-3d7c5abe2154 tempest-TestStampPattern-1009226522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:59:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ef108a8c-64b9-4f2d-a296-3d7c5abe2154 tempest-TestStampPattern-1009226522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:59:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ef108a8c-64b9-4f2d-a296-3d7c5abe2154 tempest-TestStampPattern-1009226522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:59:43 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bcfdcf2-fe04-460c-ab85-d7304eeb2f37]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:59:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ef108a8c-64b9-4f2d-a296-3d7c5abe2154 tempest-TestStampPattern-1009226522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d2b696d5-ed98-4c74-8324-5877f1541563.328f139e-aab6-434e-b8de-253760d763ee {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:59:44 devstack sudo[102549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d2b696d5-ed98-4c74-8324-5877f1541563.328f139e-aab6-434e-b8de-253760d763ee Nov 06 17:59:44 devstack sudo[102549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:59:44 devstack sudo[102549]: pam_unix(sudo:session): session closed for user root Nov 06 17:59:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ef108a8c-64b9-4f2d-a296-3d7c5abe2154 tempest-TestStampPattern-1009226522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d2b696d5-ed98-4c74-8324-5877f1541563.328f139e-aab6-434e-b8de-253760d763ee" returned: 0 in 0.527s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:59:44 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-ef108a8c-64b9-4f2d-a296-3d7c5abe2154 tempest-TestStampPattern-1009226522 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2b696d5-ed98-4c74-8324-5877f1541563(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 17:59:44 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a780df67-518c-4941-b5fe-7f9f7e221bbd]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:59:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ef108a8c-64b9-4f2d-a296-3d7c5abe2154 tempest-TestStampPattern-1009226522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d2b696d5-ed98-4c74-8324-5877f1541563 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:59:44 devstack sudo[102554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d2b696d5-ed98-4c74-8324-5877f1541563 Nov 06 17:59:44 devstack sudo[102554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:59:45 devstack sudo[102554]: pam_unix(sudo:session): session closed for user root Nov 06 17:59:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ef108a8c-64b9-4f2d-a296-3d7c5abe2154 tempest-TestStampPattern-1009226522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d2b696d5-ed98-4c74-8324-5877f1541563" returned: 0 in 0.570s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:59:45 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ef108a8c-64b9-4f2d-a296-3d7c5abe2154 tempest-TestStampPattern-1009226522 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d2b696d5-ed98-4c74-8324-5877f1541563 {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 17:59:45 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ef108a8c-64b9-4f2d-a296-3d7c5abe2154 tempest-TestStampPattern-1009226522 None] Creating direct copy from snapshot {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 17:59:45 devstack cinder-volume[87068]: DEBUG cinder.utils [None req-ef108a8c-64b9-4f2d-a296-3d7c5abe2154 tempest-TestStampPattern-1009226522 None] Path /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7ec18362-c853-4736-a380-ba7690ba3000 not found in is_blk_device check {{(pid=87068) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 17:59:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ef108a8c-64b9-4f2d-a296-3d7c5abe2154 tempest-TestStampPattern-1009226522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d2b696d5-ed98-4c74-8324-5877f1541563 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7ec18362-c853-4736-a380-ba7690ba3000 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:59:45 devstack sudo[102564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d2b696d5-ed98-4c74-8324-5877f1541563 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7ec18362-c853-4736-a380-ba7690ba3000 Nov 06 17:59:45 devstack sudo[102564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:59:45 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-31e129ad-3083-4603-b1a0-d4bcbf205483 req-b3074f7b-8b1f-4355-98fa-76d682c5a4db tempest-TestServerVolumeAttachmentScenario-2030177302 None] Terminate volume connection completed successfully. Nov 06 17:59:45 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-31e129ad-3083-4603-b1a0-d4bcbf205483 req-b3074f7b-8b1f-4355-98fa-76d682c5a4db tempest-TestServerVolumeAttachmentScenario-2030177302 None] Deleting attachment fef808c6-4351-400a-b5ed-611a7a30685d. {{(pid=87068) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 17:59:54 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 17:59:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:59:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:59:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:59:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:59:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:59:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:59:54 devstack sudo[102679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:59:54 devstack sudo[102679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:59:55 devstack sudo[102679]: pam_unix(sudo:session): session closed for user root Nov 06 17:59:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.503s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:59:55 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:59:55 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running periodic task VolumeManager._thread_info {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 17:59:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] thread count: 28 {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 17:59:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] thread info: [<_MainThread(MainThread, started 133940619505792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 17:59:57 devstack sudo[102564]: pam_unix(sudo:session): session closed for user root Nov 06 17:59:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ef108a8c-64b9-4f2d-a296-3d7c5abe2154 tempest-TestStampPattern-1009226522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d2b696d5-ed98-4c74-8324-5877f1541563 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7ec18362-c853-4736-a380-ba7690ba3000" returned: 0 in 12.165s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:59:57 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-ef108a8c-64b9-4f2d-a296-3d7c5abe2154 tempest-TestStampPattern-1009226522 None] Image conversion details: src /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d2b696d5-ed98-4c74-8324-5877f1541563, size 1024.00 MB, duration 12.17 sec, destination /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7ec18362-c853-4736-a380-ba7690ba3000 {{(pid=87068) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 17:59:57 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-ef108a8c-64b9-4f2d-a296-3d7c5abe2154 tempest-TestStampPattern-1009226522 None] Converted 1024.00 MB image at 84.17 MB/s Nov 06 17:59:57 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-ef108a8c-64b9-4f2d-a296-3d7c5abe2154 tempest-TestStampPattern-1009226522 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7ec18362-c853-4736-a380-ba7690ba3000 is being set with open permissions: ugo+rw Nov 06 17:59:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ef108a8c-64b9-4f2d-a296-3d7c5abe2154 tempest-TestStampPattern-1009226522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7ec18362-c853-4736-a380-ba7690ba3000 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:59:57 devstack sudo[102723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7ec18362-c853-4736-a380-ba7690ba3000 Nov 06 17:59:57 devstack sudo[102723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:59:57 devstack sudo[102723]: pam_unix(sudo:session): session closed for user root Nov 06 17:59:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ef108a8c-64b9-4f2d-a296-3d7c5abe2154 tempest-TestStampPattern-1009226522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7ec18362-c853-4736-a380-ba7690ba3000" returned: 0 in 0.309s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:59:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ef108a8c-64b9-4f2d-a296-3d7c5abe2154 tempest-TestStampPattern-1009226522 None] Lock "cinder-quobyte-7ec18362-c853-4736-a380-ba7690ba3000" released by "_copy_volume_from_snapshot" :: held 13.704s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:59:57 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=47,cinder:UPDATE=13,cinder:INSERT=1,cinder:DELETE=2 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 17:59:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ef108a8c-64b9-4f2d-a296-3d7c5abe2154 tempest-TestStampPattern-1009226522 None] Lock "cinder-quobyte-328f139e-aab6-434e-b8de-253760d763ee-7ec18362-c853-4736-a380-ba7690ba3000" released by "_create_volume_from_snapshot" :: held 13.808s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:59:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ef108a8c-64b9-4f2d-a296-3d7c5abe2154 tempest-TestStampPattern-1009226522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.826s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:59:57 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=45,cinder:UPDATE=15,cinder:INSERT=2 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 17:59:57 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ef108a8c-64b9-4f2d-a296-3d7c5abe2154 tempest-TestStampPattern-1009226522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bce75aca-037c-4957-9a5e-43bcf4ade0c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ec18362-c853-4736-a380-ba7690ba3000', 'volume_size': 1, 'snapshot_id': '328f139e-aab6-434e-b8de-253760d763ee'}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:59:57 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ef108a8c-64b9-4f2d-a296-3d7c5abe2154 tempest-TestStampPattern-1009226522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deeadb26-d1c7-4b6a-911e-33d8b4d4f1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 17:59:57 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-ef108a8c-64b9-4f2d-a296-3d7c5abe2154 tempest-TestStampPattern-1009226522 None] Volume volume-7ec18362-c853-4736-a380-ba7690ba3000 (7ec18362-c853-4736-a380-ba7690ba3000): created successfully Nov 06 17:59:57 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ef108a8c-64b9-4f2d-a296-3d7c5abe2154 tempest-TestStampPattern-1009226522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deeadb26-d1c7-4b6a-911e-33d8b4d4f1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 17:59:57 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ef108a8c-64b9-4f2d-a296-3d7c5abe2154 tempest-TestStampPattern-1009226522 None] Flow 'volume_create_manager' (5fca4405-76f1-48dd-9e28-def33d5d994e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 17:59:57 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-ef108a8c-64b9-4f2d-a296-3d7c5abe2154 tempest-TestStampPattern-1009226522 None] Created volume successfully. Nov 06 17:59:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-7b105caf-9e44-44a4-acdb-19db5d24a96a tempest-TestServerVolumeAttachmentScenario-2030177302 None] Acquiring lock "cinder-db31610c-a5f3-4c7b-90f7-28a6306df7ce-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:59:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-7b105caf-9e44-44a4-acdb-19db5d24a96a tempest-TestServerVolumeAttachmentScenario-2030177302 None] Lock "cinder-db31610c-a5f3-4c7b-90f7-28a6306df7ce-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:59:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-7b105caf-9e44-44a4-acdb-19db5d24a96a tempest-TestServerVolumeAttachmentScenario-2030177302 None] Acquiring lock "cinder-quobyte-db31610c-a5f3-4c7b-90f7-28a6306df7ce" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:59:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-7b105caf-9e44-44a4-acdb-19db5d24a96a tempest-TestServerVolumeAttachmentScenario-2030177302 None] Lock "cinder-quobyte-db31610c-a5f3-4c7b-90f7-28a6306df7ce" acquired by "delete_volume" :: waited 0.021s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:59:57 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea57a28f-81c0-4745-96b6-3c53da2dc3d6]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:59:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7b105caf-9e44-44a4-acdb-19db5d24a96a tempest-TestServerVolumeAttachmentScenario-2030177302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-db31610c-a5f3-4c7b-90f7-28a6306df7ce {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:59:58 devstack sudo[102727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-db31610c-a5f3-4c7b-90f7-28a6306df7ce Nov 06 17:59:58 devstack sudo[102727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:59:58 devstack sudo[102727]: pam_unix(sudo:session): session closed for user root Nov 06 17:59:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7b105caf-9e44-44a4-acdb-19db5d24a96a tempest-TestServerVolumeAttachmentScenario-2030177302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-db31610c-a5f3-4c7b-90f7-28a6306df7ce" returned: 0 in 0.467s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:59:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7b105caf-9e44-44a4-acdb-19db5d24a96a tempest-TestServerVolumeAttachmentScenario-2030177302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-db31610c-a5f3-4c7b-90f7-28a6306df7ce {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:59:58 devstack sudo[102735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-db31610c-a5f3-4c7b-90f7-28a6306df7ce Nov 06 17:59:58 devstack sudo[102735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:59:58 devstack sudo[102735]: pam_unix(sudo:session): session closed for user root Nov 06 17:59:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7b105caf-9e44-44a4-acdb-19db5d24a96a tempest-TestServerVolumeAttachmentScenario-2030177302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-db31610c-a5f3-4c7b-90f7-28a6306df7ce" returned: 0 in 0.262s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:59:58 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-7b105caf-9e44-44a4-acdb-19db5d24a96a tempest-TestServerVolumeAttachmentScenario-2030177302 None] Lock "cinder-quobyte-db31610c-a5f3-4c7b-90f7-28a6306df7ce" released by "delete_volume" :: held 0.779s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:59:58 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-7b105caf-9e44-44a4-acdb-19db5d24a96a tempest-TestServerVolumeAttachmentScenario-2030177302 None] Created reservations ['eff47b65-28f2-44af-84be-45372b31fb04', '44b5761e-1422-40fe-8eca-34273105097f', '046387b9-ce03-4de1-8525-8e1fd40c83f2', '5f0e69d2-0dc9-442f-8c6b-b19e47e8b34c'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 17:59:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7b105caf-9e44-44a4-acdb-19db5d24a96a tempest-TestServerVolumeAttachmentScenario-2030177302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 17:59:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7b105caf-9e44-44a4-acdb-19db5d24a96a tempest-TestServerVolumeAttachmentScenario-2030177302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 17:59:58 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7b105caf-9e44-44a4-acdb-19db5d24a96a tempest-TestServerVolumeAttachmentScenario-2030177302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 17:59:58 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7b105caf-9e44-44a4-acdb-19db5d24a96a tempest-TestServerVolumeAttachmentScenario-2030177302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 17:59:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7b105caf-9e44-44a4-acdb-19db5d24a96a tempest-TestServerVolumeAttachmentScenario-2030177302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 17:59:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7b105caf-9e44-44a4-acdb-19db5d24a96a tempest-TestServerVolumeAttachmentScenario-2030177302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:59:58 devstack sudo[102738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 17:59:58 devstack sudo[102738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:59:59 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-0613536e-8b7e-427f-a3c8-602f9476234c tempest-TestServerVolumeAttachmentScenario-2030177302 None] Acquiring lock "cinder-7023eb08-5967-48f3-b8f8-6c676447271b-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:59:59 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-0613536e-8b7e-427f-a3c8-602f9476234c tempest-TestServerVolumeAttachmentScenario-2030177302 None] Lock "cinder-7023eb08-5967-48f3-b8f8-6c676447271b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:59:59 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-0613536e-8b7e-427f-a3c8-602f9476234c tempest-TestServerVolumeAttachmentScenario-2030177302 None] Acquiring lock "cinder-quobyte-7023eb08-5967-48f3-b8f8-6c676447271b" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 17:59:59 devstack sudo[102738]: pam_unix(sudo:session): session closed for user root Nov 06 17:59:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7b105caf-9e44-44a4-acdb-19db5d24a96a tempest-TestServerVolumeAttachmentScenario-2030177302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.280s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:59:59 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-7b105caf-9e44-44a4-acdb-19db5d24a96a tempest-TestServerVolumeAttachmentScenario-2030177302 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 17:59:59 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-7b105caf-9e44-44a4-acdb-19db5d24a96a tempest-TestServerVolumeAttachmentScenario-2030177302 None] Deleted volume successfully. Nov 06 17:59:59 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-0613536e-8b7e-427f-a3c8-602f9476234c tempest-TestServerVolumeAttachmentScenario-2030177302 None] Lock "cinder-quobyte-7023eb08-5967-48f3-b8f8-6c676447271b" acquired by "delete_volume" :: waited 0.024s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 17:59:59 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-7b105caf-9e44-44a4-acdb-19db5d24a96a tempest-TestServerVolumeAttachmentScenario-2030177302 None] Lock "cinder-db31610c-a5f3-4c7b-90f7-28a6306df7ce-delete_volume" released by "delete_volume" :: held 1.294s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:59:59 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3540e7-dfea-4087-bee1-ddc0276dc62b]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 17:59:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0613536e-8b7e-427f-a3c8-602f9476234c tempest-TestServerVolumeAttachmentScenario-2030177302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7023eb08-5967-48f3-b8f8-6c676447271b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:59:59 devstack sudo[102741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7023eb08-5967-48f3-b8f8-6c676447271b Nov 06 17:59:59 devstack sudo[102741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:59:59 devstack sudo[102741]: pam_unix(sudo:session): session closed for user root Nov 06 17:59:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0613536e-8b7e-427f-a3c8-602f9476234c tempest-TestServerVolumeAttachmentScenario-2030177302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7023eb08-5967-48f3-b8f8-6c676447271b" returned: 0 in 0.410s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:59:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0613536e-8b7e-427f-a3c8-602f9476234c tempest-TestServerVolumeAttachmentScenario-2030177302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7023eb08-5967-48f3-b8f8-6c676447271b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 17:59:59 devstack sudo[102747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7023eb08-5967-48f3-b8f8-6c676447271b Nov 06 17:59:59 devstack sudo[102747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 17:59:59 devstack sudo[102747]: pam_unix(sudo:session): session closed for user root Nov 06 17:59:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0613536e-8b7e-427f-a3c8-602f9476234c tempest-TestServerVolumeAttachmentScenario-2030177302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7023eb08-5967-48f3-b8f8-6c676447271b" returned: 0 in 0.301s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 17:59:59 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-0613536e-8b7e-427f-a3c8-602f9476234c tempest-TestServerVolumeAttachmentScenario-2030177302 None] Lock "cinder-quobyte-7023eb08-5967-48f3-b8f8-6c676447271b" released by "delete_volume" :: held 0.777s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 17:59:59 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-0613536e-8b7e-427f-a3c8-602f9476234c tempest-TestServerVolumeAttachmentScenario-2030177302 None] Created reservations ['c58fda21-2508-4d5b-ab9b-7619bad96763', '3e0419f6-3428-4efb-bc3f-ae35747b2434', 'dc51a4cc-38f3-4c73-b23c-d49d9074a8c0', 'b289566a-d2e4-443f-a4cd-76a9ef2cf2f7'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:00:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0613536e-8b7e-427f-a3c8-602f9476234c tempest-TestServerVolumeAttachmentScenario-2030177302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:00:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0613536e-8b7e-427f-a3c8-602f9476234c tempest-TestServerVolumeAttachmentScenario-2030177302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:00:00 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0613536e-8b7e-427f-a3c8-602f9476234c tempest-TestServerVolumeAttachmentScenario-2030177302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:00:00 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0613536e-8b7e-427f-a3c8-602f9476234c tempest-TestServerVolumeAttachmentScenario-2030177302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:00:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0613536e-8b7e-427f-a3c8-602f9476234c tempest-TestServerVolumeAttachmentScenario-2030177302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:00:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0613536e-8b7e-427f-a3c8-602f9476234c tempest-TestServerVolumeAttachmentScenario-2030177302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:00 devstack sudo[102750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:00:00 devstack sudo[102750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:00 devstack sudo[102750]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0613536e-8b7e-427f-a3c8-602f9476234c tempest-TestServerVolumeAttachmentScenario-2030177302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.335s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:00 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-0613536e-8b7e-427f-a3c8-602f9476234c tempest-TestServerVolumeAttachmentScenario-2030177302 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:00:00 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-0613536e-8b7e-427f-a3c8-602f9476234c tempest-TestServerVolumeAttachmentScenario-2030177302 None] Deleted volume successfully. Nov 06 18:00:00 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-0613536e-8b7e-427f-a3c8-602f9476234c tempest-TestServerVolumeAttachmentScenario-2030177302 None] Lock "cinder-7023eb08-5967-48f3-b8f8-6c676447271b-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:00:05 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-62e20e79-c180-4c59-ae85-8a4998d3002a req-dec5ea7a-6822-4d30-a757-1d294dbeb375 tempest-TestShelveInstance-897467448 None] Terminate volume connection completed successfully. Nov 06 18:00:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-62e20e79-c180-4c59-ae85-8a4998d3002a req-dec5ea7a-6822-4d30-a757-1d294dbeb375 tempest-TestShelveInstance-897467448 None] Deleting attachment c08add17-7b1b-46cc-9604-e6c0240c2b6d. {{(pid=87068) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 18:00:05 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-62e20e79-c180-4c59-ae85-8a4998d3002a req-272f1845-07de-4d1a-92c1-dd7add7e0e65 tempest-TestShelveInstance-897467448 None] Acquiring lock "cinder-cd08e637-308b-4596-9cbc-f569b9f1102a-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:00:05 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-62e20e79-c180-4c59-ae85-8a4998d3002a req-272f1845-07de-4d1a-92c1-dd7add7e0e65 tempest-TestShelveInstance-897467448 None] Lock "cinder-cd08e637-308b-4596-9cbc-f569b9f1102a-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:00:05 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-62e20e79-c180-4c59-ae85-8a4998d3002a req-272f1845-07de-4d1a-92c1-dd7add7e0e65 tempest-TestShelveInstance-897467448 None] Acquiring lock "cinder-quobyte-cd08e637-308b-4596-9cbc-f569b9f1102a" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:00:05 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-62e20e79-c180-4c59-ae85-8a4998d3002a req-272f1845-07de-4d1a-92c1-dd7add7e0e65 tempest-TestShelveInstance-897467448 None] Lock "cinder-quobyte-cd08e637-308b-4596-9cbc-f569b9f1102a" acquired by "delete_volume" :: waited 0.021s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:00:05 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e3181e-6993-4ff2-a022-a245fe4c742b]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:00:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-62e20e79-c180-4c59-ae85-8a4998d3002a req-272f1845-07de-4d1a-92c1-dd7add7e0e65 tempest-TestShelveInstance-897467448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-cd08e637-308b-4596-9cbc-f569b9f1102a {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:05 devstack sudo[102789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-cd08e637-308b-4596-9cbc-f569b9f1102a Nov 06 18:00:05 devstack sudo[102789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:06 devstack sudo[102789]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-62e20e79-c180-4c59-ae85-8a4998d3002a req-272f1845-07de-4d1a-92c1-dd7add7e0e65 tempest-TestShelveInstance-897467448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-cd08e637-308b-4596-9cbc-f569b9f1102a" returned: 0 in 0.557s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-62e20e79-c180-4c59-ae85-8a4998d3002a req-272f1845-07de-4d1a-92c1-dd7add7e0e65 tempest-TestShelveInstance-897467448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-cd08e637-308b-4596-9cbc-f569b9f1102a {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:06 devstack sudo[102795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-cd08e637-308b-4596-9cbc-f569b9f1102a Nov 06 18:00:06 devstack sudo[102795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:06 devstack sudo[102795]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-62e20e79-c180-4c59-ae85-8a4998d3002a req-272f1845-07de-4d1a-92c1-dd7add7e0e65 tempest-TestShelveInstance-897467448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-cd08e637-308b-4596-9cbc-f569b9f1102a" returned: 0 in 0.595s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:06 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-62e20e79-c180-4c59-ae85-8a4998d3002a req-272f1845-07de-4d1a-92c1-dd7add7e0e65 tempest-TestShelveInstance-897467448 None] Lock "cinder-quobyte-cd08e637-308b-4596-9cbc-f569b9f1102a" released by "delete_volume" :: held 1.222s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:00:06 devstack cinder-volume[87068]: DEBUG cinder.quota [req-62e20e79-c180-4c59-ae85-8a4998d3002a req-272f1845-07de-4d1a-92c1-dd7add7e0e65 tempest-TestShelveInstance-897467448 None] Created reservations ['f0205970-df8b-44d2-9c4a-e4852b20094a', '6c67e0a0-9651-4dbe-b863-e53e3ddcb8ed', '5e0f9c87-8b55-4534-9a88-ed98a7cd17c8', '3970caa9-6c38-46a9-9c01-71b8fb71ecdb'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:00:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-62e20e79-c180-4c59-ae85-8a4998d3002a req-272f1845-07de-4d1a-92c1-dd7add7e0e65 tempest-TestShelveInstance-897467448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:00:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-62e20e79-c180-4c59-ae85-8a4998d3002a req-272f1845-07de-4d1a-92c1-dd7add7e0e65 tempest-TestShelveInstance-897467448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:00:07 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [req-62e20e79-c180-4c59-ae85-8a4998d3002a req-272f1845-07de-4d1a-92c1-dd7add7e0e65 tempest-TestShelveInstance-897467448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:00:07 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [req-62e20e79-c180-4c59-ae85-8a4998d3002a req-272f1845-07de-4d1a-92c1-dd7add7e0e65 tempest-TestShelveInstance-897467448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:00:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-62e20e79-c180-4c59-ae85-8a4998d3002a req-272f1845-07de-4d1a-92c1-dd7add7e0e65 tempest-TestShelveInstance-897467448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:00:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-62e20e79-c180-4c59-ae85-8a4998d3002a req-272f1845-07de-4d1a-92c1-dd7add7e0e65 tempest-TestShelveInstance-897467448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:07 devstack sudo[102806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:00:07 devstack sudo[102806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:07 devstack sudo[102806]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-62e20e79-c180-4c59-ae85-8a4998d3002a req-272f1845-07de-4d1a-92c1-dd7add7e0e65 tempest-TestShelveInstance-897467448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.300s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:07 devstack cinder-volume[87068]: DEBUG cinder.manager [req-62e20e79-c180-4c59-ae85-8a4998d3002a req-272f1845-07de-4d1a-92c1-dd7add7e0e65 tempest-TestShelveInstance-897467448 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:00:07 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-62e20e79-c180-4c59-ae85-8a4998d3002a req-272f1845-07de-4d1a-92c1-dd7add7e0e65 tempest-TestShelveInstance-897467448 None] Deleted volume successfully. Nov 06 18:00:07 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-62e20e79-c180-4c59-ae85-8a4998d3002a req-272f1845-07de-4d1a-92c1-dd7add7e0e65 tempest-TestShelveInstance-897467448 None] Lock "cinder-cd08e637-308b-4596-9cbc-f569b9f1102a-delete_volume" released by "delete_volume" :: held 1.904s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:00:16 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-bff093e1-27ea-4659-8c85-c1d2d5abe849 req-175de922-84ba-45f3-ba04-c6498b4ca582 tempest-TestMinimumBasicScenario-544336845 None] Terminate volume connection completed successfully. Nov 06 18:00:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-bff093e1-27ea-4659-8c85-c1d2d5abe849 req-175de922-84ba-45f3-ba04-c6498b4ca582 tempest-TestMinimumBasicScenario-544336845 None] Deleting attachment ebf48da8-ddcd-4f65-bd82-ff275cde7bd7. {{(pid=87068) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 18:00:17 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9f22ff21-ff68-47ae-9e0f-df54b360e4d0 tempest-TestMinimumBasicScenario-544336845 None] Acquiring lock "cinder-48304553-d973-4f0a-beff-28acd6123396-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:00:17 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9f22ff21-ff68-47ae-9e0f-df54b360e4d0 tempest-TestMinimumBasicScenario-544336845 None] Lock "cinder-48304553-d973-4f0a-beff-28acd6123396-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:00:17 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9f22ff21-ff68-47ae-9e0f-df54b360e4d0 tempest-TestMinimumBasicScenario-544336845 None] Acquiring lock "cinder-quobyte-48304553-d973-4f0a-beff-28acd6123396" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:00:17 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9f22ff21-ff68-47ae-9e0f-df54b360e4d0 tempest-TestMinimumBasicScenario-544336845 None] Lock "cinder-quobyte-48304553-d973-4f0a-beff-28acd6123396" acquired by "delete_volume" :: waited 0.016s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:00:17 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8134d3-6933-4a2c-8b3c-dd6645018f1a]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:00:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9f22ff21-ff68-47ae-9e0f-df54b360e4d0 tempest-TestMinimumBasicScenario-544336845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-48304553-d973-4f0a-beff-28acd6123396 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:17 devstack sudo[102853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-48304553-d973-4f0a-beff-28acd6123396 Nov 06 18:00:17 devstack sudo[102853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:17 devstack sudo[102853]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9f22ff21-ff68-47ae-9e0f-df54b360e4d0 tempest-TestMinimumBasicScenario-544336845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-48304553-d973-4f0a-beff-28acd6123396" returned: 0 in 0.435s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9f22ff21-ff68-47ae-9e0f-df54b360e4d0 tempest-TestMinimumBasicScenario-544336845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-48304553-d973-4f0a-beff-28acd6123396 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:17 devstack sudo[102858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-48304553-d973-4f0a-beff-28acd6123396 Nov 06 18:00:17 devstack sudo[102858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:17 devstack sudo[102858]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9f22ff21-ff68-47ae-9e0f-df54b360e4d0 tempest-TestMinimumBasicScenario-544336845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-48304553-d973-4f0a-beff-28acd6123396" returned: 0 in 0.272s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:17 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9f22ff21-ff68-47ae-9e0f-df54b360e4d0 tempest-TestMinimumBasicScenario-544336845 None] Lock "cinder-quobyte-48304553-d973-4f0a-beff-28acd6123396" released by "delete_volume" :: held 0.756s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:00:18 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-9f22ff21-ff68-47ae-9e0f-df54b360e4d0 tempest-TestMinimumBasicScenario-544336845 None] Created reservations ['652bad56-52b9-4380-b5b0-0fb26066bc7e', 'c3c45020-b416-406b-a40e-2e403e238234', '73504799-53a1-4f01-b2d0-932e104ee0e4', '13d832bf-f5de-4372-bd25-f6bb7c69a3f6'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:00:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9f22ff21-ff68-47ae-9e0f-df54b360e4d0 tempest-TestMinimumBasicScenario-544336845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:00:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9f22ff21-ff68-47ae-9e0f-df54b360e4d0 tempest-TestMinimumBasicScenario-544336845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:00:18 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9f22ff21-ff68-47ae-9e0f-df54b360e4d0 tempest-TestMinimumBasicScenario-544336845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:00:18 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9f22ff21-ff68-47ae-9e0f-df54b360e4d0 tempest-TestMinimumBasicScenario-544336845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:00:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9f22ff21-ff68-47ae-9e0f-df54b360e4d0 tempest-TestMinimumBasicScenario-544336845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:00:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9f22ff21-ff68-47ae-9e0f-df54b360e4d0 tempest-TestMinimumBasicScenario-544336845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:18 devstack sudo[102861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:00:18 devstack sudo[102861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:18 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-3608199d-f3e6-4484-93dc-73ef6ddd0214 tempest-CreateVolumesFromSnapshotTest-608498869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:00:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3608199d-f3e6-4484-93dc-73ef6ddd0214 tempest-CreateVolumesFromSnapshotTest-608498869 None] Flow 'volume_create_manager' (dd52d2fe-df45-4e21-8817-22f83efae46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:00:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3608199d-f3e6-4484-93dc-73ef6ddd0214 tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62ebc994-7452-4532-82e7-3fb5a6579845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3608199d-f3e6-4484-93dc-73ef6ddd0214 tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62ebc994-7452-4532-82e7-3fb5a6579845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:00:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1991968575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=301ca1dc-13a0-41be-bd52-c2cb6c373f6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ab555299f1e41a0b9b90739292bf970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:00:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:00:18Z,use_quota=True,user_id='9ffa4494cb41428ea649d5ee7c7876ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:00:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3608199d-f3e6-4484-93dc-73ef6ddd0214 tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f92eee41-0424-4655-b802-c6ff3768d8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3608199d-f3e6-4484-93dc-73ef6ddd0214 tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f92eee41-0424-4655-b802-c6ff3768d8cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:00:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3608199d-f3e6-4484-93dc-73ef6ddd0214 tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5130425a-098a-407e-83a3-607f32e27c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3608199d-f3e6-4484-93dc-73ef6ddd0214 tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5130425a-098a-407e-83a3-607f32e27c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '301ca1dc-13a0-41be-bd52-c2cb6c373f6e', 'volume_name': 'volume-301ca1dc-13a0-41be-bd52-c2cb6c373f6e', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:00:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3608199d-f3e6-4484-93dc-73ef6ddd0214 tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0716d6e5-bc0f-4380-a8a5-5469dca2f775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3608199d-f3e6-4484-93dc-73ef6ddd0214 tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0716d6e5-bc0f-4380-a8a5-5469dca2f775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:00:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3608199d-f3e6-4484-93dc-73ef6ddd0214 tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46070898-500f-406b-9eea-55aa036263c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:18 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-3608199d-f3e6-4484-93dc-73ef6ddd0214 tempest-CreateVolumesFromSnapshotTest-608498869 None] Volume 301ca1dc-13a0-41be-bd52-c2cb6c373f6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-301ca1dc-13a0-41be-bd52-c2cb6c373f6e', 'volume_size': 1} Nov 06 18:00:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3608199d-f3e6-4484-93dc-73ef6ddd0214 tempest-CreateVolumesFromSnapshotTest-608498869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:00:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3608199d-f3e6-4484-93dc-73ef6ddd0214 tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:00:18 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3608199d-f3e6-4484-93dc-73ef6ddd0214 tempest-CreateVolumesFromSnapshotTest-608498869 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:00:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1991968575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=301ca1dc-13a0-41be-bd52-c2cb6c373f6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ab555299f1e41a0b9b90739292bf970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:00:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:00:18Z,use_quota=True,user_id='9ffa4494cb41428ea649d5ee7c7876ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:00:18 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-3608199d-f3e6-4484-93dc-73ef6ddd0214 tempest-CreateVolumesFromSnapshotTest-608498869 None] Creating volume 301ca1dc-13a0-41be-bd52-c2cb6c373f6e {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:00:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3608199d-f3e6-4484-93dc-73ef6ddd0214 tempest-CreateVolumesFromSnapshotTest-608498869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:00:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3608199d-f3e6-4484-93dc-73ef6ddd0214 tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:00:18 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3608199d-f3e6-4484-93dc-73ef6ddd0214 tempest-CreateVolumesFromSnapshotTest-608498869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:00:18 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3608199d-f3e6-4484-93dc-73ef6ddd0214 tempest-CreateVolumesFromSnapshotTest-608498869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:00:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3608199d-f3e6-4484-93dc-73ef6ddd0214 tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:00:18 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3608199d-f3e6-4484-93dc-73ef6ddd0214 tempest-CreateVolumesFromSnapshotTest-608498869 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:00:18 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-3608199d-f3e6-4484-93dc-73ef6ddd0214 tempest-CreateVolumesFromSnapshotTest-608498869 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:00:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3608199d-f3e6-4484-93dc-73ef6ddd0214 tempest-CreateVolumesFromSnapshotTest-608498869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-301ca1dc-13a0-41be-bd52-c2cb6c373f6e 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:18 devstack sudo[102863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-301ca1dc-13a0-41be-bd52-c2cb6c373f6e 1073741824 Nov 06 18:00:18 devstack sudo[102863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:18 devstack sudo[102861]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9f22ff21-ff68-47ae-9e0f-df54b360e4d0 tempest-TestMinimumBasicScenario-544336845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.342s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:18 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-9f22ff21-ff68-47ae-9e0f-df54b360e4d0 tempest-TestMinimumBasicScenario-544336845 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:00:18 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-9f22ff21-ff68-47ae-9e0f-df54b360e4d0 tempest-TestMinimumBasicScenario-544336845 None] Deleted volume successfully. Nov 06 18:00:18 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9f22ff21-ff68-47ae-9e0f-df54b360e4d0 tempest-TestMinimumBasicScenario-544336845 None] Lock "cinder-48304553-d973-4f0a-beff-28acd6123396-delete_volume" released by "delete_volume" :: held 1.398s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:00:19 devstack sudo[102863]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3608199d-f3e6-4484-93dc-73ef6ddd0214 tempest-CreateVolumesFromSnapshotTest-608498869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-301ca1dc-13a0-41be-bd52-c2cb6c373f6e 1073741824" returned: 0 in 0.850s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3608199d-f3e6-4484-93dc-73ef6ddd0214 tempest-CreateVolumesFromSnapshotTest-608498869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-301ca1dc-13a0-41be-bd52-c2cb6c373f6e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:19 devstack sudo[102887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-301ca1dc-13a0-41be-bd52-c2cb6c373f6e Nov 06 18:00:19 devstack sudo[102887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:19 devstack sudo[102887]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3608199d-f3e6-4484-93dc-73ef6ddd0214 tempest-CreateVolumesFromSnapshotTest-608498869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-301ca1dc-13a0-41be-bd52-c2cb6c373f6e" returned: 0 in 0.322s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:19 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3608199d-f3e6-4484-93dc-73ef6ddd0214 tempest-CreateVolumesFromSnapshotTest-608498869 None] <== create_volume: return (1229ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:00:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3608199d-f3e6-4484-93dc-73ef6ddd0214 tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.232s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:00:19 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3608199d-f3e6-4484-93dc-73ef6ddd0214 tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46070898-500f-406b-9eea-55aa036263c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-301ca1dc-13a0-41be-bd52-c2cb6c373f6e', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:00:19 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3608199d-f3e6-4484-93dc-73ef6ddd0214 tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faefe288-9ae8-4c7a-b8d2-b61927fb4c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:19 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-3608199d-f3e6-4484-93dc-73ef6ddd0214 tempest-CreateVolumesFromSnapshotTest-608498869 None] Volume volume-301ca1dc-13a0-41be-bd52-c2cb6c373f6e (301ca1dc-13a0-41be-bd52-c2cb6c373f6e): created successfully Nov 06 18:00:19 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3608199d-f3e6-4484-93dc-73ef6ddd0214 tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faefe288-9ae8-4c7a-b8d2-b61927fb4c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:00:19 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3608199d-f3e6-4484-93dc-73ef6ddd0214 tempest-CreateVolumesFromSnapshotTest-608498869 None] Flow 'volume_create_manager' (dd52d2fe-df45-4e21-8817-22f83efae46d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:00:19 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-3608199d-f3e6-4484-93dc-73ef6ddd0214 tempest-CreateVolumesFromSnapshotTest-608498869 None] Created volume successfully. Nov 06 18:00:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-83df5e41-4dc8-41ec-a567-0f7d9e6213e0 tempest-CreateVolumesFromSnapshotTest-608498869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:00:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-83df5e41-4dc8-41ec-a567-0f7d9e6213e0 tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:00:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-83df5e41-4dc8-41ec-a567-0f7d9e6213e0 tempest-CreateVolumesFromSnapshotTest-608498869 None] Creating offline snapshot 127f4ca0-960b-4169-b430-a46b34dff517 of volume 301ca1dc-13a0-41be-bd52-c2cb6c373f6e {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:00:20 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4a1d1a-71f1-4316-9e3e-cdab296dad40]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:00:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-83df5e41-4dc8-41ec-a567-0f7d9e6213e0 tempest-CreateVolumesFromSnapshotTest-608498869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-301ca1dc-13a0-41be-bd52-c2cb6c373f6e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:20 devstack sudo[102894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-301ca1dc-13a0-41be-bd52-c2cb6c373f6e Nov 06 18:00:20 devstack sudo[102894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:21 devstack sudo[102894]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-83df5e41-4dc8-41ec-a567-0f7d9e6213e0 tempest-CreateVolumesFromSnapshotTest-608498869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-301ca1dc-13a0-41be-bd52-c2cb6c373f6e" returned: 0 in 0.514s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-83df5e41-4dc8-41ec-a567-0f7d9e6213e0 tempest-CreateVolumesFromSnapshotTest-608498869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-301ca1dc-13a0-41be-bd52-c2cb6c373f6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-301ca1dc-13a0-41be-bd52-c2cb6c373f6e.127f4ca0-960b-4169-b430-a46b34dff517 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:21 devstack sudo[102902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-301ca1dc-13a0-41be-bd52-c2cb6c373f6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-301ca1dc-13a0-41be-bd52-c2cb6c373f6e.127f4ca0-960b-4169-b430-a46b34dff517 1G Nov 06 18:00:21 devstack sudo[102902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:21 devstack sudo[102902]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-83df5e41-4dc8-41ec-a567-0f7d9e6213e0 tempest-CreateVolumesFromSnapshotTest-608498869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-301ca1dc-13a0-41be-bd52-c2cb6c373f6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-301ca1dc-13a0-41be-bd52-c2cb6c373f6e.127f4ca0-960b-4169-b430-a46b34dff517 1G" returned: 0 in 0.572s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-83df5e41-4dc8-41ec-a567-0f7d9e6213e0 tempest-CreateVolumesFromSnapshotTest-608498869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-301ca1dc-13a0-41be-bd52-c2cb6c373f6e -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-301ca1dc-13a0-41be-bd52-c2cb6c373f6e.127f4ca0-960b-4169-b430-a46b34dff517 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:21 devstack sudo[102908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-301ca1dc-13a0-41be-bd52-c2cb6c373f6e -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-301ca1dc-13a0-41be-bd52-c2cb6c373f6e.127f4ca0-960b-4169-b430-a46b34dff517 Nov 06 18:00:21 devstack sudo[102908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:22 devstack sudo[102908]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-83df5e41-4dc8-41ec-a567-0f7d9e6213e0 tempest-CreateVolumesFromSnapshotTest-608498869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-301ca1dc-13a0-41be-bd52-c2cb6c373f6e -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-301ca1dc-13a0-41be-bd52-c2cb6c373f6e.127f4ca0-960b-4169-b430-a46b34dff517" returned: 0 in 0.430s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:22 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-83df5e41-4dc8-41ec-a567-0f7d9e6213e0 tempest-CreateVolumesFromSnapshotTest-608498869 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-301ca1dc-13a0-41be-bd52-c2cb6c373f6e.127f4ca0-960b-4169-b430-a46b34dff517 is being set with open permissions: ugo+rw Nov 06 18:00:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-83df5e41-4dc8-41ec-a567-0f7d9e6213e0 tempest-CreateVolumesFromSnapshotTest-608498869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-301ca1dc-13a0-41be-bd52-c2cb6c373f6e.127f4ca0-960b-4169-b430-a46b34dff517 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:22 devstack sudo[102913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-301ca1dc-13a0-41be-bd52-c2cb6c373f6e.127f4ca0-960b-4169-b430-a46b34dff517 Nov 06 18:00:22 devstack sudo[102913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:22 devstack sudo[102913]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-83df5e41-4dc8-41ec-a567-0f7d9e6213e0 tempest-CreateVolumesFromSnapshotTest-608498869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-301ca1dc-13a0-41be-bd52-c2cb6c373f6e.127f4ca0-960b-4169-b430-a46b34dff517" returned: 0 in 0.318s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-83df5e41-4dc8-41ec-a567-0f7d9e6213e0 tempest-CreateVolumesFromSnapshotTest-608498869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-301ca1dc-13a0-41be-bd52-c2cb6c373f6e.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:22 devstack sudo[102916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-301ca1dc-13a0-41be-bd52-c2cb6c373f6e.info Nov 06 18:00:22 devstack sudo[102916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:22 devstack sudo[102916]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-83df5e41-4dc8-41ec-a567-0f7d9e6213e0 tempest-CreateVolumesFromSnapshotTest-608498869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-301ca1dc-13a0-41be-bd52-c2cb6c373f6e.info" returned: 0 in 0.347s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:22 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-83df5e41-4dc8-41ec-a567-0f7d9e6213e0 tempest-CreateVolumesFromSnapshotTest-608498869 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-301ca1dc-13a0-41be-bd52-c2cb6c373f6e.info is being set with open permissions: ugo+rw Nov 06 18:00:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-83df5e41-4dc8-41ec-a567-0f7d9e6213e0 tempest-CreateVolumesFromSnapshotTest-608498869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-301ca1dc-13a0-41be-bd52-c2cb6c373f6e.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:22 devstack sudo[102919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-301ca1dc-13a0-41be-bd52-c2cb6c373f6e.info Nov 06 18:00:22 devstack sudo[102919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:23 devstack sudo[102919]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-83df5e41-4dc8-41ec-a567-0f7d9e6213e0 tempest-CreateVolumesFromSnapshotTest-608498869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-301ca1dc-13a0-41be-bd52-c2cb6c373f6e.info" returned: 0 in 0.341s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-83df5e41-4dc8-41ec-a567-0f7d9e6213e0 tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.661s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:00:23 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-83df5e41-4dc8-41ec-a567-0f7d9e6213e0 tempest-CreateVolumesFromSnapshotTest-608498869 None] Create snapshot completed successfully Nov 06 18:00:24 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a9b3be1-5c97-4cbc-9e1c-cdb40cfd5957 tempest-CreateVolumesFromSnapshotTest-608498869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:00:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1a9b3be1-5c97-4cbc-9e1c-cdb40cfd5957 tempest-CreateVolumesFromSnapshotTest-608498869 None] Flow 'volume_create_manager' (2e574b19-da4c-4f2e-b29d-69be2f735c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:00:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1a9b3be1-5c97-4cbc-9e1c-cdb40cfd5957 tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6609f02f-5d50-4a6c-8101-5eedffacb678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1a9b3be1-5c97-4cbc-9e1c-cdb40cfd5957 tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6609f02f-5d50-4a6c-8101-5eedffacb678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:00:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1214484617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d80f3ef9-bbb3-49c5-913e-40ff876b4d5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ab555299f1e41a0b9b90739292bf970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:00:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:00:24Z,use_quota=True,user_id='9ffa4494cb41428ea649d5ee7c7876ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:00:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1a9b3be1-5c97-4cbc-9e1c-cdb40cfd5957 tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2cca8b2-1fe9-43be-9ecf-0b32645e5c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1a9b3be1-5c97-4cbc-9e1c-cdb40cfd5957 tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2cca8b2-1fe9-43be-9ecf-0b32645e5c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:00:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1a9b3be1-5c97-4cbc-9e1c-cdb40cfd5957 tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f0184fd-f06a-473d-8682-365935ceb836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1a9b3be1-5c97-4cbc-9e1c-cdb40cfd5957 tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f0184fd-f06a-473d-8682-365935ceb836) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd80f3ef9-bbb3-49c5-913e-40ff876b4d5f', 'volume_name': 'volume-d80f3ef9-bbb3-49c5-913e-40ff876b4d5f', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:00:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1a9b3be1-5c97-4cbc-9e1c-cdb40cfd5957 tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88f22481-d1bc-4b17-8997-f18ab2c2c86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1a9b3be1-5c97-4cbc-9e1c-cdb40cfd5957 tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88f22481-d1bc-4b17-8997-f18ab2c2c86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:00:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1a9b3be1-5c97-4cbc-9e1c-cdb40cfd5957 tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (945c8d16-cd26-4d42-92af-2b7cff4e0ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:24 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-1a9b3be1-5c97-4cbc-9e1c-cdb40cfd5957 tempest-CreateVolumesFromSnapshotTest-608498869 None] Volume d80f3ef9-bbb3-49c5-913e-40ff876b4d5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d80f3ef9-bbb3-49c5-913e-40ff876b4d5f', 'volume_size': 1} Nov 06 18:00:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1a9b3be1-5c97-4cbc-9e1c-cdb40cfd5957 tempest-CreateVolumesFromSnapshotTest-608498869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:00:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1a9b3be1-5c97-4cbc-9e1c-cdb40cfd5957 tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:00:24 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1a9b3be1-5c97-4cbc-9e1c-cdb40cfd5957 tempest-CreateVolumesFromSnapshotTest-608498869 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:00:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1214484617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d80f3ef9-bbb3-49c5-913e-40ff876b4d5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ab555299f1e41a0b9b90739292bf970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:00:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:00:24Z,use_quota=True,user_id='9ffa4494cb41428ea649d5ee7c7876ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:00:24 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-1a9b3be1-5c97-4cbc-9e1c-cdb40cfd5957 tempest-CreateVolumesFromSnapshotTest-608498869 None] Creating volume d80f3ef9-bbb3-49c5-913e-40ff876b4d5f {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:00:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1a9b3be1-5c97-4cbc-9e1c-cdb40cfd5957 tempest-CreateVolumesFromSnapshotTest-608498869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:00:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1a9b3be1-5c97-4cbc-9e1c-cdb40cfd5957 tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:00:24 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1a9b3be1-5c97-4cbc-9e1c-cdb40cfd5957 tempest-CreateVolumesFromSnapshotTest-608498869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:00:24 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1a9b3be1-5c97-4cbc-9e1c-cdb40cfd5957 tempest-CreateVolumesFromSnapshotTest-608498869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:00:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1a9b3be1-5c97-4cbc-9e1c-cdb40cfd5957 tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:00:24 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1a9b3be1-5c97-4cbc-9e1c-cdb40cfd5957 tempest-CreateVolumesFromSnapshotTest-608498869 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:00:24 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-1a9b3be1-5c97-4cbc-9e1c-cdb40cfd5957 tempest-CreateVolumesFromSnapshotTest-608498869 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:00:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1a9b3be1-5c97-4cbc-9e1c-cdb40cfd5957 tempest-CreateVolumesFromSnapshotTest-608498869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d80f3ef9-bbb3-49c5-913e-40ff876b4d5f 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:24 devstack sudo[102923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d80f3ef9-bbb3-49c5-913e-40ff876b4d5f 1073741824 Nov 06 18:00:24 devstack sudo[102923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:25 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-32b93c6f-01b7-4c99-9f39-ae91647fbacf tempest-CreateVolumesFromSnapshotTest-608498869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:00:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-32b93c6f-01b7-4c99-9f39-ae91647fbacf tempest-CreateVolumesFromSnapshotTest-608498869 None] Flow 'volume_create_manager' (d6e5026e-11ad-4e3c-b4ed-3a8c361d6423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:00:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-32b93c6f-01b7-4c99-9f39-ae91647fbacf tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (512a10e2-fd4e-4245-9276-f07afb8cf193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-32b93c6f-01b7-4c99-9f39-ae91647fbacf tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (512a10e2-fd4e-4245-9276-f07afb8cf193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-301125928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6eda20a-8fdb-4161-9f89-36c9464db4e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ab555299f1e41a0b9b90739292bf970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:00:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:00:25Z,use_quota=True,user_id='9ffa4494cb41428ea649d5ee7c7876ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:00:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-32b93c6f-01b7-4c99-9f39-ae91647fbacf tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3dcc2c9-bd72-4a37-a82e-b2bed1356cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-32b93c6f-01b7-4c99-9f39-ae91647fbacf tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3dcc2c9-bd72-4a37-a82e-b2bed1356cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:00:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-32b93c6f-01b7-4c99-9f39-ae91647fbacf tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48e623e7-f3d7-4162-8e8b-9bbb3711db1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-32b93c6f-01b7-4c99-9f39-ae91647fbacf tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48e623e7-f3d7-4162-8e8b-9bbb3711db1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6eda20a-8fdb-4161-9f89-36c9464db4e4', 'volume_name': 'volume-d6eda20a-8fdb-4161-9f89-36c9464db4e4', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:00:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-32b93c6f-01b7-4c99-9f39-ae91647fbacf tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97d500a5-db98-49c8-8e95-a081440ab435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-32b93c6f-01b7-4c99-9f39-ae91647fbacf tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97d500a5-db98-49c8-8e95-a081440ab435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:00:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-32b93c6f-01b7-4c99-9f39-ae91647fbacf tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (944d74ea-426b-4c20-b4c8-d8760617ccd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:25 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-32b93c6f-01b7-4c99-9f39-ae91647fbacf tempest-CreateVolumesFromSnapshotTest-608498869 None] Volume d6eda20a-8fdb-4161-9f89-36c9464db4e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6eda20a-8fdb-4161-9f89-36c9464db4e4', 'volume_size': 1} Nov 06 18:00:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-32b93c6f-01b7-4c99-9f39-ae91647fbacf tempest-CreateVolumesFromSnapshotTest-608498869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:00:25 devstack sudo[102923]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1a9b3be1-5c97-4cbc-9e1c-cdb40cfd5957 tempest-CreateVolumesFromSnapshotTest-608498869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d80f3ef9-bbb3-49c5-913e-40ff876b4d5f 1073741824" returned: 0 in 0.812s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1a9b3be1-5c97-4cbc-9e1c-cdb40cfd5957 tempest-CreateVolumesFromSnapshotTest-608498869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d80f3ef9-bbb3-49c5-913e-40ff876b4d5f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:25 devstack sudo[102929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d80f3ef9-bbb3-49c5-913e-40ff876b4d5f Nov 06 18:00:25 devstack sudo[102929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:25 devstack sudo[102929]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1a9b3be1-5c97-4cbc-9e1c-cdb40cfd5957 tempest-CreateVolumesFromSnapshotTest-608498869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d80f3ef9-bbb3-49c5-913e-40ff876b4d5f" returned: 0 in 0.394s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:25 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1a9b3be1-5c97-4cbc-9e1c-cdb40cfd5957 tempest-CreateVolumesFromSnapshotTest-608498869 None] <== create_volume: return (1265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:00:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1a9b3be1-5c97-4cbc-9e1c-cdb40cfd5957 tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.268s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:00:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-32b93c6f-01b7-4c99-9f39-ae91647fbacf tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.567s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:00:25 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-32b93c6f-01b7-4c99-9f39-ae91647fbacf tempest-CreateVolumesFromSnapshotTest-608498869 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-301125928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6eda20a-8fdb-4161-9f89-36c9464db4e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ab555299f1e41a0b9b90739292bf970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:00:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:00:25Z,use_quota=True,user_id='9ffa4494cb41428ea649d5ee7c7876ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:00:25 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-32b93c6f-01b7-4c99-9f39-ae91647fbacf tempest-CreateVolumesFromSnapshotTest-608498869 None] Creating volume d6eda20a-8fdb-4161-9f89-36c9464db4e4 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:00:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-32b93c6f-01b7-4c99-9f39-ae91647fbacf tempest-CreateVolumesFromSnapshotTest-608498869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:00:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-32b93c6f-01b7-4c99-9f39-ae91647fbacf tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:00:25 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-32b93c6f-01b7-4c99-9f39-ae91647fbacf tempest-CreateVolumesFromSnapshotTest-608498869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:00:25 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-32b93c6f-01b7-4c99-9f39-ae91647fbacf tempest-CreateVolumesFromSnapshotTest-608498869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:00:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-32b93c6f-01b7-4c99-9f39-ae91647fbacf tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:00:25 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-32b93c6f-01b7-4c99-9f39-ae91647fbacf tempest-CreateVolumesFromSnapshotTest-608498869 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:00:25 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-32b93c6f-01b7-4c99-9f39-ae91647fbacf tempest-CreateVolumesFromSnapshotTest-608498869 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:00:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-32b93c6f-01b7-4c99-9f39-ae91647fbacf tempest-CreateVolumesFromSnapshotTest-608498869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d6eda20a-8fdb-4161-9f89-36c9464db4e4 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:25 devstack sudo[102932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d6eda20a-8fdb-4161-9f89-36c9464db4e4 1073741824 Nov 06 18:00:25 devstack sudo[102932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1a9b3be1-5c97-4cbc-9e1c-cdb40cfd5957 tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (945c8d16-cd26-4d42-92af-2b7cff4e0ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d80f3ef9-bbb3-49c5-913e-40ff876b4d5f', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:00:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1a9b3be1-5c97-4cbc-9e1c-cdb40cfd5957 tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a7e479f-4b3a-41f0-8c12-8e87d1094ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:25 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-fafe5ac7-037c-47d3-9555-08923e576854 tempest-CreateVolumesFromSnapshotTest-608498869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:00:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fafe5ac7-037c-47d3-9555-08923e576854 tempest-CreateVolumesFromSnapshotTest-608498869 None] Flow 'volume_create_manager' (4aa76519-b668-4247-9fa2-1f662c8df588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:00:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fafe5ac7-037c-47d3-9555-08923e576854 tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00a7d53d-2af5-4efb-bb89-16a8f0caff0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:25 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-1a9b3be1-5c97-4cbc-9e1c-cdb40cfd5957 tempest-CreateVolumesFromSnapshotTest-608498869 None] Volume volume-d80f3ef9-bbb3-49c5-913e-40ff876b4d5f (d80f3ef9-bbb3-49c5-913e-40ff876b4d5f): created successfully Nov 06 18:00:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1a9b3be1-5c97-4cbc-9e1c-cdb40cfd5957 tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a7e479f-4b3a-41f0-8c12-8e87d1094ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:00:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1a9b3be1-5c97-4cbc-9e1c-cdb40cfd5957 tempest-CreateVolumesFromSnapshotTest-608498869 None] Flow 'volume_create_manager' (2e574b19-da4c-4f2e-b29d-69be2f735c95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:00:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fafe5ac7-037c-47d3-9555-08923e576854 tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00a7d53d-2af5-4efb-bb89-16a8f0caff0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1467650737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4acf537-5494-45b8-a75a-69cc55fb6fb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ab555299f1e41a0b9b90739292bf970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:00:26Z,use_quota=True,user_id='9ffa4494cb41428ea649d5ee7c7876ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:00:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fafe5ac7-037c-47d3-9555-08923e576854 tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01c9734d-2686-4aff-bf90-2de89e0d211a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fafe5ac7-037c-47d3-9555-08923e576854 tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01c9734d-2686-4aff-bf90-2de89e0d211a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:00:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fafe5ac7-037c-47d3-9555-08923e576854 tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04bd1d46-5308-4be9-b5af-f1a3a864653f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fafe5ac7-037c-47d3-9555-08923e576854 tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04bd1d46-5308-4be9-b5af-f1a3a864653f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4acf537-5494-45b8-a75a-69cc55fb6fb3', 'volume_name': 'volume-c4acf537-5494-45b8-a75a-69cc55fb6fb3', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:00:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fafe5ac7-037c-47d3-9555-08923e576854 tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a531de48-e5a4-45a5-ab73-80efd144f4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fafe5ac7-037c-47d3-9555-08923e576854 tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a531de48-e5a4-45a5-ab73-80efd144f4cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:00:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fafe5ac7-037c-47d3-9555-08923e576854 tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4125a96-049a-4581-ba6a-6359dc1ef615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:26 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-fafe5ac7-037c-47d3-9555-08923e576854 tempest-CreateVolumesFromSnapshotTest-608498869 None] Volume c4acf537-5494-45b8-a75a-69cc55fb6fb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4acf537-5494-45b8-a75a-69cc55fb6fb3', 'volume_size': 1} Nov 06 18:00:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fafe5ac7-037c-47d3-9555-08923e576854 tempest-CreateVolumesFromSnapshotTest-608498869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:00:26 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-1a9b3be1-5c97-4cbc-9e1c-cdb40cfd5957 tempest-CreateVolumesFromSnapshotTest-608498869 None] Created volume successfully. Nov 06 18:00:26 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-895354b9-9874-45d2-b49c-a2d66306c723 tempest-CreateVolumesFromSnapshotTest-608498869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:00:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-895354b9-9874-45d2-b49c-a2d66306c723 tempest-CreateVolumesFromSnapshotTest-608498869 None] Flow 'volume_create_manager' (3f11e386-7ffc-499a-a323-2029b3d6a333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:00:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-895354b9-9874-45d2-b49c-a2d66306c723 tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ec512ba-63f8-4b04-b4d3-6261bf3a1766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-895354b9-9874-45d2-b49c-a2d66306c723 tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ec512ba-63f8-4b04-b4d3-6261bf3a1766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:00:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1102516482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cae1ca4-57b7-4e81-82c5-05ff85d8a078,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ab555299f1e41a0b9b90739292bf970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:00:26Z,use_quota=True,user_id='9ffa4494cb41428ea649d5ee7c7876ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:00:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-895354b9-9874-45d2-b49c-a2d66306c723 tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71720dbb-45f6-4634-b686-8016503b2817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-895354b9-9874-45d2-b49c-a2d66306c723 tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71720dbb-45f6-4634-b686-8016503b2817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:00:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-895354b9-9874-45d2-b49c-a2d66306c723 tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a17fa0d3-f8e0-46e7-937f-56266d8a7c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-895354b9-9874-45d2-b49c-a2d66306c723 tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a17fa0d3-f8e0-46e7-937f-56266d8a7c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cae1ca4-57b7-4e81-82c5-05ff85d8a078', 'volume_name': 'volume-7cae1ca4-57b7-4e81-82c5-05ff85d8a078', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:00:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-895354b9-9874-45d2-b49c-a2d66306c723 tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85c709c9-9e90-4088-a2ae-747093e6f8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-895354b9-9874-45d2-b49c-a2d66306c723 tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85c709c9-9e90-4088-a2ae-747093e6f8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:00:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-895354b9-9874-45d2-b49c-a2d66306c723 tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cb0e38f-5c5e-4b99-8ebc-9940150719e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:26 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-895354b9-9874-45d2-b49c-a2d66306c723 tempest-CreateVolumesFromSnapshotTest-608498869 None] Volume 7cae1ca4-57b7-4e81-82c5-05ff85d8a078: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cae1ca4-57b7-4e81-82c5-05ff85d8a078', 'volume_size': 1} Nov 06 18:00:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-895354b9-9874-45d2-b49c-a2d66306c723 tempest-CreateVolumesFromSnapshotTest-608498869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:00:26 devstack sudo[102932]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-32b93c6f-01b7-4c99-9f39-ae91647fbacf tempest-CreateVolumesFromSnapshotTest-608498869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d6eda20a-8fdb-4161-9f89-36c9464db4e4 1073741824" returned: 0 in 0.704s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-32b93c6f-01b7-4c99-9f39-ae91647fbacf tempest-CreateVolumesFromSnapshotTest-608498869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d6eda20a-8fdb-4161-9f89-36c9464db4e4 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:26 devstack sudo[102938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d6eda20a-8fdb-4161-9f89-36c9464db4e4 Nov 06 18:00:26 devstack sudo[102938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:26 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b5f259a-34fb-408f-82e4-6892eefcb012 tempest-CreateVolumesFromSnapshotTest-608498869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:00:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6b5f259a-34fb-408f-82e4-6892eefcb012 tempest-CreateVolumesFromSnapshotTest-608498869 None] Flow 'volume_create_manager' (3e449250-7a1b-4523-bc22-9c8755c1f343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:00:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6b5f259a-34fb-408f-82e4-6892eefcb012 tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c16ecb54-65c8-4bf7-9f59-0023a1674a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6b5f259a-34fb-408f-82e4-6892eefcb012 tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c16ecb54-65c8-4bf7-9f59-0023a1674a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:00:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1924308967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3f0b9c7-634f-4eb2-9d0b-df0d663d275f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ab555299f1e41a0b9b90739292bf970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:00:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:00:27Z,use_quota=True,user_id='9ffa4494cb41428ea649d5ee7c7876ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:00:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6b5f259a-34fb-408f-82e4-6892eefcb012 tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2b3580b-6f85-4fc0-b93e-eefb32427e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6b5f259a-34fb-408f-82e4-6892eefcb012 tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2b3580b-6f85-4fc0-b93e-eefb32427e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:00:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6b5f259a-34fb-408f-82e4-6892eefcb012 tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1da9c7bb-5856-42a9-aa6f-49aa29f34fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6b5f259a-34fb-408f-82e4-6892eefcb012 tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1da9c7bb-5856-42a9-aa6f-49aa29f34fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3f0b9c7-634f-4eb2-9d0b-df0d663d275f', 'volume_name': 'volume-d3f0b9c7-634f-4eb2-9d0b-df0d663d275f', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:00:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6b5f259a-34fb-408f-82e4-6892eefcb012 tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cd89d0f-2870-40d6-bc09-67fca41c0f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6b5f259a-34fb-408f-82e4-6892eefcb012 tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cd89d0f-2870-40d6-bc09-67fca41c0f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:00:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6b5f259a-34fb-408f-82e4-6892eefcb012 tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61eda764-3df5-41ad-878f-7eac3ef23b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:27 devstack sudo[102938]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:27 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-6b5f259a-34fb-408f-82e4-6892eefcb012 tempest-CreateVolumesFromSnapshotTest-608498869 None] Volume d3f0b9c7-634f-4eb2-9d0b-df0d663d275f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3f0b9c7-634f-4eb2-9d0b-df0d663d275f', 'volume_size': 1} Nov 06 18:00:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6b5f259a-34fb-408f-82e4-6892eefcb012 tempest-CreateVolumesFromSnapshotTest-608498869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:00:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-32b93c6f-01b7-4c99-9f39-ae91647fbacf tempest-CreateVolumesFromSnapshotTest-608498869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d6eda20a-8fdb-4161-9f89-36c9464db4e4" returned: 0 in 0.480s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-32b93c6f-01b7-4c99-9f39-ae91647fbacf tempest-CreateVolumesFromSnapshotTest-608498869 None] <== create_volume: return (1274ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:00:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-32b93c6f-01b7-4c99-9f39-ae91647fbacf tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.278s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:00:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fafe5ac7-037c-47d3-9555-08923e576854 tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.075s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:00:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fafe5ac7-037c-47d3-9555-08923e576854 tempest-CreateVolumesFromSnapshotTest-608498869 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1467650737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4acf537-5494-45b8-a75a-69cc55fb6fb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ab555299f1e41a0b9b90739292bf970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:00:26Z,use_quota=True,user_id='9ffa4494cb41428ea649d5ee7c7876ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:00:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-fafe5ac7-037c-47d3-9555-08923e576854 tempest-CreateVolumesFromSnapshotTest-608498869 None] Creating volume c4acf537-5494-45b8-a75a-69cc55fb6fb3 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:00:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fafe5ac7-037c-47d3-9555-08923e576854 tempest-CreateVolumesFromSnapshotTest-608498869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:00:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fafe5ac7-037c-47d3-9555-08923e576854 tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:00:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fafe5ac7-037c-47d3-9555-08923e576854 tempest-CreateVolumesFromSnapshotTest-608498869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:00:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fafe5ac7-037c-47d3-9555-08923e576854 tempest-CreateVolumesFromSnapshotTest-608498869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:00:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fafe5ac7-037c-47d3-9555-08923e576854 tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:00:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fafe5ac7-037c-47d3-9555-08923e576854 tempest-CreateVolumesFromSnapshotTest-608498869 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:00:27 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-fafe5ac7-037c-47d3-9555-08923e576854 tempest-CreateVolumesFromSnapshotTest-608498869 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:00:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fafe5ac7-037c-47d3-9555-08923e576854 tempest-CreateVolumesFromSnapshotTest-608498869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c4acf537-5494-45b8-a75a-69cc55fb6fb3 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-32b93c6f-01b7-4c99-9f39-ae91647fbacf tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (944d74ea-426b-4c20-b4c8-d8760617ccd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6eda20a-8fdb-4161-9f89-36c9464db4e4', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:00:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-32b93c6f-01b7-4c99-9f39-ae91647fbacf tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c997fa66-bacb-4b03-8934-847ea32c9b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:27 devstack sudo[102941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c4acf537-5494-45b8-a75a-69cc55fb6fb3 1073741824 Nov 06 18:00:27 devstack sudo[102941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:27 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-32b93c6f-01b7-4c99-9f39-ae91647fbacf tempest-CreateVolumesFromSnapshotTest-608498869 None] Volume volume-d6eda20a-8fdb-4161-9f89-36c9464db4e4 (d6eda20a-8fdb-4161-9f89-36c9464db4e4): created successfully Nov 06 18:00:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-32b93c6f-01b7-4c99-9f39-ae91647fbacf tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c997fa66-bacb-4b03-8934-847ea32c9b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:00:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-32b93c6f-01b7-4c99-9f39-ae91647fbacf tempest-CreateVolumesFromSnapshotTest-608498869 None] Flow 'volume_create_manager' (d6e5026e-11ad-4e3c-b4ed-3a8c361d6423) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:00:27 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-32b93c6f-01b7-4c99-9f39-ae91647fbacf tempest-CreateVolumesFromSnapshotTest-608498869 None] Created volume successfully. Nov 06 18:00:27 devstack sudo[102941]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fafe5ac7-037c-47d3-9555-08923e576854 tempest-CreateVolumesFromSnapshotTest-608498869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c4acf537-5494-45b8-a75a-69cc55fb6fb3 1073741824" returned: 0 in 0.516s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fafe5ac7-037c-47d3-9555-08923e576854 tempest-CreateVolumesFromSnapshotTest-608498869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c4acf537-5494-45b8-a75a-69cc55fb6fb3 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:27 devstack sudo[102947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c4acf537-5494-45b8-a75a-69cc55fb6fb3 Nov 06 18:00:27 devstack sudo[102947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:28 devstack sudo[102947]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fafe5ac7-037c-47d3-9555-08923e576854 tempest-CreateVolumesFromSnapshotTest-608498869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c4acf537-5494-45b8-a75a-69cc55fb6fb3" returned: 0 in 0.341s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fafe5ac7-037c-47d3-9555-08923e576854 tempest-CreateVolumesFromSnapshotTest-608498869 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:00:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fafe5ac7-037c-47d3-9555-08923e576854 tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:00:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-895354b9-9874-45d2-b49c-a2d66306c723 tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.623s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:00:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-895354b9-9874-45d2-b49c-a2d66306c723 tempest-CreateVolumesFromSnapshotTest-608498869 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:00:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1102516482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cae1ca4-57b7-4e81-82c5-05ff85d8a078,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ab555299f1e41a0b9b90739292bf970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:00:26Z,use_quota=True,user_id='9ffa4494cb41428ea649d5ee7c7876ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:00:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-895354b9-9874-45d2-b49c-a2d66306c723 tempest-CreateVolumesFromSnapshotTest-608498869 None] Creating volume 7cae1ca4-57b7-4e81-82c5-05ff85d8a078 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:00:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-895354b9-9874-45d2-b49c-a2d66306c723 tempest-CreateVolumesFromSnapshotTest-608498869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:00:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-895354b9-9874-45d2-b49c-a2d66306c723 tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:00:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-895354b9-9874-45d2-b49c-a2d66306c723 tempest-CreateVolumesFromSnapshotTest-608498869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:00:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-895354b9-9874-45d2-b49c-a2d66306c723 tempest-CreateVolumesFromSnapshotTest-608498869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:00:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-895354b9-9874-45d2-b49c-a2d66306c723 tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:00:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-895354b9-9874-45d2-b49c-a2d66306c723 tempest-CreateVolumesFromSnapshotTest-608498869 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:00:28 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-895354b9-9874-45d2-b49c-a2d66306c723 tempest-CreateVolumesFromSnapshotTest-608498869 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:00:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-895354b9-9874-45d2-b49c-a2d66306c723 tempest-CreateVolumesFromSnapshotTest-608498869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7cae1ca4-57b7-4e81-82c5-05ff85d8a078 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fafe5ac7-037c-47d3-9555-08923e576854 tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4125a96-049a-4581-ba6a-6359dc1ef615) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4acf537-5494-45b8-a75a-69cc55fb6fb3', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:00:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fafe5ac7-037c-47d3-9555-08923e576854 tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5199cc79-c26a-4a70-ab3e-5d0cb9109fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:28 devstack sudo[102955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7cae1ca4-57b7-4e81-82c5-05ff85d8a078 1073741824 Nov 06 18:00:28 devstack sudo[102955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:28 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-fafe5ac7-037c-47d3-9555-08923e576854 tempest-CreateVolumesFromSnapshotTest-608498869 None] Volume volume-c4acf537-5494-45b8-a75a-69cc55fb6fb3 (c4acf537-5494-45b8-a75a-69cc55fb6fb3): created successfully Nov 06 18:00:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fafe5ac7-037c-47d3-9555-08923e576854 tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5199cc79-c26a-4a70-ab3e-5d0cb9109fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:00:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fafe5ac7-037c-47d3-9555-08923e576854 tempest-CreateVolumesFromSnapshotTest-608498869 None] Flow 'volume_create_manager' (4aa76519-b668-4247-9fa2-1f662c8df588) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:00:28 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-fafe5ac7-037c-47d3-9555-08923e576854 tempest-CreateVolumesFromSnapshotTest-608498869 None] Created volume successfully. Nov 06 18:00:28 devstack sudo[102955]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-895354b9-9874-45d2-b49c-a2d66306c723 tempest-CreateVolumesFromSnapshotTest-608498869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7cae1ca4-57b7-4e81-82c5-05ff85d8a078 1073741824" returned: 0 in 0.651s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-895354b9-9874-45d2-b49c-a2d66306c723 tempest-CreateVolumesFromSnapshotTest-608498869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7cae1ca4-57b7-4e81-82c5-05ff85d8a078 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:28 devstack sudo[102964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7cae1ca4-57b7-4e81-82c5-05ff85d8a078 Nov 06 18:00:28 devstack sudo[102964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:29 devstack sudo[102964]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-895354b9-9874-45d2-b49c-a2d66306c723 tempest-CreateVolumesFromSnapshotTest-608498869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7cae1ca4-57b7-4e81-82c5-05ff85d8a078" returned: 0 in 0.351s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:29 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-895354b9-9874-45d2-b49c-a2d66306c723 tempest-CreateVolumesFromSnapshotTest-608498869 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:00:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-895354b9-9874-45d2-b49c-a2d66306c723 tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:00:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6b5f259a-34fb-408f-82e4-6892eefcb012 tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.038s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:00:29 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-6b5f259a-34fb-408f-82e4-6892eefcb012 tempest-CreateVolumesFromSnapshotTest-608498869 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:00:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1924308967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3f0b9c7-634f-4eb2-9d0b-df0d663d275f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ab555299f1e41a0b9b90739292bf970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:00:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:00:27Z,use_quota=True,user_id='9ffa4494cb41428ea649d5ee7c7876ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:00:29 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-6b5f259a-34fb-408f-82e4-6892eefcb012 tempest-CreateVolumesFromSnapshotTest-608498869 None] Creating volume d3f0b9c7-634f-4eb2-9d0b-df0d663d275f {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:00:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6b5f259a-34fb-408f-82e4-6892eefcb012 tempest-CreateVolumesFromSnapshotTest-608498869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:00:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6b5f259a-34fb-408f-82e4-6892eefcb012 tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:00:29 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-6b5f259a-34fb-408f-82e4-6892eefcb012 tempest-CreateVolumesFromSnapshotTest-608498869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:00:29 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-6b5f259a-34fb-408f-82e4-6892eefcb012 tempest-CreateVolumesFromSnapshotTest-608498869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:00:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6b5f259a-34fb-408f-82e4-6892eefcb012 tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:00:29 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-6b5f259a-34fb-408f-82e4-6892eefcb012 tempest-CreateVolumesFromSnapshotTest-608498869 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:00:29 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-6b5f259a-34fb-408f-82e4-6892eefcb012 tempest-CreateVolumesFromSnapshotTest-608498869 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:00:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6b5f259a-34fb-408f-82e4-6892eefcb012 tempest-CreateVolumesFromSnapshotTest-608498869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d3f0b9c7-634f-4eb2-9d0b-df0d663d275f 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-895354b9-9874-45d2-b49c-a2d66306c723 tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cb0e38f-5c5e-4b99-8ebc-9940150719e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cae1ca4-57b7-4e81-82c5-05ff85d8a078', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:00:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-895354b9-9874-45d2-b49c-a2d66306c723 tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (756fecdf-dba2-4125-b40a-e9c0163b6284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:29 devstack sudo[102975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d3f0b9c7-634f-4eb2-9d0b-df0d663d275f 1073741824 Nov 06 18:00:29 devstack sudo[102975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:29 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-895354b9-9874-45d2-b49c-a2d66306c723 tempest-CreateVolumesFromSnapshotTest-608498869 None] Volume volume-7cae1ca4-57b7-4e81-82c5-05ff85d8a078 (7cae1ca4-57b7-4e81-82c5-05ff85d8a078): created successfully Nov 06 18:00:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-895354b9-9874-45d2-b49c-a2d66306c723 tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (756fecdf-dba2-4125-b40a-e9c0163b6284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:00:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-895354b9-9874-45d2-b49c-a2d66306c723 tempest-CreateVolumesFromSnapshotTest-608498869 None] Flow 'volume_create_manager' (3f11e386-7ffc-499a-a323-2029b3d6a333) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:00:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-91fac835-2637-48f1-8703-8109c505bd58 req-05bdfbcc-dc96-48c3-ba58-ef9e1c1b3839 tempest-TestStampPattern-1009226522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:00:29 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-895354b9-9874-45d2-b49c-a2d66306c723 tempest-CreateVolumesFromSnapshotTest-608498869 None] Created volume successfully. Nov 06 18:00:29 devstack sudo[102975]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6b5f259a-34fb-408f-82e4-6892eefcb012 tempest-CreateVolumesFromSnapshotTest-608498869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d3f0b9c7-634f-4eb2-9d0b-df0d663d275f 1073741824" returned: 0 in 0.538s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6b5f259a-34fb-408f-82e4-6892eefcb012 tempest-CreateVolumesFromSnapshotTest-608498869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d3f0b9c7-634f-4eb2-9d0b-df0d663d275f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:29 devstack sudo[102981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d3f0b9c7-634f-4eb2-9d0b-df0d663d275f Nov 06 18:00:29 devstack sudo[102981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:30 devstack sudo[102981]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6b5f259a-34fb-408f-82e4-6892eefcb012 tempest-CreateVolumesFromSnapshotTest-608498869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d3f0b9c7-634f-4eb2-9d0b-df0d663d275f" returned: 0 in 0.284s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-6b5f259a-34fb-408f-82e4-6892eefcb012 tempest-CreateVolumesFromSnapshotTest-608498869 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:00:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6b5f259a-34fb-408f-82e4-6892eefcb012 tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:00:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-91fac835-2637-48f1-8703-8109c505bd58 req-05bdfbcc-dc96-48c3-ba58-ef9e1c1b3839 tempest-TestStampPattern-1009226522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.757s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:00:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6b5f259a-34fb-408f-82e4-6892eefcb012 tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61eda764-3df5-41ad-878f-7eac3ef23b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3f0b9c7-634f-4eb2-9d0b-df0d663d275f', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:00:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6b5f259a-34fb-408f-82e4-6892eefcb012 tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (956c8458-ad95-4c71-a5c2-d4144f87cdd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-91fac835-2637-48f1-8703-8109c505bd58 req-05bdfbcc-dc96-48c3-ba58-ef9e1c1b3839 tempest-TestStampPattern-1009226522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:00:30 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-6b5f259a-34fb-408f-82e4-6892eefcb012 tempest-CreateVolumesFromSnapshotTest-608498869 None] Volume volume-d3f0b9c7-634f-4eb2-9d0b-df0d663d275f (d3f0b9c7-634f-4eb2-9d0b-df0d663d275f): created successfully Nov 06 18:00:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6b5f259a-34fb-408f-82e4-6892eefcb012 tempest-CreateVolumesFromSnapshotTest-608498869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (956c8458-ad95-4c71-a5c2-d4144f87cdd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:00:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6b5f259a-34fb-408f-82e4-6892eefcb012 tempest-CreateVolumesFromSnapshotTest-608498869 None] Flow 'volume_create_manager' (3e449250-7a1b-4523-bc22-9c8755c1f343) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:00:30 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-6b5f259a-34fb-408f-82e4-6892eefcb012 tempest-CreateVolumesFromSnapshotTest-608498869 None] Created volume successfully. Nov 06 18:00:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-91fac835-2637-48f1-8703-8109c505bd58 req-05bdfbcc-dc96-48c3-ba58-ef9e1c1b3839 tempest-TestStampPattern-1009226522 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072', 'name': 'volume-7ec18362-c853-4736-a380-ba7690ba3000', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e5fbd221-c574-4c88-b0cd-17535e58bf1f', 'enforce_multipath': True} {{(pid=87068) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 18:00:30 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-91fac835-2637-48f1-8703-8109c505bd58 req-05bdfbcc-dc96-48c3-ba58-ef9e1c1b3839 tempest-TestStampPattern-1009226522 None] attachment_update completed successfully. Nov 06 18:00:30 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d0358faf-53ca-429d-a75e-d2226a246f14 tempest-CreateVolumesFromSnapshotTest-608498869 None] Acquiring lock "cinder-d3f0b9c7-634f-4eb2-9d0b-df0d663d275f-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:00:30 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d0358faf-53ca-429d-a75e-d2226a246f14 tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "cinder-d3f0b9c7-634f-4eb2-9d0b-df0d663d275f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:00:30 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d0358faf-53ca-429d-a75e-d2226a246f14 tempest-CreateVolumesFromSnapshotTest-608498869 None] Acquiring lock "cinder-quobyte-d3f0b9c7-634f-4eb2-9d0b-df0d663d275f" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:00:30 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d0358faf-53ca-429d-a75e-d2226a246f14 tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "cinder-quobyte-d3f0b9c7-634f-4eb2-9d0b-df0d663d275f" acquired by "delete_volume" :: waited 0.021s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:00:30 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4b2823-e109-4a4c-8bc7-aa82f216cde0]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:00:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d0358faf-53ca-429d-a75e-d2226a246f14 tempest-CreateVolumesFromSnapshotTest-608498869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d3f0b9c7-634f-4eb2-9d0b-df0d663d275f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:30 devstack sudo[103043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d3f0b9c7-634f-4eb2-9d0b-df0d663d275f Nov 06 18:00:30 devstack sudo[103043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:31 devstack sudo[103043]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d0358faf-53ca-429d-a75e-d2226a246f14 tempest-CreateVolumesFromSnapshotTest-608498869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d3f0b9c7-634f-4eb2-9d0b-df0d663d275f" returned: 0 in 0.548s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d0358faf-53ca-429d-a75e-d2226a246f14 tempest-CreateVolumesFromSnapshotTest-608498869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d3f0b9c7-634f-4eb2-9d0b-df0d663d275f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:31 devstack sudo[103408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d3f0b9c7-634f-4eb2-9d0b-df0d663d275f Nov 06 18:00:31 devstack sudo[103408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:31 devstack sudo[103408]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d0358faf-53ca-429d-a75e-d2226a246f14 tempest-CreateVolumesFromSnapshotTest-608498869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d3f0b9c7-634f-4eb2-9d0b-df0d663d275f" returned: 0 in 0.381s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:31 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d0358faf-53ca-429d-a75e-d2226a246f14 tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "cinder-quobyte-d3f0b9c7-634f-4eb2-9d0b-df0d663d275f" released by "delete_volume" :: held 1.018s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:00:31 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-d0358faf-53ca-429d-a75e-d2226a246f14 tempest-CreateVolumesFromSnapshotTest-608498869 None] Created reservations ['86f5509e-6ff3-4039-a0e6-635e8c93e867', 'a29e33b5-635d-413b-b672-abd62a65c4c4', '78571ce4-49ed-409d-b96e-5351fb281875', 'f659ec56-40e1-484f-b10c-b487576f1e1b'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:00:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d0358faf-53ca-429d-a75e-d2226a246f14 tempest-CreateVolumesFromSnapshotTest-608498869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:00:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d0358faf-53ca-429d-a75e-d2226a246f14 tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:00:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d0358faf-53ca-429d-a75e-d2226a246f14 tempest-CreateVolumesFromSnapshotTest-608498869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:00:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d0358faf-53ca-429d-a75e-d2226a246f14 tempest-CreateVolumesFromSnapshotTest-608498869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:00:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d0358faf-53ca-429d-a75e-d2226a246f14 tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:00:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d0358faf-53ca-429d-a75e-d2226a246f14 tempest-CreateVolumesFromSnapshotTest-608498869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:31 devstack sudo[103411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:00:31 devstack sudo[103411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:31 devstack sudo[103411]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d0358faf-53ca-429d-a75e-d2226a246f14 tempest-CreateVolumesFromSnapshotTest-608498869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.288s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:31 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-d0358faf-53ca-429d-a75e-d2226a246f14 tempest-CreateVolumesFromSnapshotTest-608498869 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:00:31 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-d0358faf-53ca-429d-a75e-d2226a246f14 tempest-CreateVolumesFromSnapshotTest-608498869 None] Deleted volume successfully. Nov 06 18:00:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d0358faf-53ca-429d-a75e-d2226a246f14 tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "cinder-d3f0b9c7-634f-4eb2-9d0b-df0d663d275f-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:00:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-14ed6170-e79d-436d-a4e8-ecd6c0a5c7f9 tempest-CreateVolumesFromSnapshotTest-608498869 None] Acquiring lock "cinder-7cae1ca4-57b7-4e81-82c5-05ff85d8a078-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:00:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-14ed6170-e79d-436d-a4e8-ecd6c0a5c7f9 tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "cinder-7cae1ca4-57b7-4e81-82c5-05ff85d8a078-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:00:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-14ed6170-e79d-436d-a4e8-ecd6c0a5c7f9 tempest-CreateVolumesFromSnapshotTest-608498869 None] Acquiring lock "cinder-quobyte-7cae1ca4-57b7-4e81-82c5-05ff85d8a078" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:00:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-14ed6170-e79d-436d-a4e8-ecd6c0a5c7f9 tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "cinder-quobyte-7cae1ca4-57b7-4e81-82c5-05ff85d8a078" acquired by "delete_volume" :: waited 0.017s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:00:32 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b31819-0c9a-4c85-bcd0-67a48a040d51]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:00:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-14ed6170-e79d-436d-a4e8-ecd6c0a5c7f9 tempest-CreateVolumesFromSnapshotTest-608498869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7cae1ca4-57b7-4e81-82c5-05ff85d8a078 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:33 devstack sudo[103430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7cae1ca4-57b7-4e81-82c5-05ff85d8a078 Nov 06 18:00:33 devstack sudo[103430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:33 devstack sudo[103430]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-14ed6170-e79d-436d-a4e8-ecd6c0a5c7f9 tempest-CreateVolumesFromSnapshotTest-608498869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7cae1ca4-57b7-4e81-82c5-05ff85d8a078" returned: 0 in 0.529s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-14ed6170-e79d-436d-a4e8-ecd6c0a5c7f9 tempest-CreateVolumesFromSnapshotTest-608498869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7cae1ca4-57b7-4e81-82c5-05ff85d8a078 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:33 devstack sudo[103435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7cae1ca4-57b7-4e81-82c5-05ff85d8a078 Nov 06 18:00:33 devstack sudo[103435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:33 devstack sudo[103435]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-14ed6170-e79d-436d-a4e8-ecd6c0a5c7f9 tempest-CreateVolumesFromSnapshotTest-608498869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7cae1ca4-57b7-4e81-82c5-05ff85d8a078" returned: 0 in 0.325s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:33 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-14ed6170-e79d-436d-a4e8-ecd6c0a5c7f9 tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "cinder-quobyte-7cae1ca4-57b7-4e81-82c5-05ff85d8a078" released by "delete_volume" :: held 0.934s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:00:33 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-14ed6170-e79d-436d-a4e8-ecd6c0a5c7f9 tempest-CreateVolumesFromSnapshotTest-608498869 None] Created reservations ['2062a67c-cec0-4cbb-9e84-ae9bd737d6ca', '05afaf23-3dae-4d16-9b3a-a1d7cfbb3b7e', 'de18f4f8-da5b-4225-8adc-472d34de3c7c', '08c7d33c-6345-4401-867f-78c036576c9b'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:00:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-14ed6170-e79d-436d-a4e8-ecd6c0a5c7f9 tempest-CreateVolumesFromSnapshotTest-608498869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:00:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-14ed6170-e79d-436d-a4e8-ecd6c0a5c7f9 tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:00:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-14ed6170-e79d-436d-a4e8-ecd6c0a5c7f9 tempest-CreateVolumesFromSnapshotTest-608498869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:00:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-14ed6170-e79d-436d-a4e8-ecd6c0a5c7f9 tempest-CreateVolumesFromSnapshotTest-608498869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:00:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-14ed6170-e79d-436d-a4e8-ecd6c0a5c7f9 tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:00:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-14ed6170-e79d-436d-a4e8-ecd6c0a5c7f9 tempest-CreateVolumesFromSnapshotTest-608498869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:34 devstack sudo[103440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:00:34 devstack sudo[103440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:34 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-ee036b48-700e-4232-8e08-080f803f6664 req-3a0e016c-d14e-4374-b0c9-034e792ee4fb tempest-TestStampPattern-1009226522 None] Terminate volume connection completed successfully. Nov 06 18:00:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-ee036b48-700e-4232-8e08-080f803f6664 req-3a0e016c-d14e-4374-b0c9-034e792ee4fb tempest-TestStampPattern-1009226522 None] Deleting attachment e5fbd221-c574-4c88-b0cd-17535e58bf1f. {{(pid=87068) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 18:00:34 devstack sudo[103440]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-14ed6170-e79d-436d-a4e8-ecd6c0a5c7f9 tempest-CreateVolumesFromSnapshotTest-608498869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.306s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:34 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-14ed6170-e79d-436d-a4e8-ecd6c0a5c7f9 tempest-CreateVolumesFromSnapshotTest-608498869 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:00:34 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-14ed6170-e79d-436d-a4e8-ecd6c0a5c7f9 tempest-CreateVolumesFromSnapshotTest-608498869 None] Deleted volume successfully. Nov 06 18:00:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-14ed6170-e79d-436d-a4e8-ecd6c0a5c7f9 tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "cinder-7cae1ca4-57b7-4e81-82c5-05ff85d8a078-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:00:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-dbabbb8c-47e4-4614-906a-24cf83a0ea53 tempest-CreateVolumesFromSnapshotTest-608498869 None] Acquiring lock "cinder-c4acf537-5494-45b8-a75a-69cc55fb6fb3-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:00:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-dbabbb8c-47e4-4614-906a-24cf83a0ea53 tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "cinder-c4acf537-5494-45b8-a75a-69cc55fb6fb3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:00:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-dbabbb8c-47e4-4614-906a-24cf83a0ea53 tempest-CreateVolumesFromSnapshotTest-608498869 None] Acquiring lock "cinder-quobyte-c4acf537-5494-45b8-a75a-69cc55fb6fb3" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:00:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-dbabbb8c-47e4-4614-906a-24cf83a0ea53 tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "cinder-quobyte-c4acf537-5494-45b8-a75a-69cc55fb6fb3" acquired by "delete_volume" :: waited 0.039s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:00:35 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e01b5b-443e-49e5-ae80-8f798a59dc50]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:00:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-dbabbb8c-47e4-4614-906a-24cf83a0ea53 tempest-CreateVolumesFromSnapshotTest-608498869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c4acf537-5494-45b8-a75a-69cc55fb6fb3 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:35 devstack sudo[103468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c4acf537-5494-45b8-a75a-69cc55fb6fb3 Nov 06 18:00:35 devstack sudo[103468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:35 devstack sudo[103468]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-dbabbb8c-47e4-4614-906a-24cf83a0ea53 tempest-CreateVolumesFromSnapshotTest-608498869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c4acf537-5494-45b8-a75a-69cc55fb6fb3" returned: 0 in 0.480s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-dbabbb8c-47e4-4614-906a-24cf83a0ea53 tempest-CreateVolumesFromSnapshotTest-608498869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c4acf537-5494-45b8-a75a-69cc55fb6fb3 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:35 devstack sudo[103473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c4acf537-5494-45b8-a75a-69cc55fb6fb3 Nov 06 18:00:35 devstack sudo[103473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:35 devstack sudo[103473]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-dbabbb8c-47e4-4614-906a-24cf83a0ea53 tempest-CreateVolumesFromSnapshotTest-608498869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c4acf537-5494-45b8-a75a-69cc55fb6fb3" returned: 0 in 0.318s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-dbabbb8c-47e4-4614-906a-24cf83a0ea53 tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "cinder-quobyte-c4acf537-5494-45b8-a75a-69cc55fb6fb3" released by "delete_volume" :: held 0.859s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:00:36 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-dbabbb8c-47e4-4614-906a-24cf83a0ea53 tempest-CreateVolumesFromSnapshotTest-608498869 None] Created reservations ['a9cade03-891e-4bf4-8157-99203fa77e34', '25a09ccb-bb11-4e53-a515-5fc3d960293e', 'aa26182c-0898-4389-ad5c-060e7b675435', '8e251b84-640c-47a6-82ef-435577c14914'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:00:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-dbabbb8c-47e4-4614-906a-24cf83a0ea53 tempest-CreateVolumesFromSnapshotTest-608498869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:00:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-dbabbb8c-47e4-4614-906a-24cf83a0ea53 tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:00:36 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-dbabbb8c-47e4-4614-906a-24cf83a0ea53 tempest-CreateVolumesFromSnapshotTest-608498869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:00:36 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-dbabbb8c-47e4-4614-906a-24cf83a0ea53 tempest-CreateVolumesFromSnapshotTest-608498869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:00:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-dbabbb8c-47e4-4614-906a-24cf83a0ea53 tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:00:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-dbabbb8c-47e4-4614-906a-24cf83a0ea53 tempest-CreateVolumesFromSnapshotTest-608498869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:36 devstack sudo[103477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:00:36 devstack sudo[103477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:36 devstack sudo[103477]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-dbabbb8c-47e4-4614-906a-24cf83a0ea53 tempest-CreateVolumesFromSnapshotTest-608498869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.371s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:36 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-dbabbb8c-47e4-4614-906a-24cf83a0ea53 tempest-CreateVolumesFromSnapshotTest-608498869 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:00:36 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-dbabbb8c-47e4-4614-906a-24cf83a0ea53 tempest-CreateVolumesFromSnapshotTest-608498869 None] Deleted volume successfully. Nov 06 18:00:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-dbabbb8c-47e4-4614-906a-24cf83a0ea53 tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "cinder-c4acf537-5494-45b8-a75a-69cc55fb6fb3-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:00:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e9e072cc-47f5-4951-83da-49bff3f1f073 tempest-CreateVolumesFromSnapshotTest-608498869 None] Acquiring lock "cinder-d6eda20a-8fdb-4161-9f89-36c9464db4e4-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:00:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e9e072cc-47f5-4951-83da-49bff3f1f073 tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "cinder-d6eda20a-8fdb-4161-9f89-36c9464db4e4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:00:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e9e072cc-47f5-4951-83da-49bff3f1f073 tempest-CreateVolumesFromSnapshotTest-608498869 None] Acquiring lock "cinder-quobyte-d6eda20a-8fdb-4161-9f89-36c9464db4e4" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:00:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e9e072cc-47f5-4951-83da-49bff3f1f073 tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "cinder-quobyte-d6eda20a-8fdb-4161-9f89-36c9464db4e4" acquired by "delete_volume" :: waited 0.019s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:00:37 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[04254fb9-7dad-4589-9b9b-324e396bf723]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:00:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e9e072cc-47f5-4951-83da-49bff3f1f073 tempest-CreateVolumesFromSnapshotTest-608498869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d6eda20a-8fdb-4161-9f89-36c9464db4e4 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:37 devstack sudo[103480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d6eda20a-8fdb-4161-9f89-36c9464db4e4 Nov 06 18:00:37 devstack sudo[103480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:37 devstack sudo[103480]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e9e072cc-47f5-4951-83da-49bff3f1f073 tempest-CreateVolumesFromSnapshotTest-608498869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d6eda20a-8fdb-4161-9f89-36c9464db4e4" returned: 0 in 0.456s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e9e072cc-47f5-4951-83da-49bff3f1f073 tempest-CreateVolumesFromSnapshotTest-608498869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d6eda20a-8fdb-4161-9f89-36c9464db4e4 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:38 devstack sudo[103487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d6eda20a-8fdb-4161-9f89-36c9464db4e4 Nov 06 18:00:38 devstack sudo[103487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:38 devstack sudo[103487]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e9e072cc-47f5-4951-83da-49bff3f1f073 tempest-CreateVolumesFromSnapshotTest-608498869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d6eda20a-8fdb-4161-9f89-36c9464db4e4" returned: 0 in 0.404s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:38 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e9e072cc-47f5-4951-83da-49bff3f1f073 tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "cinder-quobyte-d6eda20a-8fdb-4161-9f89-36c9464db4e4" released by "delete_volume" :: held 0.942s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:00:38 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-e9e072cc-47f5-4951-83da-49bff3f1f073 tempest-CreateVolumesFromSnapshotTest-608498869 None] Created reservations ['bc9c7c07-461b-4027-9007-1107a5087dcc', '34573960-d509-4af3-8dbe-4c2ae3071329', '2f554bea-6987-4c5e-8f7c-aa14ad6e5fce', 'ebb6b0e2-761d-4c44-8651-9e0943c16dc7'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:00:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e9e072cc-47f5-4951-83da-49bff3f1f073 tempest-CreateVolumesFromSnapshotTest-608498869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:00:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e9e072cc-47f5-4951-83da-49bff3f1f073 tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:00:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e9e072cc-47f5-4951-83da-49bff3f1f073 tempest-CreateVolumesFromSnapshotTest-608498869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:00:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e9e072cc-47f5-4951-83da-49bff3f1f073 tempest-CreateVolumesFromSnapshotTest-608498869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:00:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e9e072cc-47f5-4951-83da-49bff3f1f073 tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:00:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e9e072cc-47f5-4951-83da-49bff3f1f073 tempest-CreateVolumesFromSnapshotTest-608498869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:38 devstack sudo[103494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:00:38 devstack sudo[103494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:39 devstack sudo[103494]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e9e072cc-47f5-4951-83da-49bff3f1f073 tempest-CreateVolumesFromSnapshotTest-608498869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.546s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:39 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-e9e072cc-47f5-4951-83da-49bff3f1f073 tempest-CreateVolumesFromSnapshotTest-608498869 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:00:39 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-e9e072cc-47f5-4951-83da-49bff3f1f073 tempest-CreateVolumesFromSnapshotTest-608498869 None] Deleted volume successfully. Nov 06 18:00:39 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e9e072cc-47f5-4951-83da-49bff3f1f073 tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "cinder-d6eda20a-8fdb-4161-9f89-36c9464db4e4-delete_volume" released by "delete_volume" :: held 1.872s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:00:39 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-be23ce13-7874-4f09-b345-3bc4ed0145f8 tempest-CreateVolumesFromSnapshotTest-608498869 None] Acquiring lock "cinder-d80f3ef9-bbb3-49c5-913e-40ff876b4d5f-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:00:39 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-be23ce13-7874-4f09-b345-3bc4ed0145f8 tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "cinder-d80f3ef9-bbb3-49c5-913e-40ff876b4d5f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:00:39 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-be23ce13-7874-4f09-b345-3bc4ed0145f8 tempest-CreateVolumesFromSnapshotTest-608498869 None] Acquiring lock "cinder-quobyte-d80f3ef9-bbb3-49c5-913e-40ff876b4d5f" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:00:39 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-be23ce13-7874-4f09-b345-3bc4ed0145f8 tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "cinder-quobyte-d80f3ef9-bbb3-49c5-913e-40ff876b4d5f" acquired by "delete_volume" :: waited 0.020s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:00:39 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f967b35a-83a5-4230-844b-9879601b81b7]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:00:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-be23ce13-7874-4f09-b345-3bc4ed0145f8 tempest-CreateVolumesFromSnapshotTest-608498869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d80f3ef9-bbb3-49c5-913e-40ff876b4d5f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:40 devstack sudo[103517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d80f3ef9-bbb3-49c5-913e-40ff876b4d5f Nov 06 18:00:40 devstack sudo[103517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:40 devstack sudo[103517]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-be23ce13-7874-4f09-b345-3bc4ed0145f8 tempest-CreateVolumesFromSnapshotTest-608498869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d80f3ef9-bbb3-49c5-913e-40ff876b4d5f" returned: 0 in 0.487s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-be23ce13-7874-4f09-b345-3bc4ed0145f8 tempest-CreateVolumesFromSnapshotTest-608498869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d80f3ef9-bbb3-49c5-913e-40ff876b4d5f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:40 devstack sudo[103523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d80f3ef9-bbb3-49c5-913e-40ff876b4d5f Nov 06 18:00:40 devstack sudo[103523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:40 devstack sudo[103523]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-be23ce13-7874-4f09-b345-3bc4ed0145f8 tempest-CreateVolumesFromSnapshotTest-608498869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d80f3ef9-bbb3-49c5-913e-40ff876b4d5f" returned: 0 in 0.329s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-be23ce13-7874-4f09-b345-3bc4ed0145f8 tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "cinder-quobyte-d80f3ef9-bbb3-49c5-913e-40ff876b4d5f" released by "delete_volume" :: held 0.875s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:00:40 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-be23ce13-7874-4f09-b345-3bc4ed0145f8 tempest-CreateVolumesFromSnapshotTest-608498869 None] Created reservations ['a8847d5d-9848-49b3-b747-456c640c2373', '37be1ae5-27a8-457e-87b3-62a673160d2e', '8df0c206-b762-4c30-825e-83c20309fd2c', 'b9e0e267-2393-43e8-92e6-784362d8fcdd'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:00:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-be23ce13-7874-4f09-b345-3bc4ed0145f8 tempest-CreateVolumesFromSnapshotTest-608498869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:00:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-be23ce13-7874-4f09-b345-3bc4ed0145f8 tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:00:40 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-be23ce13-7874-4f09-b345-3bc4ed0145f8 tempest-CreateVolumesFromSnapshotTest-608498869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:00:40 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-be23ce13-7874-4f09-b345-3bc4ed0145f8 tempest-CreateVolumesFromSnapshotTest-608498869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:00:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-be23ce13-7874-4f09-b345-3bc4ed0145f8 tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:00:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-be23ce13-7874-4f09-b345-3bc4ed0145f8 tempest-CreateVolumesFromSnapshotTest-608498869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:40 devstack sudo[103528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:00:40 devstack sudo[103528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1a170b2b-daef-4d5c-b552-53c6a953fcbb tempest-CreateVolumesFromSnapshotTest-608498869 None] Acquiring lock "cinder-127f4ca0-960b-4169-b430-a46b34dff517-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:00:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1a170b2b-daef-4d5c-b552-53c6a953fcbb tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "cinder-127f4ca0-960b-4169-b430-a46b34dff517-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:00:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1a170b2b-daef-4d5c-b552-53c6a953fcbb tempest-CreateVolumesFromSnapshotTest-608498869 None] Acquiring lock "cinder-quobyte-301ca1dc-13a0-41be-bd52-c2cb6c373f6e" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:00:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1a170b2b-daef-4d5c-b552-53c6a953fcbb tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "cinder-quobyte-301ca1dc-13a0-41be-bd52-c2cb6c373f6e" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:00:41 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1a170b2b-daef-4d5c-b552-53c6a953fcbb tempest-CreateVolumesFromSnapshotTest-608498869 None] Acquiring lock "cinder-quobyte-127f4ca0-960b-4169-b430-a46b34dff517" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:00:41 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1a170b2b-daef-4d5c-b552-53c6a953fcbb tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "cinder-quobyte-127f4ca0-960b-4169-b430-a46b34dff517" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:00:41 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-1a170b2b-daef-4d5c-b552-53c6a953fcbb tempest-CreateVolumesFromSnapshotTest-608498869 None] Deleting offline snapshot 127f4ca0-960b-4169-b430-a46b34dff517 of volume 301ca1dc-13a0-41be-bd52-c2cb6c373f6e {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:00:41 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-1a170b2b-daef-4d5c-b552-53c6a953fcbb tempest-CreateVolumesFromSnapshotTest-608498869 None] snapshot_file for this snap is: volume-301ca1dc-13a0-41be-bd52-c2cb6c373f6e.127f4ca0-960b-4169-b430-a46b34dff517 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:00:41 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb87174-9620-4707-8449-21762e8a508b]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:00:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1a170b2b-daef-4d5c-b552-53c6a953fcbb tempest-CreateVolumesFromSnapshotTest-608498869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-301ca1dc-13a0-41be-bd52-c2cb6c373f6e.127f4ca0-960b-4169-b430-a46b34dff517 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:41 devstack sudo[103528]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-be23ce13-7874-4f09-b345-3bc4ed0145f8 tempest-CreateVolumesFromSnapshotTest-608498869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.329s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:41 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-be23ce13-7874-4f09-b345-3bc4ed0145f8 tempest-CreateVolumesFromSnapshotTest-608498869 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:00:41 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-be23ce13-7874-4f09-b345-3bc4ed0145f8 tempest-CreateVolumesFromSnapshotTest-608498869 None] Deleted volume successfully. Nov 06 18:00:41 devstack sudo[103530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-301ca1dc-13a0-41be-bd52-c2cb6c373f6e.127f4ca0-960b-4169-b430-a46b34dff517 Nov 06 18:00:41 devstack sudo[103530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:41 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-be23ce13-7874-4f09-b345-3bc4ed0145f8 tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "cinder-d80f3ef9-bbb3-49c5-913e-40ff876b4d5f-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:00:41 devstack sudo[103530]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1a170b2b-daef-4d5c-b552-53c6a953fcbb tempest-CreateVolumesFromSnapshotTest-608498869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-301ca1dc-13a0-41be-bd52-c2cb6c373f6e.127f4ca0-960b-4169-b430-a46b34dff517" returned: 0 in 0.491s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:41 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-1a170b2b-daef-4d5c-b552-53c6a953fcbb tempest-CreateVolumesFromSnapshotTest-608498869 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-301ca1dc-13a0-41be-bd52-c2cb6c373f6e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:00:41 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a170b3-df8c-46b9-9d86-bf1130f36c8f]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:00:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1a170b2b-daef-4d5c-b552-53c6a953fcbb tempest-CreateVolumesFromSnapshotTest-608498869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-301ca1dc-13a0-41be-bd52-c2cb6c373f6e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:41 devstack sudo[103537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-301ca1dc-13a0-41be-bd52-c2cb6c373f6e Nov 06 18:00:41 devstack sudo[103537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:42 devstack sudo[103537]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1a170b2b-daef-4d5c-b552-53c6a953fcbb tempest-CreateVolumesFromSnapshotTest-608498869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-301ca1dc-13a0-41be-bd52-c2cb6c373f6e" returned: 0 in 0.576s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1a170b2b-daef-4d5c-b552-53c6a953fcbb tempest-CreateVolumesFromSnapshotTest-608498869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-301ca1dc-13a0-41be-bd52-c2cb6c373f6e.127f4ca0-960b-4169-b430-a46b34dff517 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:42 devstack sudo[103542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-301ca1dc-13a0-41be-bd52-c2cb6c373f6e.127f4ca0-960b-4169-b430-a46b34dff517 Nov 06 18:00:42 devstack sudo[103542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:42 devstack sudo[103542]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1a170b2b-daef-4d5c-b552-53c6a953fcbb tempest-CreateVolumesFromSnapshotTest-608498869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-301ca1dc-13a0-41be-bd52-c2cb6c373f6e.127f4ca0-960b-4169-b430-a46b34dff517" returned: 0 in 0.457s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1a170b2b-daef-4d5c-b552-53c6a953fcbb tempest-CreateVolumesFromSnapshotTest-608498869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-301ca1dc-13a0-41be-bd52-c2cb6c373f6e.127f4ca0-960b-4169-b430-a46b34dff517 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:42 devstack sudo[103547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-301ca1dc-13a0-41be-bd52-c2cb6c373f6e.127f4ca0-960b-4169-b430-a46b34dff517 Nov 06 18:00:42 devstack sudo[103547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:42 devstack sudo[103547]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1a170b2b-daef-4d5c-b552-53c6a953fcbb tempest-CreateVolumesFromSnapshotTest-608498869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-301ca1dc-13a0-41be-bd52-c2cb6c373f6e.127f4ca0-960b-4169-b430-a46b34dff517" returned: 0 in 0.292s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:43 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1a170b2b-daef-4d5c-b552-53c6a953fcbb tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "cinder-quobyte-127f4ca0-960b-4169-b430-a46b34dff517" released by "_delete_snapshot" :: held 2.050s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:00:43 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1a170b2b-daef-4d5c-b552-53c6a953fcbb tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "cinder-quobyte-301ca1dc-13a0-41be-bd52-c2cb6c373f6e" released by "delete_snapshot" :: held 2.091s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:00:43 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-31a35dbc-6efe-4c63-af4f-dfceb981e38c tempest-TestStampPattern-1009226522 None] Acquiring lock "cinder-7ec18362-c853-4736-a380-ba7690ba3000-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:00:43 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-31a35dbc-6efe-4c63-af4f-dfceb981e38c tempest-TestStampPattern-1009226522 None] Lock "cinder-7ec18362-c853-4736-a380-ba7690ba3000-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:00:43 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-1a170b2b-daef-4d5c-b552-53c6a953fcbb tempest-CreateVolumesFromSnapshotTest-608498869 None] Created reservations ['f4dedff6-5735-479e-94cd-db65c8469934', '85ab9c62-d9ee-41b8-9efe-2d65c6336e60', '0ed84b7b-cebc-4782-b347-5a9e71bf9bf7', '5184656d-59b6-4337-9cc2-011d0413787c'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:00:43 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-31a35dbc-6efe-4c63-af4f-dfceb981e38c tempest-TestStampPattern-1009226522 None] Acquiring lock "cinder-quobyte-7ec18362-c853-4736-a380-ba7690ba3000" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:00:43 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-31a35dbc-6efe-4c63-af4f-dfceb981e38c tempest-TestStampPattern-1009226522 None] Lock "cinder-quobyte-7ec18362-c853-4736-a380-ba7690ba3000" acquired by "delete_volume" :: waited 0.027s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:00:43 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1bea301-2e51-462b-ad03-41d1991ea37b]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:00:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-31a35dbc-6efe-4c63-af4f-dfceb981e38c tempest-TestStampPattern-1009226522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7ec18362-c853-4736-a380-ba7690ba3000 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:43 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-1a170b2b-daef-4d5c-b552-53c6a953fcbb tempest-CreateVolumesFromSnapshotTest-608498869 None] Delete snapshot completed successfully. Nov 06 18:00:43 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1a170b2b-daef-4d5c-b552-53c6a953fcbb tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "cinder-127f4ca0-960b-4169-b430-a46b34dff517-delete_snapshot" released by "delete_snapshot" :: held 2.423s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:00:43 devstack sudo[103550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7ec18362-c853-4736-a380-ba7690ba3000 Nov 06 18:00:43 devstack sudo[103550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:43 devstack sudo[103550]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-31a35dbc-6efe-4c63-af4f-dfceb981e38c tempest-TestStampPattern-1009226522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7ec18362-c853-4736-a380-ba7690ba3000" returned: 0 in 0.542s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-31a35dbc-6efe-4c63-af4f-dfceb981e38c tempest-TestStampPattern-1009226522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7ec18362-c853-4736-a380-ba7690ba3000 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:43 devstack sudo[103555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7ec18362-c853-4736-a380-ba7690ba3000 Nov 06 18:00:43 devstack sudo[103555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:44 devstack sudo[103555]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-31a35dbc-6efe-4c63-af4f-dfceb981e38c tempest-TestStampPattern-1009226522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7ec18362-c853-4736-a380-ba7690ba3000" returned: 0 in 0.345s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:44 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-31a35dbc-6efe-4c63-af4f-dfceb981e38c tempest-TestStampPattern-1009226522 None] Lock "cinder-quobyte-7ec18362-c853-4736-a380-ba7690ba3000" released by "delete_volume" :: held 0.968s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:00:44 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-59eb0dc0-e9af-46b8-aa97-aedbb4fb1273 tempest-CreateVolumesFromSnapshotTest-608498869 None] Acquiring lock "cinder-301ca1dc-13a0-41be-bd52-c2cb6c373f6e-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:00:44 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-59eb0dc0-e9af-46b8-aa97-aedbb4fb1273 tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "cinder-301ca1dc-13a0-41be-bd52-c2cb6c373f6e-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:00:44 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-31a35dbc-6efe-4c63-af4f-dfceb981e38c tempest-TestStampPattern-1009226522 None] Created reservations ['7087dc16-bdfd-4e9f-89d3-dfebcba1ca74', '19a84355-72f8-4826-b324-03120266b626', 'ea8e33a9-5018-4e88-8451-6045e9815cf1', 'b6975e91-6480-469e-9b31-b37329c85fcb'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:00:44 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-59eb0dc0-e9af-46b8-aa97-aedbb4fb1273 tempest-CreateVolumesFromSnapshotTest-608498869 None] Acquiring lock "cinder-quobyte-301ca1dc-13a0-41be-bd52-c2cb6c373f6e" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:00:44 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-59eb0dc0-e9af-46b8-aa97-aedbb4fb1273 tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "cinder-quobyte-301ca1dc-13a0-41be-bd52-c2cb6c373f6e" acquired by "delete_volume" :: waited 0.024s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:00:44 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee155e4-5bb6-4ad7-a721-9d7c71295947]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:00:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-59eb0dc0-e9af-46b8-aa97-aedbb4fb1273 tempest-CreateVolumesFromSnapshotTest-608498869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-301ca1dc-13a0-41be-bd52-c2cb6c373f6e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-31a35dbc-6efe-4c63-af4f-dfceb981e38c tempest-TestStampPattern-1009226522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:00:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-31a35dbc-6efe-4c63-af4f-dfceb981e38c tempest-TestStampPattern-1009226522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:00:44 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-31a35dbc-6efe-4c63-af4f-dfceb981e38c tempest-TestStampPattern-1009226522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:00:44 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-31a35dbc-6efe-4c63-af4f-dfceb981e38c tempest-TestStampPattern-1009226522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:00:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-31a35dbc-6efe-4c63-af4f-dfceb981e38c tempest-TestStampPattern-1009226522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:00:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-31a35dbc-6efe-4c63-af4f-dfceb981e38c tempest-TestStampPattern-1009226522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:44 devstack sudo[103559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:00:44 devstack sudo[103559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:44 devstack sudo[103558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-301ca1dc-13a0-41be-bd52-c2cb6c373f6e Nov 06 18:00:44 devstack sudo[103558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:44 devstack sudo[103559]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-31a35dbc-6efe-4c63-af4f-dfceb981e38c tempest-TestStampPattern-1009226522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.311s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:44 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-31a35dbc-6efe-4c63-af4f-dfceb981e38c tempest-TestStampPattern-1009226522 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:00:44 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-31a35dbc-6efe-4c63-af4f-dfceb981e38c tempest-TestStampPattern-1009226522 None] Deleted volume successfully. Nov 06 18:00:44 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-31a35dbc-6efe-4c63-af4f-dfceb981e38c tempest-TestStampPattern-1009226522 None] Lock "cinder-7ec18362-c853-4736-a380-ba7690ba3000-delete_volume" released by "delete_volume" :: held 1.741s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:00:44 devstack sudo[103558]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-59eb0dc0-e9af-46b8-aa97-aedbb4fb1273 tempest-CreateVolumesFromSnapshotTest-608498869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-301ca1dc-13a0-41be-bd52-c2cb6c373f6e" returned: 0 in 0.466s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-59eb0dc0-e9af-46b8-aa97-aedbb4fb1273 tempest-CreateVolumesFromSnapshotTest-608498869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-301ca1dc-13a0-41be-bd52-c2cb6c373f6e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:45 devstack sudo[103566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-301ca1dc-13a0-41be-bd52-c2cb6c373f6e Nov 06 18:00:45 devstack sudo[103566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:45 devstack sudo[103566]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-59eb0dc0-e9af-46b8-aa97-aedbb4fb1273 tempest-CreateVolumesFromSnapshotTest-608498869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-301ca1dc-13a0-41be-bd52-c2cb6c373f6e" returned: 0 in 0.288s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:45 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-59eb0dc0-e9af-46b8-aa97-aedbb4fb1273 tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "cinder-quobyte-301ca1dc-13a0-41be-bd52-c2cb6c373f6e" released by "delete_volume" :: held 0.851s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:00:45 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-106c5f77-e54a-4acf-b67b-9038e449b5d0 tempest-ProjectReaderTests-271704049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:00:45 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-106c5f77-e54a-4acf-b67b-9038e449b5d0 tempest-ProjectReaderTests-271704049 None] Flow 'volume_create_manager' (4f19ea1c-9905-44ea-bfd6-1ce1a1842014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:00:45 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-106c5f77-e54a-4acf-b67b-9038e449b5d0 tempest-ProjectReaderTests-271704049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9adc037a-4e32-4036-ad3d-a69501abd47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:45 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-106c5f77-e54a-4acf-b67b-9038e449b5d0 tempest-ProjectReaderTests-271704049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9adc037a-4e32-4036-ad3d-a69501abd47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:00:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1919499041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7215acfa-65e4-4ec6-bcb3-2d0840e354f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28ccefaa8eaa4710bb5c331cb928dc03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:00:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:00:45Z,use_quota=True,user_id='066e7381e1c541f1a333bab780e9078c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:00:45 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-106c5f77-e54a-4acf-b67b-9038e449b5d0 tempest-ProjectReaderTests-271704049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a06675bc-e6a8-4b7d-86c2-730b92982e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:45 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-106c5f77-e54a-4acf-b67b-9038e449b5d0 tempest-ProjectReaderTests-271704049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a06675bc-e6a8-4b7d-86c2-730b92982e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:00:45 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-106c5f77-e54a-4acf-b67b-9038e449b5d0 tempest-ProjectReaderTests-271704049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b220ed87-ffb7-4a7e-8cd5-44c269a6e238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:45 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-106c5f77-e54a-4acf-b67b-9038e449b5d0 tempest-ProjectReaderTests-271704049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b220ed87-ffb7-4a7e-8cd5-44c269a6e238) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7215acfa-65e4-4ec6-bcb3-2d0840e354f3', 'volume_name': 'volume-7215acfa-65e4-4ec6-bcb3-2d0840e354f3', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:00:45 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-106c5f77-e54a-4acf-b67b-9038e449b5d0 tempest-ProjectReaderTests-271704049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19974dc2-d5d0-40fe-8d4d-f96e4f41c52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:45 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-106c5f77-e54a-4acf-b67b-9038e449b5d0 tempest-ProjectReaderTests-271704049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19974dc2-d5d0-40fe-8d4d-f96e4f41c52a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:00:45 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-106c5f77-e54a-4acf-b67b-9038e449b5d0 tempest-ProjectReaderTests-271704049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a187bc12-bd0f-41ef-8f5f-f5da07b92580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:45 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-106c5f77-e54a-4acf-b67b-9038e449b5d0 tempest-ProjectReaderTests-271704049 None] Volume 7215acfa-65e4-4ec6-bcb3-2d0840e354f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7215acfa-65e4-4ec6-bcb3-2d0840e354f3', 'volume_size': 1} Nov 06 18:00:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-106c5f77-e54a-4acf-b67b-9038e449b5d0 tempest-ProjectReaderTests-271704049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:00:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-106c5f77-e54a-4acf-b67b-9038e449b5d0 tempest-ProjectReaderTests-271704049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:00:45 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-106c5f77-e54a-4acf-b67b-9038e449b5d0 tempest-ProjectReaderTests-271704049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:00:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1919499041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7215acfa-65e4-4ec6-bcb3-2d0840e354f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28ccefaa8eaa4710bb5c331cb928dc03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:00:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:00:45Z,use_quota=True,user_id='066e7381e1c541f1a333bab780e9078c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:00:45 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-106c5f77-e54a-4acf-b67b-9038e449b5d0 tempest-ProjectReaderTests-271704049 None] Creating volume 7215acfa-65e4-4ec6-bcb3-2d0840e354f3 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:00:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-106c5f77-e54a-4acf-b67b-9038e449b5d0 tempest-ProjectReaderTests-271704049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:00:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-106c5f77-e54a-4acf-b67b-9038e449b5d0 tempest-ProjectReaderTests-271704049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:00:45 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-106c5f77-e54a-4acf-b67b-9038e449b5d0 tempest-ProjectReaderTests-271704049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:00:45 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-106c5f77-e54a-4acf-b67b-9038e449b5d0 tempest-ProjectReaderTests-271704049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:00:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-106c5f77-e54a-4acf-b67b-9038e449b5d0 tempest-ProjectReaderTests-271704049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:00:45 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-106c5f77-e54a-4acf-b67b-9038e449b5d0 tempest-ProjectReaderTests-271704049 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:00:45 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-106c5f77-e54a-4acf-b67b-9038e449b5d0 tempest-ProjectReaderTests-271704049 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:00:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-106c5f77-e54a-4acf-b67b-9038e449b5d0 tempest-ProjectReaderTests-271704049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7215acfa-65e4-4ec6-bcb3-2d0840e354f3 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:45 devstack sudo[103569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7215acfa-65e4-4ec6-bcb3-2d0840e354f3 1073741824 Nov 06 18:00:45 devstack sudo[103569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:45 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-59eb0dc0-e9af-46b8-aa97-aedbb4fb1273 tempest-CreateVolumesFromSnapshotTest-608498869 None] Created reservations ['7c15f71b-d655-4125-877e-a729e69f2eae', '033d5b3a-edf8-41b3-a8dd-3f0578268b9b', '7c6e9724-977f-4e2c-83c7-983d593fa4a6', '79bcc730-4026-4c9e-932f-fb69c57ac2fe'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:00:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-59eb0dc0-e9af-46b8-aa97-aedbb4fb1273 tempest-CreateVolumesFromSnapshotTest-608498869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:00:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-59eb0dc0-e9af-46b8-aa97-aedbb4fb1273 tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:00:45 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-59eb0dc0-e9af-46b8-aa97-aedbb4fb1273 tempest-CreateVolumesFromSnapshotTest-608498869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:00:45 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-59eb0dc0-e9af-46b8-aa97-aedbb4fb1273 tempest-CreateVolumesFromSnapshotTest-608498869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:00:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-59eb0dc0-e9af-46b8-aa97-aedbb4fb1273 tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:00:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-59eb0dc0-e9af-46b8-aa97-aedbb4fb1273 tempest-CreateVolumesFromSnapshotTest-608498869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:45 devstack sudo[103571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:00:45 devstack sudo[103571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:45 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8dcd7d43-64a0-4133-b1c0-cf34c75e59f0 tempest-TestStampPattern-1009226522 None] Acquiring lock "cinder-328f139e-aab6-434e-b8de-253760d763ee-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:00:45 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8dcd7d43-64a0-4133-b1c0-cf34c75e59f0 tempest-TestStampPattern-1009226522 None] Lock "cinder-328f139e-aab6-434e-b8de-253760d763ee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:00:45 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8dcd7d43-64a0-4133-b1c0-cf34c75e59f0 tempest-TestStampPattern-1009226522 None] Acquiring lock "cinder-quobyte-d2b696d5-ed98-4c74-8324-5877f1541563" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:00:45 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8dcd7d43-64a0-4133-b1c0-cf34c75e59f0 tempest-TestStampPattern-1009226522 None] Lock "cinder-quobyte-d2b696d5-ed98-4c74-8324-5877f1541563" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:00:45 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8dcd7d43-64a0-4133-b1c0-cf34c75e59f0 tempest-TestStampPattern-1009226522 None] Acquiring lock "cinder-quobyte-328f139e-aab6-434e-b8de-253760d763ee" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:00:45 devstack sudo[103571]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:45 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8dcd7d43-64a0-4133-b1c0-cf34c75e59f0 tempest-TestStampPattern-1009226522 None] Lock "cinder-quobyte-328f139e-aab6-434e-b8de-253760d763ee" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:00:45 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-8dcd7d43-64a0-4133-b1c0-cf34c75e59f0 tempest-TestStampPattern-1009226522 None] Deleting offline snapshot 328f139e-aab6-434e-b8de-253760d763ee of volume d2b696d5-ed98-4c74-8324-5877f1541563 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:00:45 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-8dcd7d43-64a0-4133-b1c0-cf34c75e59f0 tempest-TestStampPattern-1009226522 None] snapshot_file for this snap is: volume-d2b696d5-ed98-4c74-8324-5877f1541563.328f139e-aab6-434e-b8de-253760d763ee {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:00:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-59eb0dc0-e9af-46b8-aa97-aedbb4fb1273 tempest-CreateVolumesFromSnapshotTest-608498869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.399s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:45 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-59eb0dc0-e9af-46b8-aa97-aedbb4fb1273 tempest-CreateVolumesFromSnapshotTest-608498869 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:00:45 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-59eb0dc0-e9af-46b8-aa97-aedbb4fb1273 tempest-CreateVolumesFromSnapshotTest-608498869 None] Deleted volume successfully. Nov 06 18:00:46 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dfb3a88-a587-41ad-a021-d4c0a162483a]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:00:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8dcd7d43-64a0-4133-b1c0-cf34c75e59f0 tempest-TestStampPattern-1009226522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d2b696d5-ed98-4c74-8324-5877f1541563.328f139e-aab6-434e-b8de-253760d763ee {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:46 devstack sudo[103569]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-106c5f77-e54a-4acf-b67b-9038e449b5d0 tempest-ProjectReaderTests-271704049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7215acfa-65e4-4ec6-bcb3-2d0840e354f3 1073741824" returned: 0 in 0.608s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:46 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-59eb0dc0-e9af-46b8-aa97-aedbb4fb1273 tempest-CreateVolumesFromSnapshotTest-608498869 None] Lock "cinder-301ca1dc-13a0-41be-bd52-c2cb6c373f6e-delete_volume" released by "delete_volume" :: held 1.726s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:00:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-106c5f77-e54a-4acf-b67b-9038e449b5d0 tempest-ProjectReaderTests-271704049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7215acfa-65e4-4ec6-bcb3-2d0840e354f3 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:46 devstack sudo[103579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7215acfa-65e4-4ec6-bcb3-2d0840e354f3 Nov 06 18:00:46 devstack sudo[103579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:46 devstack sudo[103578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d2b696d5-ed98-4c74-8324-5877f1541563.328f139e-aab6-434e-b8de-253760d763ee Nov 06 18:00:46 devstack sudo[103578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:46 devstack sudo[103579]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-106c5f77-e54a-4acf-b67b-9038e449b5d0 tempest-ProjectReaderTests-271704049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7215acfa-65e4-4ec6-bcb3-2d0840e354f3" returned: 0 in 0.314s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:46 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-106c5f77-e54a-4acf-b67b-9038e449b5d0 tempest-ProjectReaderTests-271704049 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:00:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-106c5f77-e54a-4acf-b67b-9038e449b5d0 tempest-ProjectReaderTests-271704049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:00:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-106c5f77-e54a-4acf-b67b-9038e449b5d0 tempest-ProjectReaderTests-271704049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a187bc12-bd0f-41ef-8f5f-f5da07b92580) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7215acfa-65e4-4ec6-bcb3-2d0840e354f3', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:00:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-106c5f77-e54a-4acf-b67b-9038e449b5d0 tempest-ProjectReaderTests-271704049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa986db4-f4e5-47ed-a84b-da0c7dbf88da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:46 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-106c5f77-e54a-4acf-b67b-9038e449b5d0 tempest-ProjectReaderTests-271704049 None] Volume volume-7215acfa-65e4-4ec6-bcb3-2d0840e354f3 (7215acfa-65e4-4ec6-bcb3-2d0840e354f3): created successfully Nov 06 18:00:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-106c5f77-e54a-4acf-b67b-9038e449b5d0 tempest-ProjectReaderTests-271704049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa986db4-f4e5-47ed-a84b-da0c7dbf88da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:00:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-106c5f77-e54a-4acf-b67b-9038e449b5d0 tempest-ProjectReaderTests-271704049 None] Flow 'volume_create_manager' (4f19ea1c-9905-44ea-bfd6-1ce1a1842014) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:00:46 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-106c5f77-e54a-4acf-b67b-9038e449b5d0 tempest-ProjectReaderTests-271704049 None] Created volume successfully. Nov 06 18:00:46 devstack sudo[103578]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8dcd7d43-64a0-4133-b1c0-cf34c75e59f0 tempest-TestStampPattern-1009226522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d2b696d5-ed98-4c74-8324-5877f1541563.328f139e-aab6-434e-b8de-253760d763ee" returned: 0 in 0.526s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:46 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-8dcd7d43-64a0-4133-b1c0-cf34c75e59f0 tempest-TestStampPattern-1009226522 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2b696d5-ed98-4c74-8324-5877f1541563(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:00:46 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[543cd726-db3a-4201-89f7-7f043c2d3954]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:00:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8dcd7d43-64a0-4133-b1c0-cf34c75e59f0 tempest-TestStampPattern-1009226522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d2b696d5-ed98-4c74-8324-5877f1541563 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:46 devstack sudo[103586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d2b696d5-ed98-4c74-8324-5877f1541563 Nov 06 18:00:46 devstack sudo[103586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:47 devstack sudo[103586]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8dcd7d43-64a0-4133-b1c0-cf34c75e59f0 tempest-TestStampPattern-1009226522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d2b696d5-ed98-4c74-8324-5877f1541563" returned: 0 in 0.658s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8dcd7d43-64a0-4133-b1c0-cf34c75e59f0 tempest-TestStampPattern-1009226522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d2b696d5-ed98-4c74-8324-5877f1541563.328f139e-aab6-434e-b8de-253760d763ee {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:47 devstack sudo[103591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d2b696d5-ed98-4c74-8324-5877f1541563.328f139e-aab6-434e-b8de-253760d763ee Nov 06 18:00:47 devstack sudo[103591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5d66e8c6-f87d-40cf-b278-042aab426d22 tempest-ProjectReaderTests-271704049 None] Acquiring lock "cinder-7215acfa-65e4-4ec6-bcb3-2d0840e354f3-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:00:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5d66e8c6-f87d-40cf-b278-042aab426d22 tempest-ProjectReaderTests-271704049 None] Lock "cinder-7215acfa-65e4-4ec6-bcb3-2d0840e354f3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:00:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5d66e8c6-f87d-40cf-b278-042aab426d22 tempest-ProjectReaderTests-271704049 None] Acquiring lock "cinder-quobyte-7215acfa-65e4-4ec6-bcb3-2d0840e354f3" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:00:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5d66e8c6-f87d-40cf-b278-042aab426d22 tempest-ProjectReaderTests-271704049 None] Lock "cinder-quobyte-7215acfa-65e4-4ec6-bcb3-2d0840e354f3" acquired by "delete_volume" :: waited 0.015s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:00:47 devstack sudo[103591]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8dcd7d43-64a0-4133-b1c0-cf34c75e59f0 tempest-TestStampPattern-1009226522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d2b696d5-ed98-4c74-8324-5877f1541563.328f139e-aab6-434e-b8de-253760d763ee" returned: 0 in 0.607s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8dcd7d43-64a0-4133-b1c0-cf34c75e59f0 tempest-TestStampPattern-1009226522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d2b696d5-ed98-4c74-8324-5877f1541563.328f139e-aab6-434e-b8de-253760d763ee {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:47 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5504f2-e3cb-4d8a-9be5-5e07fed398d9]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:00:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5d66e8c6-f87d-40cf-b278-042aab426d22 tempest-ProjectReaderTests-271704049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7215acfa-65e4-4ec6-bcb3-2d0840e354f3 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:47 devstack sudo[103597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d2b696d5-ed98-4c74-8324-5877f1541563.328f139e-aab6-434e-b8de-253760d763ee Nov 06 18:00:47 devstack sudo[103597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:48 devstack sudo[103598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7215acfa-65e4-4ec6-bcb3-2d0840e354f3 Nov 06 18:00:48 devstack sudo[103598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:48 devstack sudo[103597]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8dcd7d43-64a0-4133-b1c0-cf34c75e59f0 tempest-TestStampPattern-1009226522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d2b696d5-ed98-4c74-8324-5877f1541563.328f139e-aab6-434e-b8de-253760d763ee" returned: 0 in 0.339s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:48 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8dcd7d43-64a0-4133-b1c0-cf34c75e59f0 tempest-TestStampPattern-1009226522 None] Lock "cinder-quobyte-328f139e-aab6-434e-b8de-253760d763ee" released by "_delete_snapshot" :: held 2.299s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:00:48 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8dcd7d43-64a0-4133-b1c0-cf34c75e59f0 tempest-TestStampPattern-1009226522 None] Lock "cinder-quobyte-d2b696d5-ed98-4c74-8324-5877f1541563" released by "delete_snapshot" :: held 2.336s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:00:48 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-8dcd7d43-64a0-4133-b1c0-cf34c75e59f0 tempest-TestStampPattern-1009226522 None] Created reservations ['52eda09c-7670-49a0-8d4c-367d04a668e0', 'a670481f-9c99-47f7-a1d5-ce04d3ae97c4', '13b2ea37-6e3c-41cb-887e-df80402d7663', '9684d9a0-90e6-441a-902d-45f7c3bb7157'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:00:48 devstack sudo[103598]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:48 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-8dcd7d43-64a0-4133-b1c0-cf34c75e59f0 tempest-TestStampPattern-1009226522 None] Delete snapshot completed successfully. Nov 06 18:00:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5d66e8c6-f87d-40cf-b278-042aab426d22 tempest-ProjectReaderTests-271704049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7215acfa-65e4-4ec6-bcb3-2d0840e354f3" returned: 0 in 0.600s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5d66e8c6-f87d-40cf-b278-042aab426d22 tempest-ProjectReaderTests-271704049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7215acfa-65e4-4ec6-bcb3-2d0840e354f3 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:48 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8dcd7d43-64a0-4133-b1c0-cf34c75e59f0 tempest-TestStampPattern-1009226522 None] Lock "cinder-328f139e-aab6-434e-b8de-253760d763ee-delete_snapshot" released by "delete_snapshot" :: held 2.588s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:00:48 devstack sudo[103606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7215acfa-65e4-4ec6-bcb3-2d0840e354f3 Nov 06 18:00:48 devstack sudo[103606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:48 devstack sudo[103606]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5d66e8c6-f87d-40cf-b278-042aab426d22 tempest-ProjectReaderTests-271704049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7215acfa-65e4-4ec6-bcb3-2d0840e354f3" returned: 0 in 0.339s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:48 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5d66e8c6-f87d-40cf-b278-042aab426d22 tempest-ProjectReaderTests-271704049 None] Lock "cinder-quobyte-7215acfa-65e4-4ec6-bcb3-2d0840e354f3" released by "delete_volume" :: held 1.004s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:00:48 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-5d66e8c6-f87d-40cf-b278-042aab426d22 tempest-ProjectReaderTests-271704049 None] Created reservations ['01aae135-c66e-4bb3-bd2d-7267e1af8ed2', '37fb3783-5daf-4a43-ae0b-d00b17e84278', '6718c03c-85a9-4f26-8923-e38d7797f4b8', '6244b887-b517-4b22-8f62-a7de09f942a6'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:00:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5d66e8c6-f87d-40cf-b278-042aab426d22 tempest-ProjectReaderTests-271704049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:00:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5d66e8c6-f87d-40cf-b278-042aab426d22 tempest-ProjectReaderTests-271704049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:00:48 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5d66e8c6-f87d-40cf-b278-042aab426d22 tempest-ProjectReaderTests-271704049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:00:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5d66e8c6-f87d-40cf-b278-042aab426d22 tempest-ProjectReaderTests-271704049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:00:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5d66e8c6-f87d-40cf-b278-042aab426d22 tempest-ProjectReaderTests-271704049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:00:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5d66e8c6-f87d-40cf-b278-042aab426d22 tempest-ProjectReaderTests-271704049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:49 devstack sudo[103609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:00:49 devstack sudo[103609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:49 devstack sudo[103609]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5d66e8c6-f87d-40cf-b278-042aab426d22 tempest-ProjectReaderTests-271704049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.324s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:49 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-5d66e8c6-f87d-40cf-b278-042aab426d22 tempest-ProjectReaderTests-271704049 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:00:49 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-5d66e8c6-f87d-40cf-b278-042aab426d22 tempest-ProjectReaderTests-271704049 None] Deleted volume successfully. Nov 06 18:00:49 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5d66e8c6-f87d-40cf-b278-042aab426d22 tempest-ProjectReaderTests-271704049 None] Lock "cinder-7215acfa-65e4-4ec6-bcb3-2d0840e354f3-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:00:50 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-de8e4dd7-69c9-4fbb-8b4f-bca65a823389 tempest-ProjectReaderTests-271704049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:00:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-de8e4dd7-69c9-4fbb-8b4f-bca65a823389 tempest-ProjectReaderTests-271704049 None] Flow 'volume_create_manager' (e9b80368-038b-4343-a65b-b3be5a2c4010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:00:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-de8e4dd7-69c9-4fbb-8b4f-bca65a823389 tempest-ProjectReaderTests-271704049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35124ee8-18df-482e-a69d-f5e4210ad2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:51 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-de8e4dd7-69c9-4fbb-8b4f-bca65a823389 tempest-ProjectReaderTests-271704049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35124ee8-18df-482e-a69d-f5e4210ad2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-651756946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc5a43e0-87c3-4be2-8ed4-e40d491ccd55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28ccefaa8eaa4710bb5c331cb928dc03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:00:51Z,use_quota=True,user_id='066e7381e1c541f1a333bab780e9078c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:00:51 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-de8e4dd7-69c9-4fbb-8b4f-bca65a823389 tempest-ProjectReaderTests-271704049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4673b6b-bdd3-4225-82b8-9e7c806071e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:51 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-de8e4dd7-69c9-4fbb-8b4f-bca65a823389 tempest-ProjectReaderTests-271704049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4673b6b-bdd3-4225-82b8-9e7c806071e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:00:51 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-de8e4dd7-69c9-4fbb-8b4f-bca65a823389 tempest-ProjectReaderTests-271704049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a1c3725-660d-453b-8a33-056d517a26a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:51 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-de8e4dd7-69c9-4fbb-8b4f-bca65a823389 tempest-ProjectReaderTests-271704049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a1c3725-660d-453b-8a33-056d517a26a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc5a43e0-87c3-4be2-8ed4-e40d491ccd55', 'volume_name': 'volume-dc5a43e0-87c3-4be2-8ed4-e40d491ccd55', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:00:51 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-de8e4dd7-69c9-4fbb-8b4f-bca65a823389 tempest-ProjectReaderTests-271704049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0697eb97-726a-48cf-9400-c8bc04701bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:51 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-de8e4dd7-69c9-4fbb-8b4f-bca65a823389 tempest-ProjectReaderTests-271704049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0697eb97-726a-48cf-9400-c8bc04701bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:00:51 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-de8e4dd7-69c9-4fbb-8b4f-bca65a823389 tempest-ProjectReaderTests-271704049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76c16d8a-6454-4a78-8a5e-49ef8ceb02cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:51 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-de8e4dd7-69c9-4fbb-8b4f-bca65a823389 tempest-ProjectReaderTests-271704049 None] Volume dc5a43e0-87c3-4be2-8ed4-e40d491ccd55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc5a43e0-87c3-4be2-8ed4-e40d491ccd55', 'volume_size': 1} Nov 06 18:00:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-de8e4dd7-69c9-4fbb-8b4f-bca65a823389 tempest-ProjectReaderTests-271704049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:00:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-de8e4dd7-69c9-4fbb-8b4f-bca65a823389 tempest-ProjectReaderTests-271704049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:00:51 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-de8e4dd7-69c9-4fbb-8b4f-bca65a823389 tempest-ProjectReaderTests-271704049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-651756946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc5a43e0-87c3-4be2-8ed4-e40d491ccd55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28ccefaa8eaa4710bb5c331cb928dc03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:00:51Z,use_quota=True,user_id='066e7381e1c541f1a333bab780e9078c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:00:51 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-de8e4dd7-69c9-4fbb-8b4f-bca65a823389 tempest-ProjectReaderTests-271704049 None] Creating volume dc5a43e0-87c3-4be2-8ed4-e40d491ccd55 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:00:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-de8e4dd7-69c9-4fbb-8b4f-bca65a823389 tempest-ProjectReaderTests-271704049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:00:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-de8e4dd7-69c9-4fbb-8b4f-bca65a823389 tempest-ProjectReaderTests-271704049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:00:51 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-de8e4dd7-69c9-4fbb-8b4f-bca65a823389 tempest-ProjectReaderTests-271704049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:00:51 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-de8e4dd7-69c9-4fbb-8b4f-bca65a823389 tempest-ProjectReaderTests-271704049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:00:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-de8e4dd7-69c9-4fbb-8b4f-bca65a823389 tempest-ProjectReaderTests-271704049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:00:51 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-de8e4dd7-69c9-4fbb-8b4f-bca65a823389 tempest-ProjectReaderTests-271704049 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:00:51 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-de8e4dd7-69c9-4fbb-8b4f-bca65a823389 tempest-ProjectReaderTests-271704049 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:00:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-de8e4dd7-69c9-4fbb-8b4f-bca65a823389 tempest-ProjectReaderTests-271704049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-dc5a43e0-87c3-4be2-8ed4-e40d491ccd55 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:51 devstack sudo[103617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-dc5a43e0-87c3-4be2-8ed4-e40d491ccd55 1073741824 Nov 06 18:00:51 devstack sudo[103617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:52 devstack sudo[103617]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-de8e4dd7-69c9-4fbb-8b4f-bca65a823389 tempest-ProjectReaderTests-271704049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-dc5a43e0-87c3-4be2-8ed4-e40d491ccd55 1073741824" returned: 0 in 0.894s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-de8e4dd7-69c9-4fbb-8b4f-bca65a823389 tempest-ProjectReaderTests-271704049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-dc5a43e0-87c3-4be2-8ed4-e40d491ccd55 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:52 devstack sudo[103644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-dc5a43e0-87c3-4be2-8ed4-e40d491ccd55 Nov 06 18:00:52 devstack sudo[103644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:52 devstack sudo[103644]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-de8e4dd7-69c9-4fbb-8b4f-bca65a823389 tempest-ProjectReaderTests-271704049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-dc5a43e0-87c3-4be2-8ed4-e40d491ccd55" returned: 0 in 0.427s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:52 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-de8e4dd7-69c9-4fbb-8b4f-bca65a823389 tempest-ProjectReaderTests-271704049 None] <== create_volume: return (1472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:00:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-de8e4dd7-69c9-4fbb-8b4f-bca65a823389 tempest-ProjectReaderTests-271704049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:00:52 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-94d4d340-85d1-4e10-b87f-614a6327b0d9 tempest-TestImageHashVerification-276828311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:00:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-94d4d340-85d1-4e10-b87f-614a6327b0d9 tempest-TestImageHashVerification-276828311 None] Flow 'volume_create_manager' (bbbf634d-055d-4ce6-836c-38ae64080a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:00:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-94d4d340-85d1-4e10-b87f-614a6327b0d9 tempest-TestImageHashVerification-276828311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ef90021-187b-40a5-992a-e95a83a2076b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-de8e4dd7-69c9-4fbb-8b4f-bca65a823389 tempest-ProjectReaderTests-271704049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76c16d8a-6454-4a78-8a5e-49ef8ceb02cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc5a43e0-87c3-4be2-8ed4-e40d491ccd55', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:00:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-de8e4dd7-69c9-4fbb-8b4f-bca65a823389 tempest-ProjectReaderTests-271704049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb6d5f2f-8648-4003-8866-b8a812c7343e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-94d4d340-85d1-4e10-b87f-614a6327b0d9 tempest-TestImageHashVerification-276828311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ef90021-187b-40a5-992a-e95a83a2076b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:00:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-922686360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce09376c-b62c-4b33-808b-33921492fb8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b678082633942a69b09419e9d69fbb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:00:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:00:52Z,use_quota=True,user_id='2f5951441916479b99535634d5f72ee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:00:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-94d4d340-85d1-4e10-b87f-614a6327b0d9 tempest-TestImageHashVerification-276828311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2119beb-348b-4389-9e09-014c9278c759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-94d4d340-85d1-4e10-b87f-614a6327b0d9 tempest-TestImageHashVerification-276828311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2119beb-348b-4389-9e09-014c9278c759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:00:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-94d4d340-85d1-4e10-b87f-614a6327b0d9 tempest-TestImageHashVerification-276828311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5831ed0-642d-49dc-8902-8d30fa339b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-94d4d340-85d1-4e10-b87f-614a6327b0d9 tempest-TestImageHashVerification-276828311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5831ed0-642d-49dc-8902-8d30fa339b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce09376c-b62c-4b33-808b-33921492fb8b', 'volume_name': 'volume-ce09376c-b62c-4b33-808b-33921492fb8b', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:00:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-94d4d340-85d1-4e10-b87f-614a6327b0d9 tempest-TestImageHashVerification-276828311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac31e23d-614e-485c-a299-7dd7e2994fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-94d4d340-85d1-4e10-b87f-614a6327b0d9 tempest-TestImageHashVerification-276828311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac31e23d-614e-485c-a299-7dd7e2994fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:00:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-94d4d340-85d1-4e10-b87f-614a6327b0d9 tempest-TestImageHashVerification-276828311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c49187d-d886-418e-8bd6-2df8abcee822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:52 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-94d4d340-85d1-4e10-b87f-614a6327b0d9 tempest-TestImageHashVerification-276828311 None] Volume ce09376c-b62c-4b33-808b-33921492fb8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce09376c-b62c-4b33-808b-33921492fb8b', 'volume_size': 1} Nov 06 18:00:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-94d4d340-85d1-4e10-b87f-614a6327b0d9 tempest-TestImageHashVerification-276828311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:00:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-94d4d340-85d1-4e10-b87f-614a6327b0d9 tempest-TestImageHashVerification-276828311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:00:52 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-94d4d340-85d1-4e10-b87f-614a6327b0d9 tempest-TestImageHashVerification-276828311 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:00:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-922686360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce09376c-b62c-4b33-808b-33921492fb8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b678082633942a69b09419e9d69fbb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:00:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:00:52Z,use_quota=True,user_id='2f5951441916479b99535634d5f72ee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:00:52 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-94d4d340-85d1-4e10-b87f-614a6327b0d9 tempest-TestImageHashVerification-276828311 None] Creating volume ce09376c-b62c-4b33-808b-33921492fb8b {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:00:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-94d4d340-85d1-4e10-b87f-614a6327b0d9 tempest-TestImageHashVerification-276828311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:00:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-94d4d340-85d1-4e10-b87f-614a6327b0d9 tempest-TestImageHashVerification-276828311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:00:52 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-94d4d340-85d1-4e10-b87f-614a6327b0d9 tempest-TestImageHashVerification-276828311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:00:52 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-94d4d340-85d1-4e10-b87f-614a6327b0d9 tempest-TestImageHashVerification-276828311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:00:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-94d4d340-85d1-4e10-b87f-614a6327b0d9 tempest-TestImageHashVerification-276828311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:00:52 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-94d4d340-85d1-4e10-b87f-614a6327b0d9 tempest-TestImageHashVerification-276828311 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:00:52 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-94d4d340-85d1-4e10-b87f-614a6327b0d9 tempest-TestImageHashVerification-276828311 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:00:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-94d4d340-85d1-4e10-b87f-614a6327b0d9 tempest-TestImageHashVerification-276828311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ce09376c-b62c-4b33-808b-33921492fb8b 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:52 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-de8e4dd7-69c9-4fbb-8b4f-bca65a823389 tempest-ProjectReaderTests-271704049 None] Volume volume-dc5a43e0-87c3-4be2-8ed4-e40d491ccd55 (dc5a43e0-87c3-4be2-8ed4-e40d491ccd55): created successfully Nov 06 18:00:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-de8e4dd7-69c9-4fbb-8b4f-bca65a823389 tempest-ProjectReaderTests-271704049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb6d5f2f-8648-4003-8866-b8a812c7343e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:00:52 devstack sudo[103655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ce09376c-b62c-4b33-808b-33921492fb8b 1073741824 Nov 06 18:00:52 devstack sudo[103655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-de8e4dd7-69c9-4fbb-8b4f-bca65a823389 tempest-ProjectReaderTests-271704049 None] Flow 'volume_create_manager' (e9b80368-038b-4343-a65b-b3be5a2c4010) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:00:52 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-de8e4dd7-69c9-4fbb-8b4f-bca65a823389 tempest-ProjectReaderTests-271704049 None] Created volume successfully. Nov 06 18:00:53 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8b998c1d-7531-453f-8d55-461271d92cb1 tempest-ProjectReaderTests-271704049 None] Acquiring lock "cinder-dc5a43e0-87c3-4be2-8ed4-e40d491ccd55-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:00:53 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8b998c1d-7531-453f-8d55-461271d92cb1 tempest-ProjectReaderTests-271704049 None] Lock "cinder-dc5a43e0-87c3-4be2-8ed4-e40d491ccd55-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:00:53 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8b998c1d-7531-453f-8d55-461271d92cb1 tempest-ProjectReaderTests-271704049 None] Acquiring lock "cinder-quobyte-dc5a43e0-87c3-4be2-8ed4-e40d491ccd55" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:00:53 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8b998c1d-7531-453f-8d55-461271d92cb1 tempest-ProjectReaderTests-271704049 None] Lock "cinder-quobyte-dc5a43e0-87c3-4be2-8ed4-e40d491ccd55" acquired by "delete_volume" :: waited 0.038s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:00:53 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc28f419-1ebd-4b05-8a06-7d41f0165530]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:00:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8b998c1d-7531-453f-8d55-461271d92cb1 tempest-ProjectReaderTests-271704049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-dc5a43e0-87c3-4be2-8ed4-e40d491ccd55 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:53 devstack sudo[103655]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-94d4d340-85d1-4e10-b87f-614a6327b0d9 tempest-TestImageHashVerification-276828311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ce09376c-b62c-4b33-808b-33921492fb8b 1073741824" returned: 0 in 0.867s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-94d4d340-85d1-4e10-b87f-614a6327b0d9 tempest-TestImageHashVerification-276828311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ce09376c-b62c-4b33-808b-33921492fb8b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:53 devstack sudo[103664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ce09376c-b62c-4b33-808b-33921492fb8b Nov 06 18:00:53 devstack sudo[103664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:53 devstack sudo[103663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-dc5a43e0-87c3-4be2-8ed4-e40d491ccd55 Nov 06 18:00:53 devstack sudo[103663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:53 devstack sudo[103664]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-94d4d340-85d1-4e10-b87f-614a6327b0d9 tempest-TestImageHashVerification-276828311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ce09376c-b62c-4b33-808b-33921492fb8b" returned: 0 in 0.294s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-94d4d340-85d1-4e10-b87f-614a6327b0d9 tempest-TestImageHashVerification-276828311 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:00:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-94d4d340-85d1-4e10-b87f-614a6327b0d9 tempest-TestImageHashVerification-276828311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.234s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:00:53 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-94d4d340-85d1-4e10-b87f-614a6327b0d9 tempest-TestImageHashVerification-276828311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c49187d-d886-418e-8bd6-2df8abcee822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce09376c-b62c-4b33-808b-33921492fb8b', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:00:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-94d4d340-85d1-4e10-b87f-614a6327b0d9 tempest-TestImageHashVerification-276828311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3efba9d0-c7a3-47f5-91ab-09b9a629db66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:54 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-94d4d340-85d1-4e10-b87f-614a6327b0d9 tempest-TestImageHashVerification-276828311 None] Volume volume-ce09376c-b62c-4b33-808b-33921492fb8b (ce09376c-b62c-4b33-808b-33921492fb8b): created successfully Nov 06 18:00:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-94d4d340-85d1-4e10-b87f-614a6327b0d9 tempest-TestImageHashVerification-276828311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3efba9d0-c7a3-47f5-91ab-09b9a629db66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:00:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-94d4d340-85d1-4e10-b87f-614a6327b0d9 tempest-TestImageHashVerification-276828311 None] Flow 'volume_create_manager' (bbbf634d-055d-4ce6-836c-38ae64080a15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:00:54 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-94d4d340-85d1-4e10-b87f-614a6327b0d9 tempest-TestImageHashVerification-276828311 None] Created volume successfully. Nov 06 18:00:54 devstack sudo[103663]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8b998c1d-7531-453f-8d55-461271d92cb1 tempest-ProjectReaderTests-271704049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-dc5a43e0-87c3-4be2-8ed4-e40d491ccd55" returned: 0 in 0.575s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8b998c1d-7531-453f-8d55-461271d92cb1 tempest-ProjectReaderTests-271704049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-dc5a43e0-87c3-4be2-8ed4-e40d491ccd55 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:54 devstack sudo[103671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-dc5a43e0-87c3-4be2-8ed4-e40d491ccd55 Nov 06 18:00:54 devstack sudo[103671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:54 devstack sudo[103671]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8b998c1d-7531-453f-8d55-461271d92cb1 tempest-ProjectReaderTests-271704049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-dc5a43e0-87c3-4be2-8ed4-e40d491ccd55" returned: 0 in 0.268s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:54 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8b998c1d-7531-453f-8d55-461271d92cb1 tempest-ProjectReaderTests-271704049 None] Lock "cinder-quobyte-dc5a43e0-87c3-4be2-8ed4-e40d491ccd55" released by "delete_volume" :: held 0.950s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:00:54 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 18:00:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:00:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:00:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:00:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:00:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:00:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:54 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-8b998c1d-7531-453f-8d55-461271d92cb1 tempest-ProjectReaderTests-271704049 None] Created reservations ['66545edc-736e-4628-a082-b845079f3ce7', '24d897c9-67c1-4761-816d-5c3bcbc76b37', '2152d0aa-8fa0-457f-8c51-9a8007ccf6aa', '5f08556f-429e-4db4-bdba-c5d93f0a5071'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:00:54 devstack sudo[103674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:00:54 devstack sudo[103674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8b998c1d-7531-453f-8d55-461271d92cb1 tempest-ProjectReaderTests-271704049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:00:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8b998c1d-7531-453f-8d55-461271d92cb1 tempest-ProjectReaderTests-271704049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:00:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8b998c1d-7531-453f-8d55-461271d92cb1 tempest-ProjectReaderTests-271704049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:00:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8b998c1d-7531-453f-8d55-461271d92cb1 tempest-ProjectReaderTests-271704049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:00:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8b998c1d-7531-453f-8d55-461271d92cb1 tempest-ProjectReaderTests-271704049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:00:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8b998c1d-7531-453f-8d55-461271d92cb1 tempest-ProjectReaderTests-271704049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:54 devstack sudo[103676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:00:54 devstack sudo[103676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:54 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-3ea7ec52-3b73-4046-af43-7c53ffb44a70 tempest-TestStampPattern-1009226522 None] Acquiring lock "cinder-d2b696d5-ed98-4c74-8324-5877f1541563-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:00:54 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-3ea7ec52-3b73-4046-af43-7c53ffb44a70 tempest-TestStampPattern-1009226522 None] Lock "cinder-d2b696d5-ed98-4c74-8324-5877f1541563-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:00:54 devstack sudo[103674]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.526s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:55 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:00:55 devstack sudo[103676]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:55 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running periodic task VolumeManager._thread_info {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 18:00:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] thread count: 28 {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 18:00:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] thread info: [<_MainThread(MainThread, started 133940619505792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 18:00:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-3ea7ec52-3b73-4046-af43-7c53ffb44a70 tempest-TestStampPattern-1009226522 None] Acquiring lock "cinder-quobyte-d2b696d5-ed98-4c74-8324-5877f1541563" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:00:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8b998c1d-7531-453f-8d55-461271d92cb1 tempest-ProjectReaderTests-271704049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.431s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:55 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-8b998c1d-7531-453f-8d55-461271d92cb1 tempest-ProjectReaderTests-271704049 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:00:55 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-8b998c1d-7531-453f-8d55-461271d92cb1 tempest-ProjectReaderTests-271704049 None] Deleted volume successfully. Nov 06 18:00:55 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:00:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] Flow 'volume_create_manager' (fe764d40-a966-4a1f-b7a0-b1758d6c0075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:00:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03787b83-7de4-4905-95d7-9d6099954ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-3ea7ec52-3b73-4046-af43-7c53ffb44a70 tempest-TestStampPattern-1009226522 None] Lock "cinder-quobyte-d2b696d5-ed98-4c74-8324-5877f1541563" acquired by "delete_volume" :: waited 0.067s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:00:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03787b83-7de4-4905-95d7-9d6099954ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:00:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=203ea7a3-2b75-45bc-998e-f61b6951d49c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd27e0dd61a44b78af4da6d8524ed517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:00:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:00:55Z,use_quota=True,user_id='4037b1ee4e534e32a30c87209894dc93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:00:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4852bbd-17bf-4252-8ada-9a4683ca9fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4852bbd-17bf-4252-8ada-9a4683ca9fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:00:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c44bac1c-5cfc-4d0c-9b97-864b42c9112b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:55 devstack cinder-volume[87068]: DEBUG cinder.image.glance [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] Creating Keystone auth plugin from conf {{(pid=87068) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 18:00:55 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[75303de6-d64e-403d-a5db-2d8fffc4e3b1]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:00:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8b998c1d-7531-453f-8d55-461271d92cb1 tempest-ProjectReaderTests-271704049 None] Lock "cinder-dc5a43e0-87c3-4be2-8ed4-e40d491ccd55-delete_volume" released by "delete_volume" :: held 1.917s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:00:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3ea7ec52-3b73-4046-af43-7c53ffb44a70 tempest-TestStampPattern-1009226522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d2b696d5-ed98-4c74-8324-5877f1541563 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:55 devstack sudo[103714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d2b696d5-ed98-4c74-8324-5877f1541563 Nov 06 18:00:55 devstack sudo[103714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c44bac1c-5cfc-4d0c-9b97-864b42c9112b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '203ea7a3-2b75-45bc-998e-f61b6951d49c', 'volume_name': 'volume-203ea7a3-2b75-45bc-998e-f61b6951d49c', 'volume_size': 1, 'image_id': '72d27068-80ea-4c03-835e-392206f5d5a4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/72d27068-80ea-4c03-835e-392206f5d5a4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '04f542eebd7a2af9465aa5c5b7089b47', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fd27e0dd61a44b78af4da6d8524ed517', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '721c0f1a04ed94d127b2af97c90d9fe5a99a11b0736eaedee65a6b5699668c81e6339dc272495a7e21d35e9b5d91e72c3720d32e2c31e349c792bc722d6525c7', 'id': '72d27068-80ea-4c03-835e-392206f5d5a4', 'created_at': datetime.datetime(2026, 11, 6, 17, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 17, 0, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/72d27068-80ea-4c03-835e-392206f5d5a4/file', 'properties': {}}, 'image_service': }' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:00:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31f3442e-03ff-4767-b606-33ed4c6a22d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31f3442e-03ff-4767-b606-33ed4c6a22d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:00:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (308ac31d-e2c6-44a7-aac2-7a5c131f7903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:55 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] Volume 203ea7a3-2b75-45bc-998e-f61b6951d49c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-203ea7a3-2b75-45bc-998e-f61b6951d49c', 'volume_size': 1, 'image_id': '72d27068-80ea-4c03-835e-392206f5d5a4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/72d27068-80ea-4c03-835e-392206f5d5a4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '04f542eebd7a2af9465aa5c5b7089b47', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fd27e0dd61a44b78af4da6d8524ed517', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '721c0f1a04ed94d127b2af97c90d9fe5a99a11b0736eaedee65a6b5699668c81e6339dc272495a7e21d35e9b5d91e72c3720d32e2c31e349c792bc722d6525c7', 'id': '72d27068-80ea-4c03-835e-392206f5d5a4', 'created_at': datetime.datetime(2026, 11, 6, 17, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 17, 0, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/72d27068-80ea-4c03-835e-392206f5d5a4/file', 'properties': {}}, 'image_service': } Nov 06 18:00:55 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] Trying to clone 203ea7a3-2b75-45bc-998e-f61b6951d49c from image 72d27068-80ea-4c03-835e-392206f5d5a4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/72d27068-80ea-4c03-835e-392206f5d5a4', 'metadata': {}}]). {{(pid=87068) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 18:00:55 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_72d27068-80ea-4c03-835e-392206f5d5a4_u0r21hmcdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87068) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 06 18:00:55 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] Image download 0.00 MB at 0.00 MB/s Nov 06 18:00:55 devstack sudo[103714]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3ea7ec52-3b73-4046-af43-7c53ffb44a70 tempest-TestStampPattern-1009226522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d2b696d5-ed98-4c74-8324-5877f1541563" returned: 0 in 0.482s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3ea7ec52-3b73-4046-af43-7c53ffb44a70 tempest-TestStampPattern-1009226522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d2b696d5-ed98-4c74-8324-5877f1541563 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:55 devstack sudo[103722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d2b696d5-ed98-4c74-8324-5877f1541563 Nov 06 18:00:55 devstack sudo[103722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:55 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d96ae80-0497-4462-94db-dc58db89ea6d]: (4, 'raw') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:00:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_72d27068-80ea-4c03-835e-392206f5d5a4_u0r21hmcdevstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3772ea43-0d15-4b0c-8e56-d7d3582b54b7 tempest-TestImageHashVerification-276828311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:00:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3772ea43-0d15-4b0c-8e56-d7d3582b54b7 tempest-TestImageHashVerification-276828311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:00:55 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff511ee0-965c-4d82-b45f-858b0247d1e4]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:00:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3772ea43-0d15-4b0c-8e56-d7d3582b54b7 tempest-TestImageHashVerification-276828311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ce09376c-b62c-4b33-808b-33921492fb8b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:55 devstack sudo[103724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_72d27068-80ea-4c03-835e-392206f5d5a4_u0r21hmcdevstack@QuobyteHD Nov 06 18:00:55 devstack sudo[103724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:56 devstack sudo[103725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ce09376c-b62c-4b33-808b-33921492fb8b Nov 06 18:00:56 devstack sudo[103725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:56 devstack sudo[103722]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3ea7ec52-3b73-4046-af43-7c53ffb44a70 tempest-TestStampPattern-1009226522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d2b696d5-ed98-4c74-8324-5877f1541563" returned: 0 in 0.330s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:56 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-3ea7ec52-3b73-4046-af43-7c53ffb44a70 tempest-TestStampPattern-1009226522 None] Lock "cinder-quobyte-d2b696d5-ed98-4c74-8324-5877f1541563" released by "delete_volume" :: held 0.965s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:00:56 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-3ea7ec52-3b73-4046-af43-7c53ffb44a70 tempest-TestStampPattern-1009226522 None] Created reservations ['844e99fb-47f0-48c3-9e0d-ae4f2b68dec2', 'bfeef403-67b7-4ac6-b70c-87c29d77a51f', '09674acc-5b99-49e9-b66c-43b63e35dfe0', 'cc811624-8620-4430-924e-ec29b80f0692'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:00:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3ea7ec52-3b73-4046-af43-7c53ffb44a70 tempest-TestStampPattern-1009226522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:00:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3ea7ec52-3b73-4046-af43-7c53ffb44a70 tempest-TestStampPattern-1009226522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:00:56 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3ea7ec52-3b73-4046-af43-7c53ffb44a70 tempest-TestStampPattern-1009226522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:00:56 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3ea7ec52-3b73-4046-af43-7c53ffb44a70 tempest-TestStampPattern-1009226522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:00:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3ea7ec52-3b73-4046-af43-7c53ffb44a70 tempest-TestStampPattern-1009226522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:00:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3ea7ec52-3b73-4046-af43-7c53ffb44a70 tempest-TestStampPattern-1009226522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:56 devstack sudo[103724]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_72d27068-80ea-4c03-835e-392206f5d5a4_u0r21hmcdevstack@QuobyteHD" returned: 0 in 0.531s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_72d27068-80ea-4c03-835e-392206f5d5a4_u0r21hmcdevstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:56 devstack sudo[103732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:00:56 devstack sudo[103732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:56 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-98375ed5-29ae-4b30-a7db-3e0a01f881c0 tempest-ProjectReaderTests-271704049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:00:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-98375ed5-29ae-4b30-a7db-3e0a01f881c0 tempest-ProjectReaderTests-271704049 None] Flow 'volume_create_manager' (25ef95f8-37e5-4df6-91b4-dd50d00f89ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:00:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-98375ed5-29ae-4b30-a7db-3e0a01f881c0 tempest-ProjectReaderTests-271704049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b8f21c2-4272-41f4-a9f5-3ed6bf1b5506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:56 devstack sudo[103725]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-98375ed5-29ae-4b30-a7db-3e0a01f881c0 tempest-ProjectReaderTests-271704049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b8f21c2-4272-41f4-a9f5-3ed6bf1b5506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:00:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2024004864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6f2f96a-c1e5-404e-be88-4b741a778866,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28ccefaa8eaa4710bb5c331cb928dc03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:00:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:00:56Z,use_quota=True,user_id='066e7381e1c541f1a333bab780e9078c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:00:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-98375ed5-29ae-4b30-a7db-3e0a01f881c0 tempest-ProjectReaderTests-271704049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8e52039-22dc-4a9d-bef1-4e5b44845280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-98375ed5-29ae-4b30-a7db-3e0a01f881c0 tempest-ProjectReaderTests-271704049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8e52039-22dc-4a9d-bef1-4e5b44845280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:00:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-98375ed5-29ae-4b30-a7db-3e0a01f881c0 tempest-ProjectReaderTests-271704049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58f92d14-dc2f-4d71-acee-12754e46311e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-98375ed5-29ae-4b30-a7db-3e0a01f881c0 tempest-ProjectReaderTests-271704049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58f92d14-dc2f-4d71-acee-12754e46311e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6f2f96a-c1e5-404e-be88-4b741a778866', 'volume_name': 'volume-b6f2f96a-c1e5-404e-be88-4b741a778866', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:00:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-98375ed5-29ae-4b30-a7db-3e0a01f881c0 tempest-ProjectReaderTests-271704049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5c666a8-38a6-42ea-b58f-ddf5c5c527f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-98375ed5-29ae-4b30-a7db-3e0a01f881c0 tempest-ProjectReaderTests-271704049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5c666a8-38a6-42ea-b58f-ddf5c5c527f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:00:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-98375ed5-29ae-4b30-a7db-3e0a01f881c0 tempest-ProjectReaderTests-271704049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e5090d2-af28-47cb-9a76-47ed102a898c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:00:56 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-98375ed5-29ae-4b30-a7db-3e0a01f881c0 tempest-ProjectReaderTests-271704049 None] Volume b6f2f96a-c1e5-404e-be88-4b741a778866: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6f2f96a-c1e5-404e-be88-4b741a778866', 'volume_size': 1} Nov 06 18:00:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-98375ed5-29ae-4b30-a7db-3e0a01f881c0 tempest-ProjectReaderTests-271704049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:00:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3772ea43-0d15-4b0c-8e56-d7d3582b54b7 tempest-TestImageHashVerification-276828311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ce09376c-b62c-4b33-808b-33921492fb8b" returned: 0 in 0.580s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:56 devstack sudo[103735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_72d27068-80ea-4c03-835e-392206f5d5a4_u0r21hmcdevstack@QuobyteHD Nov 06 18:00:56 devstack sudo[103735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:56 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9db73e-dbda-41c4-8038-b01985023363]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:00:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3772ea43-0d15-4b0c-8e56-d7d3582b54b7 tempest-TestImageHashVerification-276828311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ce09376c-b62c-4b33-808b-33921492fb8b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:56 devstack sudo[103732]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3ea7ec52-3b73-4046-af43-7c53ffb44a70 tempest-TestStampPattern-1009226522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.277s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:56 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-3ea7ec52-3b73-4046-af43-7c53ffb44a70 tempest-TestStampPattern-1009226522 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:00:56 devstack sudo[103739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ce09376c-b62c-4b33-808b-33921492fb8b Nov 06 18:00:56 devstack sudo[103739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:56 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-3ea7ec52-3b73-4046-af43-7c53ffb44a70 tempest-TestStampPattern-1009226522 None] Deleted volume successfully. Nov 06 18:00:56 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-3ea7ec52-3b73-4046-af43-7c53ffb44a70 tempest-TestStampPattern-1009226522 None] Lock "cinder-d2b696d5-ed98-4c74-8324-5877f1541563-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:00:56 devstack sudo[103735]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_72d27068-80ea-4c03-835e-392206f5d5a4_u0r21hmcdevstack@QuobyteHD" returned: 1 in 0.369s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_72d27068-80ea-4c03-835e-392206f5d5a4_u0r21hmcdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 18:00:56 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] Temporary image 72d27068-80ea-4c03-835e-392206f5d5a4 is fetched for user 4037b1ee4e534e32a30c87209894dc93. {{(pid=87068) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 06 18:00:56 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[14976766-1d22-4d0a-a72a-4d2d402950d4]: (4, 'raw') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:00:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_72d27068-80ea-4c03-835e-392206f5d5a4_u0r21hmcdevstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:56 devstack sudo[103739]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3772ea43-0d15-4b0c-8e56-d7d3582b54b7 tempest-TestImageHashVerification-276828311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ce09376c-b62c-4b33-808b-33921492fb8b" returned: 0 in 0.384s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3772ea43-0d15-4b0c-8e56-d7d3582b54b7 tempest-TestImageHashVerification-276828311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ce09376c-b62c-4b33-808b-33921492fb8b /opt/stack/data/cinder/conversion/ce09376c-b62c-4b33-808b-33921492fb8b.temp_image.5c3cd526-8e3c-45a6-b2ac-09be64674777a0xo6sdr.img {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:56 devstack sudo[103746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_72d27068-80ea-4c03-835e-392206f5d5a4_u0r21hmcdevstack@QuobyteHD Nov 06 18:00:56 devstack sudo[103746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:56 devstack sudo[103749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ce09376c-b62c-4b33-808b-33921492fb8b /opt/stack/data/cinder/conversion/ce09376c-b62c-4b33-808b-33921492fb8b.temp_image.5c3cd526-8e3c-45a6-b2ac-09be64674777a0xo6sdr.img Nov 06 18:00:56 devstack sudo[103749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:57 devstack sudo[103746]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_72d27068-80ea-4c03-835e-392206f5d5a4_u0r21hmcdevstack@QuobyteHD" returned: 0 in 0.342s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_72d27068-80ea-4c03-835e-392206f5d5a4_u0r21hmcdevstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:00:57 devstack sudo[103758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_72d27068-80ea-4c03-835e-392206f5d5a4_u0r21hmcdevstack@QuobyteHD Nov 06 18:00:57 devstack sudo[103758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:00:57 devstack sudo[103758]: pam_unix(sudo:session): session closed for user root Nov 06 18:00:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_72d27068-80ea-4c03-835e-392206f5d5a4_u0r21hmcdevstack@QuobyteHD" returned: 1 in 0.475s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:00:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_72d27068-80ea-4c03-835e-392206f5d5a4_u0r21hmcdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 18:00:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:01:04 devstack sudo[103749]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3772ea43-0d15-4b0c-8e56-d7d3582b54b7 tempest-TestImageHashVerification-276828311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ce09376c-b62c-4b33-808b-33921492fb8b /opt/stack/data/cinder/conversion/ce09376c-b62c-4b33-808b-33921492fb8b.temp_image.5c3cd526-8e3c-45a6-b2ac-09be64674777a0xo6sdr.img" returned: 0 in 7.187s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:04 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7520c3-3095-41bf-96b5-549626e0f425]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:01:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3772ea43-0d15-4b0c-8e56-d7d3582b54b7 tempest-TestImageHashVerification-276828311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ce09376c-b62c-4b33-808b-33921492fb8b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:04 devstack sudo[103773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ce09376c-b62c-4b33-808b-33921492fb8b Nov 06 18:01:04 devstack sudo[103773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:04 devstack sudo[103773]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3772ea43-0d15-4b0c-8e56-d7d3582b54b7 tempest-TestImageHashVerification-276828311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ce09376c-b62c-4b33-808b-33921492fb8b" returned: 0 in 0.592s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:04 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-3772ea43-0d15-4b0c-8e56-d7d3582b54b7 tempest-TestImageHashVerification-276828311 None] Image conversion details: src /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ce09376c-b62c-4b33-808b-33921492fb8b, size 1024.00 MB, duration 7.19 sec, destination /opt/stack/data/cinder/conversion/ce09376c-b62c-4b33-808b-33921492fb8b.temp_image.5c3cd526-8e3c-45a6-b2ac-09be64674777a0xo6sdr.img {{(pid=87068) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 18:01:04 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-3772ea43-0d15-4b0c-8e56-d7d3582b54b7 tempest-TestImageHashVerification-276828311 None] Converted 1024.00 MB image at 142.46 MB/s Nov 06 18:01:04 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:UPDATE=150,cinder:DELETE=11,cinder:SELECT=112,cinder:INSERT=40 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:01:04 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:UPDATE=161,cinder:SELECT=121,cinder:INSERT=35,cinder:DELETE=14 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:01:04 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-3772ea43-0d15-4b0c-8e56-d7d3582b54b7 tempest-TestImageHashVerification-276828311 None] 5c3cd526-8e3c-45a6-b2ac-09be64674777 was raw, no need to convert to raw {{(pid=87068) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 06 18:01:13 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc163202-62d7-4670-a9fe-8a2251d5238e tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:01:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cc163202-62d7-4670-a9fe-8a2251d5238e tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Flow 'volume_create_manager' (d68c81d8-9154-46a7-b231-342c57df9e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:01:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cc163202-62d7-4670-a9fe-8a2251d5238e tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e413217-8460-4916-bcb6-9574032bca94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:01:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cc163202-62d7-4670-a9fe-8a2251d5238e tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e413217-8460-4916-bcb6-9574032bca94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:01:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1903650208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fc24918-2104-4b21-8475-9117d4e64118,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f19627bcb7a48d58e54e425857a7fa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:01:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:01:13Z,use_quota=True,user_id='8cc677400e774293a7b2e42e0b2a1834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cc163202-62d7-4670-a9fe-8a2251d5238e tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dd340eb-60c4-4b6d-8435-9849b8f307ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:01:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cc163202-62d7-4670-a9fe-8a2251d5238e tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dd340eb-60c4-4b6d-8435-9849b8f307ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cc163202-62d7-4670-a9fe-8a2251d5238e tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7192e11-9bf9-4091-86d1-32c975cfe87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:01:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cc163202-62d7-4670-a9fe-8a2251d5238e tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7192e11-9bf9-4091-86d1-32c975cfe87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fc24918-2104-4b21-8475-9117d4e64118', 'volume_name': 'volume-1fc24918-2104-4b21-8475-9117d4e64118', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cc163202-62d7-4670-a9fe-8a2251d5238e tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f835a55d-e1e8-4435-8b54-ec9ea4fd3144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:01:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cc163202-62d7-4670-a9fe-8a2251d5238e tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f835a55d-e1e8-4435-8b54-ec9ea4fd3144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cc163202-62d7-4670-a9fe-8a2251d5238e tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bff7df96-aee2-4223-960a-df3caff3a47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:01:13 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-cc163202-62d7-4670-a9fe-8a2251d5238e tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Volume 1fc24918-2104-4b21-8475-9117d4e64118: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fc24918-2104-4b21-8475-9117d4e64118', 'volume_size': 1} Nov 06 18:01:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cc163202-62d7-4670-a9fe-8a2251d5238e tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:01:23 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:01:23 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=1 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:01:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3772ea43-0d15-4b0c-8e56-d7d3582b54b7 tempest-TestImageHashVerification-276828311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.271s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:01:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3772ea43-0d15-4b0c-8e56-d7d3582b54b7 tempest-TestImageHashVerification-276828311 None] Uploaded volume to glance image-id: 5c3cd526-8e3c-45a6-b2ac-09be64674777. {{(pid=87068) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 06 18:01:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-98375ed5-29ae-4b30-a7db-3e0a01f881c0 tempest-ProjectReaderTests-271704049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 27.657s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:01:24 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-98375ed5-29ae-4b30-a7db-3e0a01f881c0 tempest-ProjectReaderTests-271704049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:00:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2024004864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6f2f96a-c1e5-404e-be88-4b741a778866,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28ccefaa8eaa4710bb5c331cb928dc03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:00:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:00:56Z,use_quota=True,user_id='066e7381e1c541f1a333bab780e9078c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:01:24 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-98375ed5-29ae-4b30-a7db-3e0a01f881c0 tempest-ProjectReaderTests-271704049 None] Creating volume b6f2f96a-c1e5-404e-be88-4b741a778866 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:01:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-98375ed5-29ae-4b30-a7db-3e0a01f881c0 tempest-ProjectReaderTests-271704049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:01:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-98375ed5-29ae-4b30-a7db-3e0a01f881c0 tempest-ProjectReaderTests-271704049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:01:24 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-98375ed5-29ae-4b30-a7db-3e0a01f881c0 tempest-ProjectReaderTests-271704049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:01:24 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-98375ed5-29ae-4b30-a7db-3e0a01f881c0 tempest-ProjectReaderTests-271704049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:01:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-98375ed5-29ae-4b30-a7db-3e0a01f881c0 tempest-ProjectReaderTests-271704049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:01:24 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-98375ed5-29ae-4b30-a7db-3e0a01f881c0 tempest-ProjectReaderTests-271704049 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:01:24 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-98375ed5-29ae-4b30-a7db-3e0a01f881c0 tempest-ProjectReaderTests-271704049 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:01:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-98375ed5-29ae-4b30-a7db-3e0a01f881c0 tempest-ProjectReaderTests-271704049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b6f2f96a-c1e5-404e-be88-4b741a778866 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:24 devstack sudo[103787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b6f2f96a-c1e5-404e-be88-4b741a778866 1073741824 Nov 06 18:01:24 devstack sudo[103787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:24 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-3772ea43-0d15-4b0c-8e56-d7d3582b54b7 tempest-TestImageHashVerification-276828311 None] Copy volume to image completed successfully. Nov 06 18:01:24 devstack sudo[103787]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-98375ed5-29ae-4b30-a7db-3e0a01f881c0 tempest-ProjectReaderTests-271704049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b6f2f96a-c1e5-404e-be88-4b741a778866 1073741824" returned: 0 in 0.427s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-98375ed5-29ae-4b30-a7db-3e0a01f881c0 tempest-ProjectReaderTests-271704049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b6f2f96a-c1e5-404e-be88-4b741a778866 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:24 devstack sudo[103792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b6f2f96a-c1e5-404e-be88-4b741a778866 Nov 06 18:01:24 devstack sudo[103792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:24 devstack sudo[103792]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-98375ed5-29ae-4b30-a7db-3e0a01f881c0 tempest-ProjectReaderTests-271704049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b6f2f96a-c1e5-404e-be88-4b741a778866" returned: 0 in 0.279s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:24 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-98375ed5-29ae-4b30-a7db-3e0a01f881c0 tempest-ProjectReaderTests-271704049 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:01:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-98375ed5-29ae-4b30-a7db-3e0a01f881c0 tempest-ProjectReaderTests-271704049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:01:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 27.267s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:01:24 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:00:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=203ea7a3-2b75-45bc-998e-f61b6951d49c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd27e0dd61a44b78af4da6d8524ed517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:00:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:00:55Z,use_quota=True,user_id='4037b1ee4e534e32a30c87209894dc93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:01:24 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] Creating volume 203ea7a3-2b75-45bc-998e-f61b6951d49c {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:01:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:01:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:01:24 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:01:24 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:01:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:01:24 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:01:24 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:01:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-203ea7a3-2b75-45bc-998e-f61b6951d49c 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-98375ed5-29ae-4b30-a7db-3e0a01f881c0 tempest-ProjectReaderTests-271704049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e5090d2-af28-47cb-9a76-47ed102a898c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6f2f96a-c1e5-404e-be88-4b741a778866', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:24 devstack sudo[103795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-203ea7a3-2b75-45bc-998e-f61b6951d49c 1073741824 Nov 06 18:01:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-98375ed5-29ae-4b30-a7db-3e0a01f881c0 tempest-ProjectReaderTests-271704049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89c6bbcc-35ae-4129-9624-7655537950d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:01:24 devstack sudo[103795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:24 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-98375ed5-29ae-4b30-a7db-3e0a01f881c0 tempest-ProjectReaderTests-271704049 None] Volume volume-b6f2f96a-c1e5-404e-be88-4b741a778866 (b6f2f96a-c1e5-404e-be88-4b741a778866): created successfully Nov 06 18:01:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-98375ed5-29ae-4b30-a7db-3e0a01f881c0 tempest-ProjectReaderTests-271704049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89c6bbcc-35ae-4129-9624-7655537950d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-98375ed5-29ae-4b30-a7db-3e0a01f881c0 tempest-ProjectReaderTests-271704049 None] Flow 'volume_create_manager' (25ef95f8-37e5-4df6-91b4-dd50d00f89ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:01:24 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-98375ed5-29ae-4b30-a7db-3e0a01f881c0 tempest-ProjectReaderTests-271704049 None] Created volume successfully. Nov 06 18:01:25 devstack sudo[103795]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-203ea7a3-2b75-45bc-998e-f61b6951d49c 1073741824" returned: 0 in 0.448s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-203ea7a3-2b75-45bc-998e-f61b6951d49c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:25 devstack sudo[103800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-203ea7a3-2b75-45bc-998e-f61b6951d49c Nov 06 18:01:25 devstack sudo[103800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:25 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d845e135-499c-44d8-bb96-66435aac7e28 tempest-TestImageHashVerification-276828311 None] Acquiring lock "cinder-ce09376c-b62c-4b33-808b-33921492fb8b-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:01:25 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d845e135-499c-44d8-bb96-66435aac7e28 tempest-TestImageHashVerification-276828311 None] Lock "cinder-ce09376c-b62c-4b33-808b-33921492fb8b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:01:25 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d845e135-499c-44d8-bb96-66435aac7e28 tempest-TestImageHashVerification-276828311 None] Acquiring lock "cinder-quobyte-ce09376c-b62c-4b33-808b-33921492fb8b" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:01:25 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d823c3a3-38f5-40d7-9913-a1bca9921aad tempest-ProjectReaderTests-271704049 None] Acquiring lock "cinder-b6f2f96a-c1e5-404e-be88-4b741a778866-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:01:25 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d845e135-499c-44d8-bb96-66435aac7e28 tempest-TestImageHashVerification-276828311 None] Lock "cinder-quobyte-ce09376c-b62c-4b33-808b-33921492fb8b" acquired by "delete_volume" :: waited 0.032s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:01:25 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d823c3a3-38f5-40d7-9913-a1bca9921aad tempest-ProjectReaderTests-271704049 None] Lock "cinder-b6f2f96a-c1e5-404e-be88-4b741a778866-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:01:25 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb264bba-6b7e-44f5-bec3-4dc5c9489db3]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:01:25 devstack sudo[103800]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d845e135-499c-44d8-bb96-66435aac7e28 tempest-TestImageHashVerification-276828311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ce09376c-b62c-4b33-808b-33921492fb8b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-203ea7a3-2b75-45bc-998e-f61b6951d49c" returned: 0 in 0.337s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:25 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:01:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:01:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cc163202-62d7-4670-a9fe-8a2251d5238e tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.562s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:01:25 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-cc163202-62d7-4670-a9fe-8a2251d5238e tempest-CreateVolumesFromSourceVolumeTest-306738423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:01:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1903650208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fc24918-2104-4b21-8475-9117d4e64118,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f19627bcb7a48d58e54e425857a7fa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:01:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:01:13Z,use_quota=True,user_id='8cc677400e774293a7b2e42e0b2a1834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:01:25 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-cc163202-62d7-4670-a9fe-8a2251d5238e tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Creating volume 1fc24918-2104-4b21-8475-9117d4e64118 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:01:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cc163202-62d7-4670-a9fe-8a2251d5238e tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:01:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cc163202-62d7-4670-a9fe-8a2251d5238e tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:01:25 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-cc163202-62d7-4670-a9fe-8a2251d5238e tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:01:25 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-cc163202-62d7-4670-a9fe-8a2251d5238e tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:01:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cc163202-62d7-4670-a9fe-8a2251d5238e tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:01:25 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-cc163202-62d7-4670-a9fe-8a2251d5238e tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:01:25 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-cc163202-62d7-4670-a9fe-8a2251d5238e tempest-CreateVolumesFromSourceVolumeTest-306738423 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:01:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cc163202-62d7-4670-a9fe-8a2251d5238e tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1fc24918-2104-4b21-8475-9117d4e64118 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:25 devstack sudo[103804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1fc24918-2104-4b21-8475-9117d4e64118 1073741824 Nov 06 18:01:25 devstack sudo[103804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:25 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d823c3a3-38f5-40d7-9913-a1bca9921aad tempest-ProjectReaderTests-271704049 None] Acquiring lock "cinder-quobyte-b6f2f96a-c1e5-404e-be88-4b741a778866" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:01:25 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d823c3a3-38f5-40d7-9913-a1bca9921aad tempest-ProjectReaderTests-271704049 None] Lock "cinder-quobyte-b6f2f96a-c1e5-404e-be88-4b741a778866" acquired by "delete_volume" :: waited 0.018s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:01:25 devstack cinder-volume[87068]: DEBUG cinder.volume.volume_utils [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] Attempting download of 72d27068-80ea-4c03-835e-392206f5d5a4 ((None, [{'url': 'file:///opt/stack/data/glance/images/72d27068-80ea-4c03-835e-392206f5d5a4', 'metadata': {}}])) to volume 203ea7a3-2b75-45bc-998e-f61b6951d49c. {{(pid=87068) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 18:01:25 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dca290a-3c03-4f11-a6b9-e6f5e3692275]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:01:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d823c3a3-38f5-40d7-9913-a1bca9921aad tempest-ProjectReaderTests-271704049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b6f2f96a-c1e5-404e-be88-4b741a778866 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:25 devstack sudo[103803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ce09376c-b62c-4b33-808b-33921492fb8b Nov 06 18:01:25 devstack sudo[103803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:25 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae71bcd9-80dd-4321-846b-126982e72931]: (4, 'raw') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:01:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_72d27068-80ea-4c03-835e-392206f5d5a4_lwkjqstv {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:25 devstack sudo[103806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b6f2f96a-c1e5-404e-be88-4b741a778866 Nov 06 18:01:25 devstack sudo[103806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:25 devstack sudo[103808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_72d27068-80ea-4c03-835e-392206f5d5a4_lwkjqstv Nov 06 18:01:25 devstack sudo[103808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:26 devstack sudo[103803]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d845e135-499c-44d8-bb96-66435aac7e28 tempest-TestImageHashVerification-276828311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ce09376c-b62c-4b33-808b-33921492fb8b" returned: 0 in 0.516s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d845e135-499c-44d8-bb96-66435aac7e28 tempest-TestImageHashVerification-276828311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ce09376c-b62c-4b33-808b-33921492fb8b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:26 devstack sudo[103823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ce09376c-b62c-4b33-808b-33921492fb8b Nov 06 18:01:26 devstack sudo[103823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:26 devstack sudo[103808]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_72d27068-80ea-4c03-835e-392206f5d5a4_lwkjqstv" returned: 0 in 0.371s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_72d27068-80ea-4c03-835e-392206f5d5a4_lwkjqstv {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:26 devstack sudo[103804]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cc163202-62d7-4670-a9fe-8a2251d5238e tempest-CreateVolumesFromSourceVolumeTest-306738423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1fc24918-2104-4b21-8475-9117d4e64118 1073741824" returned: 0 in 0.544s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:26 devstack sudo[103806]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d823c3a3-38f5-40d7-9913-a1bca9921aad tempest-ProjectReaderTests-271704049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b6f2f96a-c1e5-404e-be88-4b741a778866" returned: 0 in 0.450s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d823c3a3-38f5-40d7-9913-a1bca9921aad tempest-ProjectReaderTests-271704049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b6f2f96a-c1e5-404e-be88-4b741a778866 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:26 devstack sudo[103826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b6f2f96a-c1e5-404e-be88-4b741a778866 Nov 06 18:01:26 devstack sudo[103826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cc163202-62d7-4670-a9fe-8a2251d5238e tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1fc24918-2104-4b21-8475-9117d4e64118 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:26 devstack sudo[103828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1fc24918-2104-4b21-8475-9117d4e64118 Nov 06 18:01:26 devstack sudo[103828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:26 devstack sudo[103825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_72d27068-80ea-4c03-835e-392206f5d5a4_lwkjqstv Nov 06 18:01:26 devstack sudo[103825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:26 devstack sudo[103823]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d845e135-499c-44d8-bb96-66435aac7e28 tempest-TestImageHashVerification-276828311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ce09376c-b62c-4b33-808b-33921492fb8b" returned: 0 in 0.289s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:26 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d845e135-499c-44d8-bb96-66435aac7e28 tempest-TestImageHashVerification-276828311 None] Lock "cinder-quobyte-ce09376c-b62c-4b33-808b-33921492fb8b" released by "delete_volume" :: held 0.869s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:01:26 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-d845e135-499c-44d8-bb96-66435aac7e28 tempest-TestImageHashVerification-276828311 None] Created reservations ['db6a5aea-d0b1-4ae0-8afc-b31be4448c62', '88fd2fb5-1078-4586-afde-fbefb524e08a', '6527099c-f42a-40b4-bb87-1ed6fd5e9d0b', '18c6acd2-49b9-464e-8898-cfa93e1bfdfa'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:01:26 devstack sudo[103828]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cc163202-62d7-4670-a9fe-8a2251d5238e tempest-CreateVolumesFromSourceVolumeTest-306738423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1fc24918-2104-4b21-8475-9117d4e64118" returned: 0 in 0.273s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:26 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-cc163202-62d7-4670-a9fe-8a2251d5238e tempest-CreateVolumesFromSourceVolumeTest-306738423 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:01:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cc163202-62d7-4670-a9fe-8a2251d5238e tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:01:26 devstack sudo[103826]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:26 devstack sudo[103825]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d823c3a3-38f5-40d7-9913-a1bca9921aad tempest-ProjectReaderTests-271704049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b6f2f96a-c1e5-404e-be88-4b741a778866" returned: 0 in 0.338s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cc163202-62d7-4670-a9fe-8a2251d5238e tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bff7df96-aee2-4223-960a-df3caff3a47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fc24918-2104-4b21-8475-9117d4e64118', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cc163202-62d7-4670-a9fe-8a2251d5238e tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6549c1d7-a61c-4fd7-b2d4-1fb47d0ae04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:01:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_72d27068-80ea-4c03-835e-392206f5d5a4_lwkjqstv" returned: 1 in 0.397s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_72d27068-80ea-4c03-835e-392206f5d5a4_lwkjqstv' failed. Not Retrying. {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 18:01:26 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8f6c2a-4e87-428b-8e56-8cb32710f977]: (4, 'raw') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:01:26 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d823c3a3-38f5-40d7-9913-a1bca9921aad tempest-ProjectReaderTests-271704049 None] Lock "cinder-quobyte-b6f2f96a-c1e5-404e-be88-4b741a778866" released by "delete_volume" :: held 0.882s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:01:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_72d27068-80ea-4c03-835e-392206f5d5a4_u0r21hmcdevstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:26 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-cc163202-62d7-4670-a9fe-8a2251d5238e tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Volume volume-1fc24918-2104-4b21-8475-9117d4e64118 (1fc24918-2104-4b21-8475-9117d4e64118): created successfully Nov 06 18:01:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cc163202-62d7-4670-a9fe-8a2251d5238e tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6549c1d7-a61c-4fd7-b2d4-1fb47d0ae04e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cc163202-62d7-4670-a9fe-8a2251d5238e tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Flow 'volume_create_manager' (d68c81d8-9154-46a7-b231-342c57df9e59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:01:26 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-cc163202-62d7-4670-a9fe-8a2251d5238e tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Created volume successfully. Nov 06 18:01:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d845e135-499c-44d8-bb96-66435aac7e28 tempest-TestImageHashVerification-276828311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:01:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d845e135-499c-44d8-bb96-66435aac7e28 tempest-TestImageHashVerification-276828311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:01:26 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d845e135-499c-44d8-bb96-66435aac7e28 tempest-TestImageHashVerification-276828311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:01:26 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d845e135-499c-44d8-bb96-66435aac7e28 tempest-TestImageHashVerification-276828311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:01:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d845e135-499c-44d8-bb96-66435aac7e28 tempest-TestImageHashVerification-276828311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:01:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d845e135-499c-44d8-bb96-66435aac7e28 tempest-TestImageHashVerification-276828311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:26 devstack sudo[103836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_72d27068-80ea-4c03-835e-392206f5d5a4_u0r21hmcdevstack@QuobyteHD Nov 06 18:01:26 devstack sudo[103836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:26 devstack sudo[103837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:01:26 devstack sudo[103837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:26 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-d823c3a3-38f5-40d7-9913-a1bca9921aad tempest-ProjectReaderTests-271704049 None] Created reservations ['5c76137e-d63e-4be9-b911-5f110e26c427', '5e3fd21e-bc0a-4ea8-be01-aa61064d0fdb', 'ec22e087-9f86-4c9c-a667-b0fa6a022ddf', 'b28fb3cf-5b83-4a7e-a0d9-50cce44ead8c'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:01:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d823c3a3-38f5-40d7-9913-a1bca9921aad tempest-ProjectReaderTests-271704049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:01:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d823c3a3-38f5-40d7-9913-a1bca9921aad tempest-ProjectReaderTests-271704049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:01:26 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d823c3a3-38f5-40d7-9913-a1bca9921aad tempest-ProjectReaderTests-271704049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:01:26 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d823c3a3-38f5-40d7-9913-a1bca9921aad tempest-ProjectReaderTests-271704049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:01:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d823c3a3-38f5-40d7-9913-a1bca9921aad tempest-ProjectReaderTests-271704049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:01:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d823c3a3-38f5-40d7-9913-a1bca9921aad tempest-ProjectReaderTests-271704049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:26 devstack sudo[103840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:01:26 devstack sudo[103840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:27 devstack sudo[103837]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d845e135-499c-44d8-bb96-66435aac7e28 tempest-TestImageHashVerification-276828311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.284s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:27 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-d845e135-499c-44d8-bb96-66435aac7e28 tempest-TestImageHashVerification-276828311 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:01:27 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-d845e135-499c-44d8-bb96-66435aac7e28 tempest-TestImageHashVerification-276828311 None] Deleted volume successfully. Nov 06 18:01:27 devstack sudo[103836]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_72d27068-80ea-4c03-835e-392206f5d5a4_u0r21hmcdevstack@QuobyteHD" returned: 0 in 0.436s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_72d27068-80ea-4c03-835e-392206f5d5a4_u0r21hmcdevstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:27 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d845e135-499c-44d8-bb96-66435aac7e28 tempest-TestImageHashVerification-276828311 None] Lock "cinder-ce09376c-b62c-4b33-808b-33921492fb8b-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:01:27 devstack sudo[103840]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d823c3a3-38f5-40d7-9913-a1bca9921aad tempest-ProjectReaderTests-271704049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.288s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:27 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-d823c3a3-38f5-40d7-9913-a1bca9921aad tempest-ProjectReaderTests-271704049 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:01:27 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-d823c3a3-38f5-40d7-9913-a1bca9921aad tempest-ProjectReaderTests-271704049 None] Deleted volume successfully. Nov 06 18:01:27 devstack sudo[103845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_72d27068-80ea-4c03-835e-392206f5d5a4_u0r21hmcdevstack@QuobyteHD Nov 06 18:01:27 devstack sudo[103845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:27 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d823c3a3-38f5-40d7-9913-a1bca9921aad tempest-ProjectReaderTests-271704049 None] Lock "cinder-b6f2f96a-c1e5-404e-be88-4b741a778866-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:01:27 devstack sudo[103845]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_72d27068-80ea-4c03-835e-392206f5d5a4_u0r21hmcdevstack@QuobyteHD" returned: 1 in 0.361s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_72d27068-80ea-4c03-835e-392206f5d5a4_u0r21hmcdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 18:01:27 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] 72d27068-80ea-4c03-835e-392206f5d5a4 was raw, converting to qcow2 {{(pid=87068) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 06 18:01:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_72d27068-80ea-4c03-835e-392206f5d5a4_u0r21hmcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-203ea7a3-2b75-45bc-998e-f61b6951d49c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:27 devstack sudo[103851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_72d27068-80ea-4c03-835e-392206f5d5a4_u0r21hmcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-203ea7a3-2b75-45bc-998e-f61b6951d49c Nov 06 18:01:27 devstack sudo[103851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:27 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-80ba5d05-3c6a-4fb7-b7f4-a8076e05fdd8 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:01:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-80ba5d05-3c6a-4fb7-b7f4-a8076e05fdd8 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Flow 'volume_create_manager' (c657b667-d93f-4da3-b6d9-5b3d40c08c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:01:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-80ba5d05-3c6a-4fb7-b7f4-a8076e05fdd8 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e57b1711-7ab9-4f2e-9922-8d62dc092a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:01:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-80ba5d05-3c6a-4fb7-b7f4-a8076e05fdd8 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e57b1711-7ab9-4f2e-9922-8d62dc092a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-550857529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d507b664-fbab-4184-bc17-ee9b17d474c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f19627bcb7a48d58e54e425857a7fa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:01:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:01:27Z,use_quota=True,user_id='8cc677400e774293a7b2e42e0b2a1834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-80ba5d05-3c6a-4fb7-b7f4-a8076e05fdd8 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f0d6f23-e390-4c41-8135-7bb015112d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:01:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-80ba5d05-3c6a-4fb7-b7f4-a8076e05fdd8 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f0d6f23-e390-4c41-8135-7bb015112d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-80ba5d05-3c6a-4fb7-b7f4-a8076e05fdd8 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e5f3c63-ee28-4e88-8698-29423dc53845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:01:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-80ba5d05-3c6a-4fb7-b7f4-a8076e05fdd8 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e5f3c63-ee28-4e88-8698-29423dc53845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd507b664-fbab-4184-bc17-ee9b17d474c0', 'volume_name': 'volume-d507b664-fbab-4184-bc17-ee9b17d474c0', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-80ba5d05-3c6a-4fb7-b7f4-a8076e05fdd8 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0df0d2aa-a1e9-4a66-ae92-ff13657e03c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:01:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-80ba5d05-3c6a-4fb7-b7f4-a8076e05fdd8 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0df0d2aa-a1e9-4a66-ae92-ff13657e03c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-80ba5d05-3c6a-4fb7-b7f4-a8076e05fdd8 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68c2448f-5bbd-4a2e-af9c-93c5e1fc9d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:01:27 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-80ba5d05-3c6a-4fb7-b7f4-a8076e05fdd8 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Volume d507b664-fbab-4184-bc17-ee9b17d474c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d507b664-fbab-4184-bc17-ee9b17d474c0', 'volume_size': 1} Nov 06 18:01:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-80ba5d05-3c6a-4fb7-b7f4-a8076e05fdd8 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:01:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-80ba5d05-3c6a-4fb7-b7f4-a8076e05fdd8 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:01:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-80ba5d05-3c6a-4fb7-b7f4-a8076e05fdd8 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-550857529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d507b664-fbab-4184-bc17-ee9b17d474c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f19627bcb7a48d58e54e425857a7fa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:01:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:01:27Z,use_quota=True,user_id='8cc677400e774293a7b2e42e0b2a1834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:01:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-80ba5d05-3c6a-4fb7-b7f4-a8076e05fdd8 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Creating volume d507b664-fbab-4184-bc17-ee9b17d474c0 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:01:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-80ba5d05-3c6a-4fb7-b7f4-a8076e05fdd8 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:01:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-80ba5d05-3c6a-4fb7-b7f4-a8076e05fdd8 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:01:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-80ba5d05-3c6a-4fb7-b7f4-a8076e05fdd8 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:01:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-80ba5d05-3c6a-4fb7-b7f4-a8076e05fdd8 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:01:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-80ba5d05-3c6a-4fb7-b7f4-a8076e05fdd8 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:01:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-80ba5d05-3c6a-4fb7-b7f4-a8076e05fdd8 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:01:27 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-80ba5d05-3c6a-4fb7-b7f4-a8076e05fdd8 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:01:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-80ba5d05-3c6a-4fb7-b7f4-a8076e05fdd8 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d507b664-fbab-4184-bc17-ee9b17d474c0 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:27 devstack sudo[103853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d507b664-fbab-4184-bc17-ee9b17d474c0 1073741824 Nov 06 18:01:27 devstack sudo[103853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:28 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-35fd057c-3ec2-4313-8cb8-dc373bfe24a9 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:01:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-35fd057c-3ec2-4313-8cb8-dc373bfe24a9 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Flow 'volume_create_manager' (890ddff6-7cf6-4e81-97f7-9e46bc414db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:01:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-35fd057c-3ec2-4313-8cb8-dc373bfe24a9 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f582a5d-db7f-42a7-87b6-483ec07fb5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:01:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-35fd057c-3ec2-4313-8cb8-dc373bfe24a9 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f582a5d-db7f-42a7-87b6-483ec07fb5ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1835292464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c58ed1b-1cd6-43aa-9c23-a6c54b23e4b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f19627bcb7a48d58e54e425857a7fa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:01:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:01:28Z,use_quota=True,user_id='8cc677400e774293a7b2e42e0b2a1834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-35fd057c-3ec2-4313-8cb8-dc373bfe24a9 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f31075ba-fdd4-4c0a-b99c-7afbce0b7410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:01:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-35fd057c-3ec2-4313-8cb8-dc373bfe24a9 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f31075ba-fdd4-4c0a-b99c-7afbce0b7410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-35fd057c-3ec2-4313-8cb8-dc373bfe24a9 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4641611c-043d-458f-854f-639676674595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:01:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-35fd057c-3ec2-4313-8cb8-dc373bfe24a9 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4641611c-043d-458f-854f-639676674595) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c58ed1b-1cd6-43aa-9c23-a6c54b23e4b7', 'volume_name': 'volume-6c58ed1b-1cd6-43aa-9c23-a6c54b23e4b7', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-35fd057c-3ec2-4313-8cb8-dc373bfe24a9 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f20863f-39f4-4be9-bd08-d60df2da3c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:01:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-35fd057c-3ec2-4313-8cb8-dc373bfe24a9 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f20863f-39f4-4be9-bd08-d60df2da3c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-35fd057c-3ec2-4313-8cb8-dc373bfe24a9 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e4a1ab1-9acf-4eb6-b397-4edb6f70afdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:01:28 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-35fd057c-3ec2-4313-8cb8-dc373bfe24a9 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Volume 6c58ed1b-1cd6-43aa-9c23-a6c54b23e4b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c58ed1b-1cd6-43aa-9c23-a6c54b23e4b7', 'volume_size': 1} Nov 06 18:01:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-35fd057c-3ec2-4313-8cb8-dc373bfe24a9 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:01:28 devstack sudo[103851]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_72d27068-80ea-4c03-835e-392206f5d5a4_u0r21hmcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-203ea7a3-2b75-45bc-998e-f61b6951d49c" returned: 0 in 0.730s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:28 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_72d27068-80ea-4c03-835e-392206f5d5a4_u0r21hmcdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-203ea7a3-2b75-45bc-998e-f61b6951d49c {{(pid=87068) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 18:01:28 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] Converted 0.00 MB image at 0.00 MB/s Nov 06 18:01:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-203ea7a3-2b75-45bc-998e-f61b6951d49c 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:28 devstack sudo[103862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-203ea7a3-2b75-45bc-998e-f61b6951d49c 1G Nov 06 18:01:28 devstack sudo[103862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:28 devstack sudo[103853]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-80ba5d05-3c6a-4fb7-b7f4-a8076e05fdd8 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d507b664-fbab-4184-bc17-ee9b17d474c0 1073741824" returned: 0 in 0.769s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-80ba5d05-3c6a-4fb7-b7f4-a8076e05fdd8 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d507b664-fbab-4184-bc17-ee9b17d474c0 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:28 devstack sudo[103864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d507b664-fbab-4184-bc17-ee9b17d474c0 Nov 06 18:01:28 devstack sudo[103864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:28 devstack sudo[103862]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-203ea7a3-2b75-45bc-998e-f61b6951d49c 1G" returned: 0 in 0.550s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:28 devstack cinder-volume[87068]: DEBUG cinder.volume.volume_utils [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] Downloaded image 72d27068-80ea-4c03-835e-392206f5d5a4 ((None, [{'url': 'file:///opt/stack/data/glance/images/72d27068-80ea-4c03-835e-392206f5d5a4', 'metadata': {}}])) to volume 203ea7a3-2b75-45bc-998e-f61b6951d49c successfully. {{(pid=87068) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 18:01:28 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] Temporary image 72d27068-80ea-4c03-835e-392206f5d5a4 for user 4037b1ee4e534e32a30c87209894dc93 is deleted. {{(pid=87068) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 06 18:01:28 devstack cinder-volume[87068]: DEBUG cinder.volume.volume_utils [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] Marking volume 203ea7a3-2b75-45bc-998e-f61b6951d49c as bootable. {{(pid=87068) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 18:01:28 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] Copying metadata from image 72d27068-80ea-4c03-835e-392206f5d5a4 to 203ea7a3-2b75-45bc-998e-f61b6951d49c. {{(pid=87068) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 18:01:28 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] Creating volume glance metadata for volume 203ea7a3-2b75-45bc-998e-f61b6951d49c backed by image 72d27068-80ea-4c03-835e-392206f5d5a4 with: {'image_id': '72d27068-80ea-4c03-835e-392206f5d5a4', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '04f542eebd7a2af9465aa5c5b7089b47', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87068) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 18:01:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (308ac31d-e2c6-44a7-aac2-7a5c131f7903) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-203ea7a3-2b75-45bc-998e-f61b6951d49c', 'volume_size': 1, 'image_id': '72d27068-80ea-4c03-835e-392206f5d5a4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/72d27068-80ea-4c03-835e-392206f5d5a4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '04f542eebd7a2af9465aa5c5b7089b47', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fd27e0dd61a44b78af4da6d8524ed517', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '721c0f1a04ed94d127b2af97c90d9fe5a99a11b0736eaedee65a6b5699668c81e6339dc272495a7e21d35e9b5d91e72c3720d32e2c31e349c792bc722d6525c7', 'id': '72d27068-80ea-4c03-835e-392206f5d5a4', 'created_at': datetime.datetime(2026, 11, 6, 17, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 17, 0, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/72d27068-80ea-4c03-835e-392206f5d5a4/file', 'properties': {}}, 'image_service': }' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bd3304f-b8cd-4e19-94cc-b35eadd1eba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:01:28 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] Volume volume-203ea7a3-2b75-45bc-998e-f61b6951d49c (203ea7a3-2b75-45bc-998e-f61b6951d49c): created successfully Nov 06 18:01:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bd3304f-b8cd-4e19-94cc-b35eadd1eba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] Flow 'volume_create_manager' (fe764d40-a966-4a1f-b7a0-b1758d6c0075) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:01:28 devstack sudo[103864]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-80ba5d05-3c6a-4fb7-b7f4-a8076e05fdd8 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d507b664-fbab-4184-bc17-ee9b17d474c0" returned: 0 in 0.443s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-80ba5d05-3c6a-4fb7-b7f4-a8076e05fdd8 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] <== create_volume: return (1294ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:01:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-80ba5d05-3c6a-4fb7-b7f4-a8076e05fdd8 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.297s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:01:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-35fd057c-3ec2-4313-8cb8-dc373bfe24a9 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.762s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:01:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-35fd057c-3ec2-4313-8cb8-dc373bfe24a9 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1835292464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c58ed1b-1cd6-43aa-9c23-a6c54b23e4b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f19627bcb7a48d58e54e425857a7fa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:01:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:01:28Z,use_quota=True,user_id='8cc677400e774293a7b2e42e0b2a1834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:01:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-35fd057c-3ec2-4313-8cb8-dc373bfe24a9 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Creating volume 6c58ed1b-1cd6-43aa-9c23-a6c54b23e4b7 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:01:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-35fd057c-3ec2-4313-8cb8-dc373bfe24a9 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:01:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-35fd057c-3ec2-4313-8cb8-dc373bfe24a9 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:01:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-35fd057c-3ec2-4313-8cb8-dc373bfe24a9 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:01:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-35fd057c-3ec2-4313-8cb8-dc373bfe24a9 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:01:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-35fd057c-3ec2-4313-8cb8-dc373bfe24a9 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:01:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-35fd057c-3ec2-4313-8cb8-dc373bfe24a9 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:01:28 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-35fd057c-3ec2-4313-8cb8-dc373bfe24a9 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:01:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-35fd057c-3ec2-4313-8cb8-dc373bfe24a9 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6c58ed1b-1cd6-43aa-9c23-a6c54b23e4b7 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:28 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-fd842e5a-6b32-47f0-bead-707260b1cdf9 tempest-VolumeImageDependencyTests-1275522647 None] Created volume successfully. Nov 06 18:01:29 devstack sudo[103870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6c58ed1b-1cd6-43aa-9c23-a6c54b23e4b7 1073741824 Nov 06 18:01:29 devstack sudo[103870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-80ba5d05-3c6a-4fb7-b7f4-a8076e05fdd8 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68c2448f-5bbd-4a2e-af9c-93c5e1fc9d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d507b664-fbab-4184-bc17-ee9b17d474c0', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-80ba5d05-3c6a-4fb7-b7f4-a8076e05fdd8 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21aaee32-e5c5-4e4c-8945-0bfa6b7be5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:01:29 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-80ba5d05-3c6a-4fb7-b7f4-a8076e05fdd8 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Volume volume-d507b664-fbab-4184-bc17-ee9b17d474c0 (d507b664-fbab-4184-bc17-ee9b17d474c0): created successfully Nov 06 18:01:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-80ba5d05-3c6a-4fb7-b7f4-a8076e05fdd8 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21aaee32-e5c5-4e4c-8945-0bfa6b7be5fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-80ba5d05-3c6a-4fb7-b7f4-a8076e05fdd8 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Flow 'volume_create_manager' (c657b667-d93f-4da3-b6d9-5b3d40c08c73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:01:29 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-80ba5d05-3c6a-4fb7-b7f4-a8076e05fdd8 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Created volume successfully. Nov 06 18:01:29 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a4a7dbe-81e6-4e73-8d46-979608053099 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:01:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8a4a7dbe-81e6-4e73-8d46-979608053099 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Flow 'volume_create_manager' (3b8c25d4-9575-4529-b502-db405053270e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:01:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8a4a7dbe-81e6-4e73-8d46-979608053099 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffef1ca4-7940-47e8-86a2-a8152a4dd966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:01:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8a4a7dbe-81e6-4e73-8d46-979608053099 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffef1ca4-7940-47e8-86a2-a8152a4dd966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1714701561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f23aab8-5689-4773-96a0-1068f9d3594a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f19627bcb7a48d58e54e425857a7fa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:01:29Z,use_quota=True,user_id='8cc677400e774293a7b2e42e0b2a1834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8a4a7dbe-81e6-4e73-8d46-979608053099 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f147e608-aeda-435f-a24d-211751c6d372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:01:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8a4a7dbe-81e6-4e73-8d46-979608053099 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f147e608-aeda-435f-a24d-211751c6d372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8a4a7dbe-81e6-4e73-8d46-979608053099 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7926ba4b-c17d-4630-8095-80349612b0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:01:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8a4a7dbe-81e6-4e73-8d46-979608053099 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7926ba4b-c17d-4630-8095-80349612b0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f23aab8-5689-4773-96a0-1068f9d3594a', 'volume_name': 'volume-6f23aab8-5689-4773-96a0-1068f9d3594a', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8a4a7dbe-81e6-4e73-8d46-979608053099 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f861b396-3fa7-4be3-9d62-c4faa51a66f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:01:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8a4a7dbe-81e6-4e73-8d46-979608053099 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f861b396-3fa7-4be3-9d62-c4faa51a66f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8a4a7dbe-81e6-4e73-8d46-979608053099 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ae72d28-3df0-48dc-88ff-c70d10fa68e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:01:29 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-8a4a7dbe-81e6-4e73-8d46-979608053099 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Volume 6f23aab8-5689-4773-96a0-1068f9d3594a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f23aab8-5689-4773-96a0-1068f9d3594a', 'volume_size': 1} Nov 06 18:01:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8a4a7dbe-81e6-4e73-8d46-979608053099 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:01:29 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-7817ff28-a78e-42bb-a3a0-5f9e6bbc366d tempest-ProjectReaderTests-271704049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:01:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7817ff28-a78e-42bb-a3a0-5f9e6bbc366d tempest-ProjectReaderTests-271704049 None] Flow 'volume_create_manager' (0b1a0149-5bc8-44d4-b573-3086c1169524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:01:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7817ff28-a78e-42bb-a3a0-5f9e6bbc366d tempest-ProjectReaderTests-271704049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55433990-1eb4-4840-9dfa-e788b02c8f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:01:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7817ff28-a78e-42bb-a3a0-5f9e6bbc366d tempest-ProjectReaderTests-271704049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55433990-1eb4-4840-9dfa-e788b02c8f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-999993091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0c0bfc1-faa7-4691-ae9c-4dcd224c4a0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28ccefaa8eaa4710bb5c331cb928dc03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:01:29Z,use_quota=True,user_id='066e7381e1c541f1a333bab780e9078c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7817ff28-a78e-42bb-a3a0-5f9e6bbc366d tempest-ProjectReaderTests-271704049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16504b86-2531-4949-9ef0-be8bbcb531b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:01:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7817ff28-a78e-42bb-a3a0-5f9e6bbc366d tempest-ProjectReaderTests-271704049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16504b86-2531-4949-9ef0-be8bbcb531b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7817ff28-a78e-42bb-a3a0-5f9e6bbc366d tempest-ProjectReaderTests-271704049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c5bd2fd-5c26-4ffa-8b6f-01efd8ef52ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:01:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7817ff28-a78e-42bb-a3a0-5f9e6bbc366d tempest-ProjectReaderTests-271704049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c5bd2fd-5c26-4ffa-8b6f-01efd8ef52ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0c0bfc1-faa7-4691-ae9c-4dcd224c4a0e', 'volume_name': 'volume-e0c0bfc1-faa7-4691-ae9c-4dcd224c4a0e', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7817ff28-a78e-42bb-a3a0-5f9e6bbc366d tempest-ProjectReaderTests-271704049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01154985-a3ef-49e3-b928-84614bcb4200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:01:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7817ff28-a78e-42bb-a3a0-5f9e6bbc366d tempest-ProjectReaderTests-271704049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01154985-a3ef-49e3-b928-84614bcb4200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7817ff28-a78e-42bb-a3a0-5f9e6bbc366d tempest-ProjectReaderTests-271704049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cfc5a84-59aa-44f6-9d94-cbf8c4b207dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:01:29 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-7817ff28-a78e-42bb-a3a0-5f9e6bbc366d tempest-ProjectReaderTests-271704049 None] Volume e0c0bfc1-faa7-4691-ae9c-4dcd224c4a0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0c0bfc1-faa7-4691-ae9c-4dcd224c4a0e', 'volume_size': 1} Nov 06 18:01:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7817ff28-a78e-42bb-a3a0-5f9e6bbc366d tempest-ProjectReaderTests-271704049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:01:29 devstack sudo[103870]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-35fd057c-3ec2-4313-8cb8-dc373bfe24a9 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6c58ed1b-1cd6-43aa-9c23-a6c54b23e4b7 1073741824" returned: 0 in 0.768s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:29 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b802729-a8f8-46b0-b155-22ab7a97d516 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:01:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1b802729-a8f8-46b0-b155-22ab7a97d516 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Flow 'volume_create_manager' (2c7dd14e-4a05-4071-ae84-92abfcea358f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:01:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1b802729-a8f8-46b0-b155-22ab7a97d516 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e904759-b57c-477b-b8a8-75e22d611f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:01:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1b802729-a8f8-46b0-b155-22ab7a97d516 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e904759-b57c-477b-b8a8-75e22d611f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2122892839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2b02f63-e6c2-4bd8-a8e9-35cfc178caf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f19627bcb7a48d58e54e425857a7fa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:01:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:01:30Z,use_quota=True,user_id='8cc677400e774293a7b2e42e0b2a1834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1b802729-a8f8-46b0-b155-22ab7a97d516 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab0cc321-5cc5-410f-8fc4-ea2d8754bdc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:01:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1b802729-a8f8-46b0-b155-22ab7a97d516 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab0cc321-5cc5-410f-8fc4-ea2d8754bdc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1b802729-a8f8-46b0-b155-22ab7a97d516 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ffdd48a-366f-4b4d-9469-de1214c27ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:01:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1b802729-a8f8-46b0-b155-22ab7a97d516 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ffdd48a-366f-4b4d-9469-de1214c27ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2b02f63-e6c2-4bd8-a8e9-35cfc178caf7', 'volume_name': 'volume-f2b02f63-e6c2-4bd8-a8e9-35cfc178caf7', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1b802729-a8f8-46b0-b155-22ab7a97d516 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d1e088f-abc3-4af6-89c2-27a0c8ba5d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:01:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1b802729-a8f8-46b0-b155-22ab7a97d516 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d1e088f-abc3-4af6-89c2-27a0c8ba5d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1b802729-a8f8-46b0-b155-22ab7a97d516 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ff024a1-7c78-456d-9f03-4166d0cc9f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:01:29 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-1b802729-a8f8-46b0-b155-22ab7a97d516 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Volume f2b02f63-e6c2-4bd8-a8e9-35cfc178caf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2b02f63-e6c2-4bd8-a8e9-35cfc178caf7', 'volume_size': 1} Nov 06 18:01:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1b802729-a8f8-46b0-b155-22ab7a97d516 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:01:29 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-bca5e2e6-bd0d-4150-9b66-db1a5e8d5652 tempest-VolumeImageDependencyTests-1275522647 None] Acquiring lock "cinder-203ea7a3-2b75-45bc-998e-f61b6951d49c-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:01:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-35fd057c-3ec2-4313-8cb8-dc373bfe24a9 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6c58ed1b-1cd6-43aa-9c23-a6c54b23e4b7 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:29 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-bca5e2e6-bd0d-4150-9b66-db1a5e8d5652 tempest-VolumeImageDependencyTests-1275522647 None] Lock "cinder-203ea7a3-2b75-45bc-998e-f61b6951d49c-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:01:29 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-70e65903-56e4-43c9-80d1-88761c09abd0 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:01:29 devstack sudo[103878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6c58ed1b-1cd6-43aa-9c23-a6c54b23e4b7 Nov 06 18:01:29 devstack sudo[103878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-70e65903-56e4-43c9-80d1-88761c09abd0 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Flow 'volume_create_manager' (fe60e741-d69b-42cf-8094-5b73849b9fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:01:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-70e65903-56e4-43c9-80d1-88761c09abd0 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bc57ae2-1094-4790-95b3-cb724a6784f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:01:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-70e65903-56e4-43c9-80d1-88761c09abd0 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bc57ae2-1094-4790-95b3-cb724a6784f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1177785525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2284efad-639c-4732-9c03-a2130e91306a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f19627bcb7a48d58e54e425857a7fa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:01:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:01:30Z,use_quota=True,user_id='8cc677400e774293a7b2e42e0b2a1834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-70e65903-56e4-43c9-80d1-88761c09abd0 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16955cb3-c5af-45e1-979f-164cce8f673f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:01:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-70e65903-56e4-43c9-80d1-88761c09abd0 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16955cb3-c5af-45e1-979f-164cce8f673f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-70e65903-56e4-43c9-80d1-88761c09abd0 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (470ffefa-95e2-4944-8802-b04a1daf83f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:01:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-70e65903-56e4-43c9-80d1-88761c09abd0 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (470ffefa-95e2-4944-8802-b04a1daf83f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2284efad-639c-4732-9c03-a2130e91306a', 'volume_name': 'volume-2284efad-639c-4732-9c03-a2130e91306a', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-70e65903-56e4-43c9-80d1-88761c09abd0 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54e60b2b-b74f-49ce-9b27-11a91b98aef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:01:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-70e65903-56e4-43c9-80d1-88761c09abd0 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54e60b2b-b74f-49ce-9b27-11a91b98aef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-70e65903-56e4-43c9-80d1-88761c09abd0 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aabdc060-b271-4008-bd29-0d774f7beeb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:01:30 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-70e65903-56e4-43c9-80d1-88761c09abd0 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Volume 2284efad-639c-4732-9c03-a2130e91306a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2284efad-639c-4732-9c03-a2130e91306a', 'volume_size': 1} Nov 06 18:01:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-70e65903-56e4-43c9-80d1-88761c09abd0 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:01:30 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-bca5e2e6-bd0d-4150-9b66-db1a5e8d5652 tempest-VolumeImageDependencyTests-1275522647 None] Acquiring lock "cinder-quobyte-203ea7a3-2b75-45bc-998e-f61b6951d49c" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:01:30 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-bca5e2e6-bd0d-4150-9b66-db1a5e8d5652 tempest-VolumeImageDependencyTests-1275522647 None] Lock "cinder-quobyte-203ea7a3-2b75-45bc-998e-f61b6951d49c" acquired by "delete_volume" :: waited 0.019s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:01:30 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61d47ba-3e95-4dff-b0f5-0eb2a49c1361]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:01:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bca5e2e6-bd0d-4150-9b66-db1a5e8d5652 tempest-VolumeImageDependencyTests-1275522647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-203ea7a3-2b75-45bc-998e-f61b6951d49c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:30 devstack sudo[103880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-203ea7a3-2b75-45bc-998e-f61b6951d49c Nov 06 18:01:30 devstack sudo[103880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:30 devstack sudo[103878]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-35fd057c-3ec2-4313-8cb8-dc373bfe24a9 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6c58ed1b-1cd6-43aa-9c23-a6c54b23e4b7" returned: 0 in 0.358s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-35fd057c-3ec2-4313-8cb8-dc373bfe24a9 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] <== create_volume: return (1342ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:01:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-35fd057c-3ec2-4313-8cb8-dc373bfe24a9 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.345s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:01:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8a4a7dbe-81e6-4e73-8d46-979608053099 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.841s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:01:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8a4a7dbe-81e6-4e73-8d46-979608053099 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1714701561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f23aab8-5689-4773-96a0-1068f9d3594a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f19627bcb7a48d58e54e425857a7fa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:01:29Z,use_quota=True,user_id='8cc677400e774293a7b2e42e0b2a1834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:01:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-8a4a7dbe-81e6-4e73-8d46-979608053099 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Creating volume 6f23aab8-5689-4773-96a0-1068f9d3594a {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:01:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8a4a7dbe-81e6-4e73-8d46-979608053099 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:01:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8a4a7dbe-81e6-4e73-8d46-979608053099 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:01:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8a4a7dbe-81e6-4e73-8d46-979608053099 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:01:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8a4a7dbe-81e6-4e73-8d46-979608053099 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:01:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8a4a7dbe-81e6-4e73-8d46-979608053099 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:01:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8a4a7dbe-81e6-4e73-8d46-979608053099 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:01:30 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-8a4a7dbe-81e6-4e73-8d46-979608053099 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:01:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8a4a7dbe-81e6-4e73-8d46-979608053099 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f23aab8-5689-4773-96a0-1068f9d3594a 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-35fd057c-3ec2-4313-8cb8-dc373bfe24a9 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e4a1ab1-9acf-4eb6-b397-4edb6f70afdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c58ed1b-1cd6-43aa-9c23-a6c54b23e4b7', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-35fd057c-3ec2-4313-8cb8-dc373bfe24a9 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81c9f56c-f800-4a0a-9455-be0a30328afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:01:30 devstack sudo[103884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f23aab8-5689-4773-96a0-1068f9d3594a 1073741824 Nov 06 18:01:30 devstack sudo[103884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:30 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-35fd057c-3ec2-4313-8cb8-dc373bfe24a9 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Volume volume-6c58ed1b-1cd6-43aa-9c23-a6c54b23e4b7 (6c58ed1b-1cd6-43aa-9c23-a6c54b23e4b7): created successfully Nov 06 18:01:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-35fd057c-3ec2-4313-8cb8-dc373bfe24a9 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81c9f56c-f800-4a0a-9455-be0a30328afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-35fd057c-3ec2-4313-8cb8-dc373bfe24a9 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Flow 'volume_create_manager' (890ddff6-7cf6-4e81-97f7-9e46bc414db7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:01:30 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-35fd057c-3ec2-4313-8cb8-dc373bfe24a9 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Created volume successfully. Nov 06 18:01:30 devstack sudo[103880]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bca5e2e6-bd0d-4150-9b66-db1a5e8d5652 tempest-VolumeImageDependencyTests-1275522647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-203ea7a3-2b75-45bc-998e-f61b6951d49c" returned: 0 in 0.428s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bca5e2e6-bd0d-4150-9b66-db1a5e8d5652 tempest-VolumeImageDependencyTests-1275522647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-203ea7a3-2b75-45bc-998e-f61b6951d49c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:30 devstack sudo[103891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-203ea7a3-2b75-45bc-998e-f61b6951d49c Nov 06 18:01:30 devstack sudo[103891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:30 devstack sudo[103884]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8a4a7dbe-81e6-4e73-8d46-979608053099 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f23aab8-5689-4773-96a0-1068f9d3594a 1073741824" returned: 0 in 0.505s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8a4a7dbe-81e6-4e73-8d46-979608053099 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f23aab8-5689-4773-96a0-1068f9d3594a {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:30 devstack sudo[103895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f23aab8-5689-4773-96a0-1068f9d3594a Nov 06 18:01:30 devstack sudo[103895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:30 devstack sudo[103891]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bca5e2e6-bd0d-4150-9b66-db1a5e8d5652 tempest-VolumeImageDependencyTests-1275522647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-203ea7a3-2b75-45bc-998e-f61b6951d49c" returned: 0 in 0.340s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:30 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-bca5e2e6-bd0d-4150-9b66-db1a5e8d5652 tempest-VolumeImageDependencyTests-1275522647 None] Lock "cinder-quobyte-203ea7a3-2b75-45bc-998e-f61b6951d49c" released by "delete_volume" :: held 0.833s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:01:30 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-bca5e2e6-bd0d-4150-9b66-db1a5e8d5652 tempest-VolumeImageDependencyTests-1275522647 None] Created reservations ['eb5fec4e-1e06-443a-a503-20e277d67552', '6170c98d-b9cd-4c98-abd0-52e6c57bda1f', 'd99a98ed-5fbd-420f-a149-52c590d22246', '724d1a0b-e1cc-4dc2-bd20-9c1f29a87188'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:01:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-bca5e2e6-bd0d-4150-9b66-db1a5e8d5652 tempest-VolumeImageDependencyTests-1275522647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:01:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-bca5e2e6-bd0d-4150-9b66-db1a5e8d5652 tempest-VolumeImageDependencyTests-1275522647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:01:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-bca5e2e6-bd0d-4150-9b66-db1a5e8d5652 tempest-VolumeImageDependencyTests-1275522647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:01:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-bca5e2e6-bd0d-4150-9b66-db1a5e8d5652 tempest-VolumeImageDependencyTests-1275522647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:01:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-bca5e2e6-bd0d-4150-9b66-db1a5e8d5652 tempest-VolumeImageDependencyTests-1275522647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:01:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bca5e2e6-bd0d-4150-9b66-db1a5e8d5652 tempest-VolumeImageDependencyTests-1275522647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:31 devstack sudo[103898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:01:31 devstack sudo[103898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:31 devstack sudo[103895]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8a4a7dbe-81e6-4e73-8d46-979608053099 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f23aab8-5689-4773-96a0-1068f9d3594a" returned: 0 in 0.321s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8a4a7dbe-81e6-4e73-8d46-979608053099 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:01:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8a4a7dbe-81e6-4e73-8d46-979608053099 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:01:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7817ff28-a78e-42bb-a3a0-5f9e6bbc366d tempest-ProjectReaderTests-271704049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.478s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:01:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7817ff28-a78e-42bb-a3a0-5f9e6bbc366d tempest-ProjectReaderTests-271704049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-999993091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0c0bfc1-faa7-4691-ae9c-4dcd224c4a0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28ccefaa8eaa4710bb5c331cb928dc03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:01:29Z,use_quota=True,user_id='066e7381e1c541f1a333bab780e9078c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:01:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-7817ff28-a78e-42bb-a3a0-5f9e6bbc366d tempest-ProjectReaderTests-271704049 None] Creating volume e0c0bfc1-faa7-4691-ae9c-4dcd224c4a0e {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:01:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7817ff28-a78e-42bb-a3a0-5f9e6bbc366d tempest-ProjectReaderTests-271704049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:01:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7817ff28-a78e-42bb-a3a0-5f9e6bbc366d tempest-ProjectReaderTests-271704049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:01:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7817ff28-a78e-42bb-a3a0-5f9e6bbc366d tempest-ProjectReaderTests-271704049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:01:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7817ff28-a78e-42bb-a3a0-5f9e6bbc366d tempest-ProjectReaderTests-271704049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:01:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7817ff28-a78e-42bb-a3a0-5f9e6bbc366d tempest-ProjectReaderTests-271704049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:01:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7817ff28-a78e-42bb-a3a0-5f9e6bbc366d tempest-ProjectReaderTests-271704049 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:01:31 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-7817ff28-a78e-42bb-a3a0-5f9e6bbc366d tempest-ProjectReaderTests-271704049 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:01:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7817ff28-a78e-42bb-a3a0-5f9e6bbc366d tempest-ProjectReaderTests-271704049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e0c0bfc1-faa7-4691-ae9c-4dcd224c4a0e 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8a4a7dbe-81e6-4e73-8d46-979608053099 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ae72d28-3df0-48dc-88ff-c70d10fa68e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f23aab8-5689-4773-96a0-1068f9d3594a', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:31 devstack sudo[103901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e0c0bfc1-faa7-4691-ae9c-4dcd224c4a0e 1073741824 Nov 06 18:01:31 devstack sudo[103901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8a4a7dbe-81e6-4e73-8d46-979608053099 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ff865b8-59a1-4be1-a169-a781f2856849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:01:31 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-8a4a7dbe-81e6-4e73-8d46-979608053099 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Volume volume-6f23aab8-5689-4773-96a0-1068f9d3594a (6f23aab8-5689-4773-96a0-1068f9d3594a): created successfully Nov 06 18:01:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8a4a7dbe-81e6-4e73-8d46-979608053099 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ff865b8-59a1-4be1-a169-a781f2856849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8a4a7dbe-81e6-4e73-8d46-979608053099 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Flow 'volume_create_manager' (3b8c25d4-9575-4529-b502-db405053270e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:01:31 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-8a4a7dbe-81e6-4e73-8d46-979608053099 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Created volume successfully. Nov 06 18:01:31 devstack sudo[103898]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bca5e2e6-bd0d-4150-9b66-db1a5e8d5652 tempest-VolumeImageDependencyTests-1275522647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.267s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:31 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-bca5e2e6-bd0d-4150-9b66-db1a5e8d5652 tempest-VolumeImageDependencyTests-1275522647 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:01:31 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-bca5e2e6-bd0d-4150-9b66-db1a5e8d5652 tempest-VolumeImageDependencyTests-1275522647 None] Deleted volume successfully. Nov 06 18:01:31 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-bca5e2e6-bd0d-4150-9b66-db1a5e8d5652 tempest-VolumeImageDependencyTests-1275522647 None] Lock "cinder-203ea7a3-2b75-45bc-998e-f61b6951d49c-delete_volume" released by "delete_volume" :: held 1.448s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:01:31 devstack sudo[103901]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7817ff28-a78e-42bb-a3a0-5f9e6bbc366d tempest-ProjectReaderTests-271704049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e0c0bfc1-faa7-4691-ae9c-4dcd224c4a0e 1073741824" returned: 0 in 0.478s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7817ff28-a78e-42bb-a3a0-5f9e6bbc366d tempest-ProjectReaderTests-271704049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e0c0bfc1-faa7-4691-ae9c-4dcd224c4a0e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:31 devstack sudo[103907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e0c0bfc1-faa7-4691-ae9c-4dcd224c4a0e Nov 06 18:01:31 devstack sudo[103907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:31 devstack sudo[103907]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7817ff28-a78e-42bb-a3a0-5f9e6bbc366d tempest-ProjectReaderTests-271704049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e0c0bfc1-faa7-4691-ae9c-4dcd224c4a0e" returned: 0 in 0.249s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7817ff28-a78e-42bb-a3a0-5f9e6bbc366d tempest-ProjectReaderTests-271704049 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:01:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7817ff28-a78e-42bb-a3a0-5f9e6bbc366d tempest-ProjectReaderTests-271704049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:01:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1b802729-a8f8-46b0-b155-22ab7a97d516 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.056s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:01:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1b802729-a8f8-46b0-b155-22ab7a97d516 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2122892839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2b02f63-e6c2-4bd8-a8e9-35cfc178caf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f19627bcb7a48d58e54e425857a7fa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:01:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:01:30Z,use_quota=True,user_id='8cc677400e774293a7b2e42e0b2a1834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:01:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-1b802729-a8f8-46b0-b155-22ab7a97d516 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Creating volume f2b02f63-e6c2-4bd8-a8e9-35cfc178caf7 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:01:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1b802729-a8f8-46b0-b155-22ab7a97d516 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:01:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1b802729-a8f8-46b0-b155-22ab7a97d516 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:01:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1b802729-a8f8-46b0-b155-22ab7a97d516 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:01:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1b802729-a8f8-46b0-b155-22ab7a97d516 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:01:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1b802729-a8f8-46b0-b155-22ab7a97d516 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:01:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1b802729-a8f8-46b0-b155-22ab7a97d516 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:01:31 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-1b802729-a8f8-46b0-b155-22ab7a97d516 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:01:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1b802729-a8f8-46b0-b155-22ab7a97d516 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f2b02f63-e6c2-4bd8-a8e9-35cfc178caf7 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7817ff28-a78e-42bb-a3a0-5f9e6bbc366d tempest-ProjectReaderTests-271704049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cfc5a84-59aa-44f6-9d94-cbf8c4b207dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0c0bfc1-faa7-4691-ae9c-4dcd224c4a0e', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7817ff28-a78e-42bb-a3a0-5f9e6bbc366d tempest-ProjectReaderTests-271704049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (271d3d33-55f1-4311-ae3d-c80062830597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:01:32 devstack sudo[103910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f2b02f63-e6c2-4bd8-a8e9-35cfc178caf7 1073741824 Nov 06 18:01:32 devstack sudo[103910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:32 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-7817ff28-a78e-42bb-a3a0-5f9e6bbc366d tempest-ProjectReaderTests-271704049 None] Volume volume-e0c0bfc1-faa7-4691-ae9c-4dcd224c4a0e (e0c0bfc1-faa7-4691-ae9c-4dcd224c4a0e): created successfully Nov 06 18:01:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7817ff28-a78e-42bb-a3a0-5f9e6bbc366d tempest-ProjectReaderTests-271704049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (271d3d33-55f1-4311-ae3d-c80062830597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7817ff28-a78e-42bb-a3a0-5f9e6bbc366d tempest-ProjectReaderTests-271704049 None] Flow 'volume_create_manager' (0b1a0149-5bc8-44d4-b573-3086c1169524) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:01:32 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-7817ff28-a78e-42bb-a3a0-5f9e6bbc366d tempest-ProjectReaderTests-271704049 None] Created volume successfully. Nov 06 18:01:32 devstack sudo[103910]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1b802729-a8f8-46b0-b155-22ab7a97d516 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f2b02f63-e6c2-4bd8-a8e9-35cfc178caf7 1073741824" returned: 0 in 0.580s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1b802729-a8f8-46b0-b155-22ab7a97d516 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f2b02f63-e6c2-4bd8-a8e9-35cfc178caf7 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:32 devstack sudo[103916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f2b02f63-e6c2-4bd8-a8e9-35cfc178caf7 Nov 06 18:01:32 devstack sudo[103916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:32 devstack sudo[103916]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1b802729-a8f8-46b0-b155-22ab7a97d516 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f2b02f63-e6c2-4bd8-a8e9-35cfc178caf7" returned: 0 in 0.270s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1b802729-a8f8-46b0-b155-22ab7a97d516 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:01:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1b802729-a8f8-46b0-b155-22ab7a97d516 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:01:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-70e65903-56e4-43c9-80d1-88761c09abd0 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.817s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:01:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-70e65903-56e4-43c9-80d1-88761c09abd0 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1177785525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2284efad-639c-4732-9c03-a2130e91306a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f19627bcb7a48d58e54e425857a7fa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:01:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:01:30Z,use_quota=True,user_id='8cc677400e774293a7b2e42e0b2a1834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:01:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-70e65903-56e4-43c9-80d1-88761c09abd0 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Creating volume 2284efad-639c-4732-9c03-a2130e91306a {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:01:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-70e65903-56e4-43c9-80d1-88761c09abd0 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:01:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-70e65903-56e4-43c9-80d1-88761c09abd0 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:01:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-70e65903-56e4-43c9-80d1-88761c09abd0 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:01:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-70e65903-56e4-43c9-80d1-88761c09abd0 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:01:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-70e65903-56e4-43c9-80d1-88761c09abd0 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:01:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-70e65903-56e4-43c9-80d1-88761c09abd0 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:01:32 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-70e65903-56e4-43c9-80d1-88761c09abd0 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:01:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-70e65903-56e4-43c9-80d1-88761c09abd0 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-2284efad-639c-4732-9c03-a2130e91306a 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1b802729-a8f8-46b0-b155-22ab7a97d516 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ff024a1-7c78-456d-9f03-4166d0cc9f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2b02f63-e6c2-4bd8-a8e9-35cfc178caf7', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1b802729-a8f8-46b0-b155-22ab7a97d516 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ca968aa-09e0-4b69-a045-23511b6fd2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:01:32 devstack sudo[103919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-2284efad-639c-4732-9c03-a2130e91306a 1073741824 Nov 06 18:01:32 devstack sudo[103919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:32 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-1b802729-a8f8-46b0-b155-22ab7a97d516 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Volume volume-f2b02f63-e6c2-4bd8-a8e9-35cfc178caf7 (f2b02f63-e6c2-4bd8-a8e9-35cfc178caf7): created successfully Nov 06 18:01:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1b802729-a8f8-46b0-b155-22ab7a97d516 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ca968aa-09e0-4b69-a045-23511b6fd2ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1b802729-a8f8-46b0-b155-22ab7a97d516 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Flow 'volume_create_manager' (2c7dd14e-4a05-4071-ae84-92abfcea358f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:01:32 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-1b802729-a8f8-46b0-b155-22ab7a97d516 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Created volume successfully. Nov 06 18:01:33 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f4a87b3c-dd0e-4d42-8f9c-29f0f475e27d tempest-ProjectReaderTests-271704049 None] Acquiring lock "cinder-e0c0bfc1-faa7-4691-ae9c-4dcd224c4a0e-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:01:33 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f4a87b3c-dd0e-4d42-8f9c-29f0f475e27d tempest-ProjectReaderTests-271704049 None] Lock "cinder-e0c0bfc1-faa7-4691-ae9c-4dcd224c4a0e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:01:33 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f4a87b3c-dd0e-4d42-8f9c-29f0f475e27d tempest-ProjectReaderTests-271704049 None] Acquiring lock "cinder-quobyte-e0c0bfc1-faa7-4691-ae9c-4dcd224c4a0e" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:01:33 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f4a87b3c-dd0e-4d42-8f9c-29f0f475e27d tempest-ProjectReaderTests-271704049 None] Lock "cinder-quobyte-e0c0bfc1-faa7-4691-ae9c-4dcd224c4a0e" acquired by "delete_volume" :: waited 0.034s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:01:33 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f37b07-95de-43a4-b6a7-5ca52bb7c483]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:01:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f4a87b3c-dd0e-4d42-8f9c-29f0f475e27d tempest-ProjectReaderTests-271704049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e0c0bfc1-faa7-4691-ae9c-4dcd224c4a0e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:33 devstack sudo[103919]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-70e65903-56e4-43c9-80d1-88761c09abd0 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-2284efad-639c-4732-9c03-a2130e91306a 1073741824" returned: 0 in 0.725s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:33 devstack sudo[103924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e0c0bfc1-faa7-4691-ae9c-4dcd224c4a0e Nov 06 18:01:33 devstack sudo[103924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-70e65903-56e4-43c9-80d1-88761c09abd0 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-2284efad-639c-4732-9c03-a2130e91306a {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:33 devstack sudo[103926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-2284efad-639c-4732-9c03-a2130e91306a Nov 06 18:01:33 devstack sudo[103926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:33 devstack sudo[103924]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f4a87b3c-dd0e-4d42-8f9c-29f0f475e27d tempest-ProjectReaderTests-271704049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e0c0bfc1-faa7-4691-ae9c-4dcd224c4a0e" returned: 0 in 0.507s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f4a87b3c-dd0e-4d42-8f9c-29f0f475e27d tempest-ProjectReaderTests-271704049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e0c0bfc1-faa7-4691-ae9c-4dcd224c4a0e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:33 devstack sudo[103931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e0c0bfc1-faa7-4691-ae9c-4dcd224c4a0e Nov 06 18:01:33 devstack sudo[103931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:34 devstack sudo[103926]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-70e65903-56e4-43c9-80d1-88761c09abd0 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-2284efad-639c-4732-9c03-a2130e91306a" returned: 0 in 0.369s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-70e65903-56e4-43c9-80d1-88761c09abd0 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] <== create_volume: return (1165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:01:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-70e65903-56e4-43c9-80d1-88761c09abd0 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:01:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-70e65903-56e4-43c9-80d1-88761c09abd0 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aabdc060-b271-4008-bd29-0d774f7beeb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2284efad-639c-4732-9c03-a2130e91306a', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-70e65903-56e4-43c9-80d1-88761c09abd0 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daaae25f-393d-451f-810d-0e1b7782fecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:01:34 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-70e65903-56e4-43c9-80d1-88761c09abd0 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Volume volume-2284efad-639c-4732-9c03-a2130e91306a (2284efad-639c-4732-9c03-a2130e91306a): created successfully Nov 06 18:01:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-70e65903-56e4-43c9-80d1-88761c09abd0 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daaae25f-393d-451f-810d-0e1b7782fecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-70e65903-56e4-43c9-80d1-88761c09abd0 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Flow 'volume_create_manager' (fe60e741-d69b-42cf-8094-5b73849b9fc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:01:34 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-70e65903-56e4-43c9-80d1-88761c09abd0 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Created volume successfully. Nov 06 18:01:34 devstack sudo[103931]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f4a87b3c-dd0e-4d42-8f9c-29f0f475e27d tempest-ProjectReaderTests-271704049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e0c0bfc1-faa7-4691-ae9c-4dcd224c4a0e" returned: 0 in 0.364s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f4a87b3c-dd0e-4d42-8f9c-29f0f475e27d tempest-ProjectReaderTests-271704049 None] Lock "cinder-quobyte-e0c0bfc1-faa7-4691-ae9c-4dcd224c4a0e" released by "delete_volume" :: held 0.937s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:01:34 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-f4a87b3c-dd0e-4d42-8f9c-29f0f475e27d tempest-ProjectReaderTests-271704049 None] Created reservations ['ca24c22b-ee62-47ff-9ed2-71731169c6cf', '46065128-e1ba-48f1-9ea7-f161271e72b0', '3db36e77-8ab6-444e-9fcb-c7f87286007d', 'cdda4ad2-aea3-40b8-be20-fddcf6d0a194'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:01:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f4a87b3c-dd0e-4d42-8f9c-29f0f475e27d tempest-ProjectReaderTests-271704049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:01:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f4a87b3c-dd0e-4d42-8f9c-29f0f475e27d tempest-ProjectReaderTests-271704049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:01:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f4a87b3c-dd0e-4d42-8f9c-29f0f475e27d tempest-ProjectReaderTests-271704049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:01:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f4a87b3c-dd0e-4d42-8f9c-29f0f475e27d tempest-ProjectReaderTests-271704049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:01:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f4a87b3c-dd0e-4d42-8f9c-29f0f475e27d tempest-ProjectReaderTests-271704049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:01:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f4a87b3c-dd0e-4d42-8f9c-29f0f475e27d tempest-ProjectReaderTests-271704049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:34 devstack sudo[103936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:01:34 devstack sudo[103936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c1d2b0d7-0d31-46e8-bd4e-4fa8c2eaba85 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Acquiring lock "cinder-2284efad-639c-4732-9c03-a2130e91306a-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:01:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c1d2b0d7-0d31-46e8-bd4e-4fa8c2eaba85 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Lock "cinder-2284efad-639c-4732-9c03-a2130e91306a-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:01:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c1d2b0d7-0d31-46e8-bd4e-4fa8c2eaba85 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Acquiring lock "cinder-quobyte-2284efad-639c-4732-9c03-a2130e91306a" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:01:34 devstack sudo[103936]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c1d2b0d7-0d31-46e8-bd4e-4fa8c2eaba85 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Lock "cinder-quobyte-2284efad-639c-4732-9c03-a2130e91306a" acquired by "delete_volume" :: waited 0.036s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:01:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f4a87b3c-dd0e-4d42-8f9c-29f0f475e27d tempest-ProjectReaderTests-271704049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.335s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:34 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-f4a87b3c-dd0e-4d42-8f9c-29f0f475e27d tempest-ProjectReaderTests-271704049 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:01:34 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-f4a87b3c-dd0e-4d42-8f9c-29f0f475e27d tempest-ProjectReaderTests-271704049 None] Deleted volume successfully. Nov 06 18:01:34 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2f28bc-d70a-44b2-a889-425fc742b575]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:01:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c1d2b0d7-0d31-46e8-bd4e-4fa8c2eaba85 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-2284efad-639c-4732-9c03-a2130e91306a {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f4a87b3c-dd0e-4d42-8f9c-29f0f475e27d tempest-ProjectReaderTests-271704049 None] Lock "cinder-e0c0bfc1-faa7-4691-ae9c-4dcd224c4a0e-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:01:34 devstack sudo[103939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-2284efad-639c-4732-9c03-a2130e91306a Nov 06 18:01:34 devstack sudo[103939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:35 devstack sudo[103939]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c1d2b0d7-0d31-46e8-bd4e-4fa8c2eaba85 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-2284efad-639c-4732-9c03-a2130e91306a" returned: 0 in 0.431s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c1d2b0d7-0d31-46e8-bd4e-4fa8c2eaba85 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-2284efad-639c-4732-9c03-a2130e91306a {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:35 devstack sudo[103944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-2284efad-639c-4732-9c03-a2130e91306a Nov 06 18:01:35 devstack sudo[103944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:35 devstack sudo[103944]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c1d2b0d7-0d31-46e8-bd4e-4fa8c2eaba85 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-2284efad-639c-4732-9c03-a2130e91306a" returned: 0 in 0.363s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c1d2b0d7-0d31-46e8-bd4e-4fa8c2eaba85 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Lock "cinder-quobyte-2284efad-639c-4732-9c03-a2130e91306a" released by "delete_volume" :: held 0.874s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:01:35 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-c1d2b0d7-0d31-46e8-bd4e-4fa8c2eaba85 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Created reservations ['efe93578-4021-486a-b235-1b81aa096894', '647c8e2f-5102-49d6-8d3d-b382746f941d', '37c377b5-03ee-420e-8460-3f55c612a10c', '342b179d-c470-48ef-9e6a-4548e33fa269'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:01:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c1d2b0d7-0d31-46e8-bd4e-4fa8c2eaba85 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:01:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c1d2b0d7-0d31-46e8-bd4e-4fa8c2eaba85 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:01:35 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c1d2b0d7-0d31-46e8-bd4e-4fa8c2eaba85 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:01:35 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c1d2b0d7-0d31-46e8-bd4e-4fa8c2eaba85 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:01:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c1d2b0d7-0d31-46e8-bd4e-4fa8c2eaba85 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:01:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c1d2b0d7-0d31-46e8-bd4e-4fa8c2eaba85 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:35 devstack sudo[103947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:01:35 devstack sudo[103947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:36 devstack sudo[103947]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c1d2b0d7-0d31-46e8-bd4e-4fa8c2eaba85 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.332s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:36 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-c1d2b0d7-0d31-46e8-bd4e-4fa8c2eaba85 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:01:36 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-c1d2b0d7-0d31-46e8-bd4e-4fa8c2eaba85 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Deleted volume successfully. Nov 06 18:01:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c1d2b0d7-0d31-46e8-bd4e-4fa8c2eaba85 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Lock "cinder-2284efad-639c-4732-9c03-a2130e91306a-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:01:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e8088ca8-bf5c-4c68-9f1c-a48921e5b2ef tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Acquiring lock "cinder-f2b02f63-e6c2-4bd8-a8e9-35cfc178caf7-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:01:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e8088ca8-bf5c-4c68-9f1c-a48921e5b2ef tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Lock "cinder-f2b02f63-e6c2-4bd8-a8e9-35cfc178caf7-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:01:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e8088ca8-bf5c-4c68-9f1c-a48921e5b2ef tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Acquiring lock "cinder-quobyte-f2b02f63-e6c2-4bd8-a8e9-35cfc178caf7" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:01:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e8088ca8-bf5c-4c68-9f1c-a48921e5b2ef tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Lock "cinder-quobyte-f2b02f63-e6c2-4bd8-a8e9-35cfc178caf7" acquired by "delete_volume" :: waited 0.022s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:01:37 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b678168-d26d-41e8-ba3c-ad75de2c18d4]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:01:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e8088ca8-bf5c-4c68-9f1c-a48921e5b2ef tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f2b02f63-e6c2-4bd8-a8e9-35cfc178caf7 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:37 devstack sudo[103951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f2b02f63-e6c2-4bd8-a8e9-35cfc178caf7 Nov 06 18:01:37 devstack sudo[103951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:37 devstack sudo[103951]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e8088ca8-bf5c-4c68-9f1c-a48921e5b2ef tempest-CreateVolumesFromSourceVolumeTest-306738423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f2b02f63-e6c2-4bd8-a8e9-35cfc178caf7" returned: 0 in 0.452s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e8088ca8-bf5c-4c68-9f1c-a48921e5b2ef tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f2b02f63-e6c2-4bd8-a8e9-35cfc178caf7 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:37 devstack sudo[103956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f2b02f63-e6c2-4bd8-a8e9-35cfc178caf7 Nov 06 18:01:37 devstack sudo[103956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:37 devstack sudo[103956]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e8088ca8-bf5c-4c68-9f1c-a48921e5b2ef tempest-CreateVolumesFromSourceVolumeTest-306738423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f2b02f63-e6c2-4bd8-a8e9-35cfc178caf7" returned: 0 in 0.395s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e8088ca8-bf5c-4c68-9f1c-a48921e5b2ef tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Lock "cinder-quobyte-f2b02f63-e6c2-4bd8-a8e9-35cfc178caf7" released by "delete_volume" :: held 0.928s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:01:38 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-e8088ca8-bf5c-4c68-9f1c-a48921e5b2ef tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Created reservations ['9e6772b3-5f20-4e5b-816c-1f78bdff7ac5', '2ca533c0-5549-4492-934c-d073f98f3402', '3fe3cdfc-b95c-4a66-8317-327ab14dea92', '31b655f1-c0dd-4d6e-a409-4fe2ff12edf3'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:01:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e8088ca8-bf5c-4c68-9f1c-a48921e5b2ef tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:01:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e8088ca8-bf5c-4c68-9f1c-a48921e5b2ef tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:01:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e8088ca8-bf5c-4c68-9f1c-a48921e5b2ef tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:01:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e8088ca8-bf5c-4c68-9f1c-a48921e5b2ef tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:01:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e8088ca8-bf5c-4c68-9f1c-a48921e5b2ef tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:01:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e8088ca8-bf5c-4c68-9f1c-a48921e5b2ef tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:38 devstack sudo[103959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:01:38 devstack sudo[103959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:38 devstack sudo[103959]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e8088ca8-bf5c-4c68-9f1c-a48921e5b2ef tempest-CreateVolumesFromSourceVolumeTest-306738423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.272s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:38 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-e8088ca8-bf5c-4c68-9f1c-a48921e5b2ef tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:01:38 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-e8088ca8-bf5c-4c68-9f1c-a48921e5b2ef tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Deleted volume successfully. Nov 06 18:01:38 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e8088ca8-bf5c-4c68-9f1c-a48921e5b2ef tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Lock "cinder-f2b02f63-e6c2-4bd8-a8e9-35cfc178caf7-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:01:39 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-beb7c36e-a729-4b97-a6b3-34464918279a tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Acquiring lock "cinder-6f23aab8-5689-4773-96a0-1068f9d3594a-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:01:39 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-beb7c36e-a729-4b97-a6b3-34464918279a tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Lock "cinder-6f23aab8-5689-4773-96a0-1068f9d3594a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:01:39 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-beb7c36e-a729-4b97-a6b3-34464918279a tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Acquiring lock "cinder-quobyte-6f23aab8-5689-4773-96a0-1068f9d3594a" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:01:39 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-beb7c36e-a729-4b97-a6b3-34464918279a tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Lock "cinder-quobyte-6f23aab8-5689-4773-96a0-1068f9d3594a" acquired by "delete_volume" :: waited 0.014s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:01:39 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[585a39e8-ddb6-4326-9abf-7dcfe2063933]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:01:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-beb7c36e-a729-4b97-a6b3-34464918279a tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f23aab8-5689-4773-96a0-1068f9d3594a {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:39 devstack sudo[103962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f23aab8-5689-4773-96a0-1068f9d3594a Nov 06 18:01:39 devstack sudo[103962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:39 devstack sudo[103962]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-beb7c36e-a729-4b97-a6b3-34464918279a tempest-CreateVolumesFromSourceVolumeTest-306738423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f23aab8-5689-4773-96a0-1068f9d3594a" returned: 0 in 0.462s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-beb7c36e-a729-4b97-a6b3-34464918279a tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f23aab8-5689-4773-96a0-1068f9d3594a {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:39 devstack sudo[103969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f23aab8-5689-4773-96a0-1068f9d3594a Nov 06 18:01:39 devstack sudo[103969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:40 devstack sudo[103969]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-beb7c36e-a729-4b97-a6b3-34464918279a tempest-CreateVolumesFromSourceVolumeTest-306738423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f23aab8-5689-4773-96a0-1068f9d3594a" returned: 0 in 0.300s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-beb7c36e-a729-4b97-a6b3-34464918279a tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Lock "cinder-quobyte-6f23aab8-5689-4773-96a0-1068f9d3594a" released by "delete_volume" :: held 0.824s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:01:40 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-beb7c36e-a729-4b97-a6b3-34464918279a tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Created reservations ['a6bd3a4d-1d66-4957-bcd8-528983f54937', 'f5b798ed-4821-444a-ba27-65f64803008f', 'd96a1393-ab8f-4872-ba72-b38f884ce1fd', '872a5fa5-9d30-4d10-ae90-6b853a53f9e8'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:01:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-beb7c36e-a729-4b97-a6b3-34464918279a tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:01:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-beb7c36e-a729-4b97-a6b3-34464918279a tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:01:40 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-beb7c36e-a729-4b97-a6b3-34464918279a tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:01:40 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-beb7c36e-a729-4b97-a6b3-34464918279a tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:01:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-beb7c36e-a729-4b97-a6b3-34464918279a tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:01:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-beb7c36e-a729-4b97-a6b3-34464918279a tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:40 devstack sudo[103972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:01:40 devstack sudo[103972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d56fb2fd-3bbc-4aaa-be28-4d0ebafe9a45 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Acquiring lock "cinder-6c58ed1b-1cd6-43aa-9c23-a6c54b23e4b7-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:01:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d56fb2fd-3bbc-4aaa-be28-4d0ebafe9a45 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Lock "cinder-6c58ed1b-1cd6-43aa-9c23-a6c54b23e4b7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:01:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d56fb2fd-3bbc-4aaa-be28-4d0ebafe9a45 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Acquiring lock "cinder-quobyte-6c58ed1b-1cd6-43aa-9c23-a6c54b23e4b7" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:01:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d56fb2fd-3bbc-4aaa-be28-4d0ebafe9a45 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Lock "cinder-quobyte-6c58ed1b-1cd6-43aa-9c23-a6c54b23e4b7" acquired by "delete_volume" :: waited 0.018s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:01:40 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b3b3f6-299a-4a52-b63c-f339bb237a42]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:01:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d56fb2fd-3bbc-4aaa-be28-4d0ebafe9a45 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6c58ed1b-1cd6-43aa-9c23-a6c54b23e4b7 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:40 devstack sudo[103972]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-beb7c36e-a729-4b97-a6b3-34464918279a tempest-CreateVolumesFromSourceVolumeTest-306738423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.366s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:40 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-beb7c36e-a729-4b97-a6b3-34464918279a tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:01:40 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-beb7c36e-a729-4b97-a6b3-34464918279a tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Deleted volume successfully. Nov 06 18:01:40 devstack sudo[103974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6c58ed1b-1cd6-43aa-9c23-a6c54b23e4b7 Nov 06 18:01:40 devstack sudo[103974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-beb7c36e-a729-4b97-a6b3-34464918279a tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Lock "cinder-6f23aab8-5689-4773-96a0-1068f9d3594a-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:01:41 devstack sudo[103974]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d56fb2fd-3bbc-4aaa-be28-4d0ebafe9a45 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6c58ed1b-1cd6-43aa-9c23-a6c54b23e4b7" returned: 0 in 0.468s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d56fb2fd-3bbc-4aaa-be28-4d0ebafe9a45 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6c58ed1b-1cd6-43aa-9c23-a6c54b23e4b7 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:41 devstack sudo[103981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6c58ed1b-1cd6-43aa-9c23-a6c54b23e4b7 Nov 06 18:01:41 devstack sudo[103981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:41 devstack sudo[103981]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d56fb2fd-3bbc-4aaa-be28-4d0ebafe9a45 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6c58ed1b-1cd6-43aa-9c23-a6c54b23e4b7" returned: 0 in 0.282s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:41 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d56fb2fd-3bbc-4aaa-be28-4d0ebafe9a45 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Lock "cinder-quobyte-6c58ed1b-1cd6-43aa-9c23-a6c54b23e4b7" released by "delete_volume" :: held 0.832s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:01:41 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-d56fb2fd-3bbc-4aaa-be28-4d0ebafe9a45 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Created reservations ['0efac39b-8fc8-4b9f-a98b-4096df7ba9f8', '46296e88-bf20-42c7-9b7b-23187cf3590e', '4d2111e6-79ce-4a21-962b-fb198c880b49', '9e62da69-8471-48a8-ac5e-093220170fb1'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:01:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d56fb2fd-3bbc-4aaa-be28-4d0ebafe9a45 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:01:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d56fb2fd-3bbc-4aaa-be28-4d0ebafe9a45 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:01:41 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d56fb2fd-3bbc-4aaa-be28-4d0ebafe9a45 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:01:41 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d56fb2fd-3bbc-4aaa-be28-4d0ebafe9a45 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:01:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d56fb2fd-3bbc-4aaa-be28-4d0ebafe9a45 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:01:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d56fb2fd-3bbc-4aaa-be28-4d0ebafe9a45 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:41 devstack sudo[103984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:01:41 devstack sudo[103984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:41 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ac12be98-715e-49c9-8d28-269a138be975 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Acquiring lock "cinder-d507b664-fbab-4184-bc17-ee9b17d474c0-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:01:41 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ac12be98-715e-49c9-8d28-269a138be975 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Lock "cinder-d507b664-fbab-4184-bc17-ee9b17d474c0-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:01:41 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ac12be98-715e-49c9-8d28-269a138be975 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Acquiring lock "cinder-quobyte-d507b664-fbab-4184-bc17-ee9b17d474c0" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:01:41 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ac12be98-715e-49c9-8d28-269a138be975 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Lock "cinder-quobyte-d507b664-fbab-4184-bc17-ee9b17d474c0" acquired by "delete_volume" :: waited 0.030s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:01:41 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d9017b-a942-4383-a3e2-cbbfd7f9a998]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:01:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ac12be98-715e-49c9-8d28-269a138be975 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d507b664-fbab-4184-bc17-ee9b17d474c0 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:41 devstack sudo[103984]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d56fb2fd-3bbc-4aaa-be28-4d0ebafe9a45 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.385s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:41 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-d56fb2fd-3bbc-4aaa-be28-4d0ebafe9a45 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:01:41 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-d56fb2fd-3bbc-4aaa-be28-4d0ebafe9a45 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Deleted volume successfully. Nov 06 18:01:41 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d56fb2fd-3bbc-4aaa-be28-4d0ebafe9a45 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Lock "cinder-6c58ed1b-1cd6-43aa-9c23-a6c54b23e4b7-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:01:42 devstack sudo[103987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d507b664-fbab-4184-bc17-ee9b17d474c0 Nov 06 18:01:42 devstack sudo[103987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:42 devstack sudo[103987]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ac12be98-715e-49c9-8d28-269a138be975 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d507b664-fbab-4184-bc17-ee9b17d474c0" returned: 0 in 0.464s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ac12be98-715e-49c9-8d28-269a138be975 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d507b664-fbab-4184-bc17-ee9b17d474c0 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:42 devstack sudo[103992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d507b664-fbab-4184-bc17-ee9b17d474c0 Nov 06 18:01:42 devstack sudo[103992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:42 devstack sudo[103992]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ac12be98-715e-49c9-8d28-269a138be975 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-d507b664-fbab-4184-bc17-ee9b17d474c0" returned: 0 in 0.309s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:42 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ac12be98-715e-49c9-8d28-269a138be975 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Lock "cinder-quobyte-d507b664-fbab-4184-bc17-ee9b17d474c0" released by "delete_volume" :: held 0.851s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:01:42 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-ac12be98-715e-49c9-8d28-269a138be975 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Created reservations ['79efc782-4b88-4a61-8f6c-b151c6756ab3', '9adea692-cada-4e60-8aee-7d5c42d3df97', '58038894-fd30-463e-aa93-46fd0a59fa97', '35edfeb3-8642-4992-8c86-e86511178c7b'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:01:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ac12be98-715e-49c9-8d28-269a138be975 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:01:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ac12be98-715e-49c9-8d28-269a138be975 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:01:42 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ac12be98-715e-49c9-8d28-269a138be975 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:01:42 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ac12be98-715e-49c9-8d28-269a138be975 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:01:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ac12be98-715e-49c9-8d28-269a138be975 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:01:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ac12be98-715e-49c9-8d28-269a138be975 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:42 devstack sudo[103995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:01:42 devstack sudo[103995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:42 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-fc9f1112-f752-451d-8a74-8e37f303559d tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Acquiring lock "cinder-1fc24918-2104-4b21-8475-9117d4e64118-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:01:42 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-fc9f1112-f752-451d-8a74-8e37f303559d tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Lock "cinder-1fc24918-2104-4b21-8475-9117d4e64118-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:01:43 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-fc9f1112-f752-451d-8a74-8e37f303559d tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Acquiring lock "cinder-quobyte-1fc24918-2104-4b21-8475-9117d4e64118" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:01:43 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-fc9f1112-f752-451d-8a74-8e37f303559d tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Lock "cinder-quobyte-1fc24918-2104-4b21-8475-9117d4e64118" acquired by "delete_volume" :: waited 0.023s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:01:43 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffbda7e3-7177-45b9-8816-152bbf39eb85]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:01:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fc9f1112-f752-451d-8a74-8e37f303559d tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1fc24918-2104-4b21-8475-9117d4e64118 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:43 devstack sudo[103995]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ac12be98-715e-49c9-8d28-269a138be975 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.322s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:43 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-ac12be98-715e-49c9-8d28-269a138be975 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:01:43 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-ac12be98-715e-49c9-8d28-269a138be975 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Deleted volume successfully. Nov 06 18:01:43 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ac12be98-715e-49c9-8d28-269a138be975 tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Lock "cinder-d507b664-fbab-4184-bc17-ee9b17d474c0-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:01:43 devstack sudo[103998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1fc24918-2104-4b21-8475-9117d4e64118 Nov 06 18:01:43 devstack sudo[103998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:43 devstack sudo[103998]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fc9f1112-f752-451d-8a74-8e37f303559d tempest-CreateVolumesFromSourceVolumeTest-306738423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1fc24918-2104-4b21-8475-9117d4e64118" returned: 0 in 0.453s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fc9f1112-f752-451d-8a74-8e37f303559d tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1fc24918-2104-4b21-8475-9117d4e64118 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:43 devstack sudo[104003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1fc24918-2104-4b21-8475-9117d4e64118 Nov 06 18:01:43 devstack sudo[104003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:43 devstack sudo[104003]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fc9f1112-f752-451d-8a74-8e37f303559d tempest-CreateVolumesFromSourceVolumeTest-306738423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1fc24918-2104-4b21-8475-9117d4e64118" returned: 0 in 0.300s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:43 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-fc9f1112-f752-451d-8a74-8e37f303559d tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Lock "cinder-quobyte-1fc24918-2104-4b21-8475-9117d4e64118" released by "delete_volume" :: held 0.822s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:01:43 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-fc9f1112-f752-451d-8a74-8e37f303559d tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Created reservations ['18275c36-11de-43b1-9859-498a8dfee02a', '6a5ae449-d398-4f67-9530-a7ddef2a00d0', '42c76149-9396-428b-ac5a-4d9c38c38bf3', '9786a9cf-0e4e-40a8-b0fa-cbc69f4d9d22'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:01:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fc9f1112-f752-451d-8a74-8e37f303559d tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:01:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fc9f1112-f752-451d-8a74-8e37f303559d tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:01:44 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fc9f1112-f752-451d-8a74-8e37f303559d tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:01:44 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fc9f1112-f752-451d-8a74-8e37f303559d tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:01:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fc9f1112-f752-451d-8a74-8e37f303559d tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:01:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fc9f1112-f752-451d-8a74-8e37f303559d tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:44 devstack sudo[104006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:01:44 devstack sudo[104006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:44 devstack sudo[104006]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fc9f1112-f752-451d-8a74-8e37f303559d tempest-CreateVolumesFromSourceVolumeTest-306738423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.320s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:44 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-fc9f1112-f752-451d-8a74-8e37f303559d tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:01:44 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-fc9f1112-f752-451d-8a74-8e37f303559d tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Deleted volume successfully. Nov 06 18:01:44 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-fc9f1112-f752-451d-8a74-8e37f303559d tempest-CreateVolumesFromSourceVolumeTest-306738423 None] Lock "cinder-1fc24918-2104-4b21-8475-9117d4e64118-delete_volume" released by "delete_volume" :: held 1.425s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:01:48 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-2542d110-c86d-4f46-aa15-e2c8d73d0f6d tempest-ProjectReaderTests-1677890695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:01:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2542d110-c86d-4f46-aa15-e2c8d73d0f6d tempest-ProjectReaderTests-1677890695 None] Flow 'volume_create_manager' (3abd81b5-2fc0-4016-87aa-4a3ef30b530d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:01:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2542d110-c86d-4f46-aa15-e2c8d73d0f6d tempest-ProjectReaderTests-1677890695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d5b8f73-2a2f-4e37-80a4-70dbf9226c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:01:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2542d110-c86d-4f46-aa15-e2c8d73d0f6d tempest-ProjectReaderTests-1677890695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d5b8f73-2a2f-4e37-80a4-70dbf9226c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:01:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1231196854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1205625a-7f86-4092-b4e0-93ca85319b2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b700f8a4a4d4e008e4bf0e11f489f5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:01:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:01:48Z,use_quota=True,user_id='08db92c9ca0d44ce92d0bf92903edbaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2542d110-c86d-4f46-aa15-e2c8d73d0f6d tempest-ProjectReaderTests-1677890695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6264b40-cd96-4b49-b3e5-2ba2d74cb85e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:01:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2542d110-c86d-4f46-aa15-e2c8d73d0f6d tempest-ProjectReaderTests-1677890695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6264b40-cd96-4b49-b3e5-2ba2d74cb85e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2542d110-c86d-4f46-aa15-e2c8d73d0f6d tempest-ProjectReaderTests-1677890695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75f4f3be-30dc-46e3-8992-9839d57e326e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:01:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2542d110-c86d-4f46-aa15-e2c8d73d0f6d tempest-ProjectReaderTests-1677890695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75f4f3be-30dc-46e3-8992-9839d57e326e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1205625a-7f86-4092-b4e0-93ca85319b2d', 'volume_name': 'volume-1205625a-7f86-4092-b4e0-93ca85319b2d', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2542d110-c86d-4f46-aa15-e2c8d73d0f6d tempest-ProjectReaderTests-1677890695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (564cd07c-2763-4d9a-8868-41ff5fc7ce41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:01:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2542d110-c86d-4f46-aa15-e2c8d73d0f6d tempest-ProjectReaderTests-1677890695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (564cd07c-2763-4d9a-8868-41ff5fc7ce41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2542d110-c86d-4f46-aa15-e2c8d73d0f6d tempest-ProjectReaderTests-1677890695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d71c5650-5013-4015-87ff-14fc48b1d117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:01:48 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-2542d110-c86d-4f46-aa15-e2c8d73d0f6d tempest-ProjectReaderTests-1677890695 None] Volume 1205625a-7f86-4092-b4e0-93ca85319b2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1205625a-7f86-4092-b4e0-93ca85319b2d', 'volume_size': 1} Nov 06 18:01:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2542d110-c86d-4f46-aa15-e2c8d73d0f6d tempest-ProjectReaderTests-1677890695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:01:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2542d110-c86d-4f46-aa15-e2c8d73d0f6d tempest-ProjectReaderTests-1677890695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:01:48 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2542d110-c86d-4f46-aa15-e2c8d73d0f6d tempest-ProjectReaderTests-1677890695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:01:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1231196854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1205625a-7f86-4092-b4e0-93ca85319b2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b700f8a4a4d4e008e4bf0e11f489f5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:01:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:01:48Z,use_quota=True,user_id='08db92c9ca0d44ce92d0bf92903edbaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:01:48 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-2542d110-c86d-4f46-aa15-e2c8d73d0f6d tempest-ProjectReaderTests-1677890695 None] Creating volume 1205625a-7f86-4092-b4e0-93ca85319b2d {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:01:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2542d110-c86d-4f46-aa15-e2c8d73d0f6d tempest-ProjectReaderTests-1677890695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:01:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2542d110-c86d-4f46-aa15-e2c8d73d0f6d tempest-ProjectReaderTests-1677890695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:01:48 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2542d110-c86d-4f46-aa15-e2c8d73d0f6d tempest-ProjectReaderTests-1677890695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:01:48 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2542d110-c86d-4f46-aa15-e2c8d73d0f6d tempest-ProjectReaderTests-1677890695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:01:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2542d110-c86d-4f46-aa15-e2c8d73d0f6d tempest-ProjectReaderTests-1677890695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:01:48 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2542d110-c86d-4f46-aa15-e2c8d73d0f6d tempest-ProjectReaderTests-1677890695 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:01:48 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-2542d110-c86d-4f46-aa15-e2c8d73d0f6d tempest-ProjectReaderTests-1677890695 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:01:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2542d110-c86d-4f46-aa15-e2c8d73d0f6d tempest-ProjectReaderTests-1677890695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1205625a-7f86-4092-b4e0-93ca85319b2d 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:48 devstack sudo[104010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1205625a-7f86-4092-b4e0-93ca85319b2d 1073741824 Nov 06 18:01:48 devstack sudo[104010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:48 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:01:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Flow 'volume_create_manager' (6ac1b90a-cd56-473e-88d8-68524b829b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:01:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb40bffd-f9af-4f7e-a45d-9a60d2a40b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:01:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb40bffd-f9af-4f7e-a45d-9a60d2a40b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:01:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e51e7a14-4872-4742-a19f-7e5af8ba2153,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c8e54df574446e5a09c25138517e17e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:01:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:01:49Z,use_quota=True,user_id='a099c51c5c874ccd847de59b30d0478d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c9957d3-d59b-459c-98e2-fdd885cb885e),volume_type_id=0c9957d3-d59b-459c-98e2-fdd885cb885e)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (959ed93b-bb6c-480a-8036-b948cc11f391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:01:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (959ed93b-bb6c-480a-8036-b948cc11f391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ddf66aa-c803-439e-86d0-3669b7188bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:01:48 devstack cinder-volume[87068]: DEBUG cinder.image.glance [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Creating Keystone auth plugin from conf {{(pid=87068) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 18:01:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ddf66aa-c803-439e-86d0-3669b7188bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e51e7a14-4872-4742-a19f-7e5af8ba2153', 'volume_name': 'volume-e51e7a14-4872-4742-a19f-7e5af8ba2153', 'volume_size': 1, 'image_id': '987dc24f-a6cb-4c70-b2ca-023f3e436541', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/987dc24f-a6cb-4c70-b2ca-023f3e436541', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '02cb72c138e06e4fb74d457f36fe0d13', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8c8e54df574446e5a09c25138517e17e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c11bf2d8fb30b247c202fd50e73d3817760b72c78c19fab71c733eba6ebf89c51a59a93e5092d20127734382a2e3dfb6e7f01f40af7607946f62b5c37c1ff808', 'id': '987dc24f-a6cb-4c70-b2ca-023f3e436541', 'created_at': datetime.datetime(2026, 11, 6, 17, 1, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 17, 1, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/987dc24f-a6cb-4c70-b2ca-023f3e436541/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f4ea196-102b-4f25-b19e-db6f6d039b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:01:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f4ea196-102b-4f25-b19e-db6f6d039b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (115e34c3-248b-46f1-a301-b38e2b75f393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:01:49 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Volume e51e7a14-4872-4742-a19f-7e5af8ba2153: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e51e7a14-4872-4742-a19f-7e5af8ba2153', 'volume_size': 1, 'image_id': '987dc24f-a6cb-4c70-b2ca-023f3e436541', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/987dc24f-a6cb-4c70-b2ca-023f3e436541', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '02cb72c138e06e4fb74d457f36fe0d13', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8c8e54df574446e5a09c25138517e17e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c11bf2d8fb30b247c202fd50e73d3817760b72c78c19fab71c733eba6ebf89c51a59a93e5092d20127734382a2e3dfb6e7f01f40af7607946f62b5c37c1ff808', 'id': '987dc24f-a6cb-4c70-b2ca-023f3e436541', 'created_at': datetime.datetime(2026, 11, 6, 17, 1, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 17, 1, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/987dc24f-a6cb-4c70-b2ca-023f3e436541/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 06 18:01:49 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Trying to clone e51e7a14-4872-4742-a19f-7e5af8ba2153 from image 987dc24f-a6cb-4c70-b2ca-023f3e436541 at location (None, [{'url': 'file:///opt/stack/data/glance/images/987dc24f-a6cb-4c70-b2ca-023f3e436541', 'metadata': {}}]). {{(pid=87068) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 18:01:49 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_987dc24f-a6cb-4c70-b2ca-023f3e436541_tgg51zfedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87068) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 06 18:01:49 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Image download 0.00 MB at 0.00 MB/s Nov 06 18:01:49 devstack sudo[104010]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2542d110-c86d-4f46-aa15-e2c8d73d0f6d tempest-ProjectReaderTests-1677890695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1205625a-7f86-4092-b4e0-93ca85319b2d 1073741824" returned: 0 in 0.575s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2542d110-c86d-4f46-aa15-e2c8d73d0f6d tempest-ProjectReaderTests-1677890695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1205625a-7f86-4092-b4e0-93ca85319b2d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:49 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4431e42-7da2-4714-a678-3d0cd22c5f94]: (4, 'raw') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:01:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_987dc24f-a6cb-4c70-b2ca-023f3e436541_tgg51zfedevstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:49 devstack sudo[104016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1205625a-7f86-4092-b4e0-93ca85319b2d Nov 06 18:01:49 devstack sudo[104016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:49 devstack sudo[104017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_987dc24f-a6cb-4c70-b2ca-023f3e436541_tgg51zfedevstack@QuobyteHD Nov 06 18:01:49 devstack sudo[104017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:49 devstack sudo[104016]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2542d110-c86d-4f46-aa15-e2c8d73d0f6d tempest-ProjectReaderTests-1677890695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1205625a-7f86-4092-b4e0-93ca85319b2d" returned: 0 in 0.309s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2542d110-c86d-4f46-aa15-e2c8d73d0f6d tempest-ProjectReaderTests-1677890695 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:01:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2542d110-c86d-4f46-aa15-e2c8d73d0f6d tempest-ProjectReaderTests-1677890695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:01:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2542d110-c86d-4f46-aa15-e2c8d73d0f6d tempest-ProjectReaderTests-1677890695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d71c5650-5013-4015-87ff-14fc48b1d117) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1205625a-7f86-4092-b4e0-93ca85319b2d', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2542d110-c86d-4f46-aa15-e2c8d73d0f6d tempest-ProjectReaderTests-1677890695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af8b92bd-7fa5-472c-8ac8-8dc8d71f85f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:01:49 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-2542d110-c86d-4f46-aa15-e2c8d73d0f6d tempest-ProjectReaderTests-1677890695 None] Volume volume-1205625a-7f86-4092-b4e0-93ca85319b2d (1205625a-7f86-4092-b4e0-93ca85319b2d): created successfully Nov 06 18:01:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2542d110-c86d-4f46-aa15-e2c8d73d0f6d tempest-ProjectReaderTests-1677890695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af8b92bd-7fa5-472c-8ac8-8dc8d71f85f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2542d110-c86d-4f46-aa15-e2c8d73d0f6d tempest-ProjectReaderTests-1677890695 None] Flow 'volume_create_manager' (3abd81b5-2fc0-4016-87aa-4a3ef30b530d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:01:49 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-2542d110-c86d-4f46-aa15-e2c8d73d0f6d tempest-ProjectReaderTests-1677890695 None] Created volume successfully. Nov 06 18:01:49 devstack sudo[104017]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_987dc24f-a6cb-4c70-b2ca-023f3e436541_tgg51zfedevstack@QuobyteHD" returned: 0 in 0.410s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_987dc24f-a6cb-4c70-b2ca-023f3e436541_tgg51zfedevstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:49 devstack sudo[104023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_987dc24f-a6cb-4c70-b2ca-023f3e436541_tgg51zfedevstack@QuobyteHD Nov 06 18:01:49 devstack sudo[104023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:50 devstack sudo[104023]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_987dc24f-a6cb-4c70-b2ca-023f3e436541_tgg51zfedevstack@QuobyteHD" returned: 1 in 0.361s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_987dc24f-a6cb-4c70-b2ca-023f3e436541_tgg51zfedevstack@QuobyteHD' failed. Not Retrying. {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 18:01:50 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Temporary image 987dc24f-a6cb-4c70-b2ca-023f3e436541 is fetched for user a099c51c5c874ccd847de59b30d0478d. {{(pid=87068) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 06 18:01:50 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[17666918-7395-4a3c-8bc3-42b8bbcd476c]: (4, 'raw') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:01:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_987dc24f-a6cb-4c70-b2ca-023f3e436541_tgg51zfedevstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:50 devstack sudo[104028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_987dc24f-a6cb-4c70-b2ca-023f3e436541_tgg51zfedevstack@QuobyteHD Nov 06 18:01:50 devstack sudo[104028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:50 devstack sudo[104028]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_987dc24f-a6cb-4c70-b2ca-023f3e436541_tgg51zfedevstack@QuobyteHD" returned: 0 in 0.351s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_987dc24f-a6cb-4c70-b2ca-023f3e436541_tgg51zfedevstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:50 devstack sudo[104032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_987dc24f-a6cb-4c70-b2ca-023f3e436541_tgg51zfedevstack@QuobyteHD Nov 06 18:01:50 devstack sudo[104032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:50 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a4ab8af3-edb2-4446-a15f-6532071524ed tempest-ProjectReaderTests-1677890695 None] Acquiring lock "cinder-1205625a-7f86-4092-b4e0-93ca85319b2d-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:01:50 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a4ab8af3-edb2-4446-a15f-6532071524ed tempest-ProjectReaderTests-1677890695 None] Lock "cinder-1205625a-7f86-4092-b4e0-93ca85319b2d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:01:50 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a4ab8af3-edb2-4446-a15f-6532071524ed tempest-ProjectReaderTests-1677890695 None] Acquiring lock "cinder-quobyte-1205625a-7f86-4092-b4e0-93ca85319b2d" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:01:50 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a4ab8af3-edb2-4446-a15f-6532071524ed tempest-ProjectReaderTests-1677890695 None] Lock "cinder-quobyte-1205625a-7f86-4092-b4e0-93ca85319b2d" acquired by "delete_volume" :: waited 0.030s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:01:50 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca9dca9-4ba9-4c0f-bff4-289d7b4ff9fb]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:01:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a4ab8af3-edb2-4446-a15f-6532071524ed tempest-ProjectReaderTests-1677890695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1205625a-7f86-4092-b4e0-93ca85319b2d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:51 devstack sudo[104032]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_987dc24f-a6cb-4c70-b2ca-023f3e436541_tgg51zfedevstack@QuobyteHD" returned: 1 in 0.561s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_987dc24f-a6cb-4c70-b2ca-023f3e436541_tgg51zfedevstack@QuobyteHD' failed. Not Retrying. {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 18:01:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:01:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:01:51 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:01:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e51e7a14-4872-4742-a19f-7e5af8ba2153,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c8e54df574446e5a09c25138517e17e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:01:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:01:49Z,use_quota=True,user_id='a099c51c5c874ccd847de59b30d0478d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c9957d3-d59b-459c-98e2-fdd885cb885e),volume_type_id=0c9957d3-d59b-459c-98e2-fdd885cb885e)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:01:51 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Creating volume e51e7a14-4872-4742-a19f-7e5af8ba2153 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:01:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:01:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:01:51 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:01:51 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:01:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:01:51 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:01:51 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:01:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e51e7a14-4872-4742-a19f-7e5af8ba2153 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:51 devstack sudo[104037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1205625a-7f86-4092-b4e0-93ca85319b2d Nov 06 18:01:51 devstack sudo[104037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:51 devstack sudo[104041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e51e7a14-4872-4742-a19f-7e5af8ba2153 1073741824 Nov 06 18:01:51 devstack sudo[104041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:51 devstack sudo[104037]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a4ab8af3-edb2-4446-a15f-6532071524ed tempest-ProjectReaderTests-1677890695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1205625a-7f86-4092-b4e0-93ca85319b2d" returned: 0 in 0.460s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a4ab8af3-edb2-4446-a15f-6532071524ed tempest-ProjectReaderTests-1677890695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1205625a-7f86-4092-b4e0-93ca85319b2d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:51 devstack sudo[104052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1205625a-7f86-4092-b4e0-93ca85319b2d Nov 06 18:01:51 devstack sudo[104052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:51 devstack sudo[104041]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e51e7a14-4872-4742-a19f-7e5af8ba2153 1073741824" returned: 0 in 0.519s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e51e7a14-4872-4742-a19f-7e5af8ba2153 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:51 devstack sudo[104054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e51e7a14-4872-4742-a19f-7e5af8ba2153 Nov 06 18:01:51 devstack sudo[104054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:51 devstack sudo[104052]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a4ab8af3-edb2-4446-a15f-6532071524ed tempest-ProjectReaderTests-1677890695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1205625a-7f86-4092-b4e0-93ca85319b2d" returned: 0 in 0.321s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:51 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a4ab8af3-edb2-4446-a15f-6532071524ed tempest-ProjectReaderTests-1677890695 None] Lock "cinder-quobyte-1205625a-7f86-4092-b4e0-93ca85319b2d" released by "delete_volume" :: held 0.854s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:01:51 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-a4ab8af3-edb2-4446-a15f-6532071524ed tempest-ProjectReaderTests-1677890695 None] Created reservations ['c865dabb-b803-494f-8d93-cb48506861e0', '2f12dc71-391b-4340-aed2-3fa8d24d9107', 'f172d88f-0b9c-4593-be16-4de28c52ac0c', 'b2691ea5-3a4c-40e0-86f7-9dea612fe88a'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:01:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a4ab8af3-edb2-4446-a15f-6532071524ed tempest-ProjectReaderTests-1677890695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:01:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a4ab8af3-edb2-4446-a15f-6532071524ed tempest-ProjectReaderTests-1677890695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:01:51 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a4ab8af3-edb2-4446-a15f-6532071524ed tempest-ProjectReaderTests-1677890695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:01:51 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a4ab8af3-edb2-4446-a15f-6532071524ed tempest-ProjectReaderTests-1677890695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:01:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a4ab8af3-edb2-4446-a15f-6532071524ed tempest-ProjectReaderTests-1677890695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:01:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a4ab8af3-edb2-4446-a15f-6532071524ed tempest-ProjectReaderTests-1677890695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:51 devstack sudo[104054]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e51e7a14-4872-4742-a19f-7e5af8ba2153" returned: 0 in 0.310s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:51 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:01:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:01:51 devstack sudo[104058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:01:51 devstack sudo[104058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:51 devstack cinder-volume[87068]: DEBUG cinder.volume.volume_utils [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Attempting download of 987dc24f-a6cb-4c70-b2ca-023f3e436541 ((None, [{'url': 'file:///opt/stack/data/glance/images/987dc24f-a6cb-4c70-b2ca-023f3e436541', 'metadata': {}}])) to volume e51e7a14-4872-4742-a19f-7e5af8ba2153. {{(pid=87068) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 18:01:52 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b848963a-7f74-4e25-96e6-c0cfdec27275]: (4, 'raw') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:01:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_987dc24f-a6cb-4c70-b2ca-023f3e436541_wxdaoh8g {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:52 devstack sudo[104060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_987dc24f-a6cb-4c70-b2ca-023f3e436541_wxdaoh8g Nov 06 18:01:52 devstack sudo[104060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:52 devstack sudo[104058]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a4ab8af3-edb2-4446-a15f-6532071524ed tempest-ProjectReaderTests-1677890695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.384s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:52 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-a4ab8af3-edb2-4446-a15f-6532071524ed tempest-ProjectReaderTests-1677890695 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:01:52 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-a4ab8af3-edb2-4446-a15f-6532071524ed tempest-ProjectReaderTests-1677890695 None] Deleted volume successfully. Nov 06 18:01:52 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a4ab8af3-edb2-4446-a15f-6532071524ed tempest-ProjectReaderTests-1677890695 None] Lock "cinder-1205625a-7f86-4092-b4e0-93ca85319b2d-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:01:52 devstack sudo[104060]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_987dc24f-a6cb-4c70-b2ca-023f3e436541_wxdaoh8g" returned: 0 in 0.433s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_987dc24f-a6cb-4c70-b2ca-023f3e436541_wxdaoh8g {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:52 devstack sudo[104065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_987dc24f-a6cb-4c70-b2ca-023f3e436541_wxdaoh8g Nov 06 18:01:52 devstack sudo[104065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:52 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-e35a3003-015c-4091-91f1-8f8aba8d71e4 tempest-ProjectReaderTests-1677890695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:01:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e35a3003-015c-4091-91f1-8f8aba8d71e4 tempest-ProjectReaderTests-1677890695 None] Flow 'volume_create_manager' (3cc1e7c9-e096-4cdc-90d8-456c6af68232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:01:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e35a3003-015c-4091-91f1-8f8aba8d71e4 tempest-ProjectReaderTests-1677890695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76891e94-5b0a-4eac-acef-291c7cd3b477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:01:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e35a3003-015c-4091-91f1-8f8aba8d71e4 tempest-ProjectReaderTests-1677890695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76891e94-5b0a-4eac-acef-291c7cd3b477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:01:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-195969321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e79e1c53-8a80-4794-899a-a5cb08c8670b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b700f8a4a4d4e008e4bf0e11f489f5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:01:53Z,use_quota=True,user_id='08db92c9ca0d44ce92d0bf92903edbaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e35a3003-015c-4091-91f1-8f8aba8d71e4 tempest-ProjectReaderTests-1677890695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c336851-136f-44af-8b73-23c04be2d046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:01:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e35a3003-015c-4091-91f1-8f8aba8d71e4 tempest-ProjectReaderTests-1677890695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c336851-136f-44af-8b73-23c04be2d046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e35a3003-015c-4091-91f1-8f8aba8d71e4 tempest-ProjectReaderTests-1677890695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f280b6dc-9706-4b23-9320-cc6738ee8612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:01:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e35a3003-015c-4091-91f1-8f8aba8d71e4 tempest-ProjectReaderTests-1677890695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f280b6dc-9706-4b23-9320-cc6738ee8612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e79e1c53-8a80-4794-899a-a5cb08c8670b', 'volume_name': 'volume-e79e1c53-8a80-4794-899a-a5cb08c8670b', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e35a3003-015c-4091-91f1-8f8aba8d71e4 tempest-ProjectReaderTests-1677890695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcce810e-19fd-40db-82b2-3c2fad2537f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:01:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e35a3003-015c-4091-91f1-8f8aba8d71e4 tempest-ProjectReaderTests-1677890695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcce810e-19fd-40db-82b2-3c2fad2537f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e35a3003-015c-4091-91f1-8f8aba8d71e4 tempest-ProjectReaderTests-1677890695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63c36562-de3b-4b21-b909-7b1ff6d1524e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:01:52 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-e35a3003-015c-4091-91f1-8f8aba8d71e4 tempest-ProjectReaderTests-1677890695 None] Volume e79e1c53-8a80-4794-899a-a5cb08c8670b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e79e1c53-8a80-4794-899a-a5cb08c8670b', 'volume_size': 1} Nov 06 18:01:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e35a3003-015c-4091-91f1-8f8aba8d71e4 tempest-ProjectReaderTests-1677890695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:01:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e35a3003-015c-4091-91f1-8f8aba8d71e4 tempest-ProjectReaderTests-1677890695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:01:52 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e35a3003-015c-4091-91f1-8f8aba8d71e4 tempest-ProjectReaderTests-1677890695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:01:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-195969321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e79e1c53-8a80-4794-899a-a5cb08c8670b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b700f8a4a4d4e008e4bf0e11f489f5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:01:53Z,use_quota=True,user_id='08db92c9ca0d44ce92d0bf92903edbaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:01:52 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-e35a3003-015c-4091-91f1-8f8aba8d71e4 tempest-ProjectReaderTests-1677890695 None] Creating volume e79e1c53-8a80-4794-899a-a5cb08c8670b {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:01:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e35a3003-015c-4091-91f1-8f8aba8d71e4 tempest-ProjectReaderTests-1677890695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:01:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e35a3003-015c-4091-91f1-8f8aba8d71e4 tempest-ProjectReaderTests-1677890695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:01:52 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e35a3003-015c-4091-91f1-8f8aba8d71e4 tempest-ProjectReaderTests-1677890695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:01:52 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e35a3003-015c-4091-91f1-8f8aba8d71e4 tempest-ProjectReaderTests-1677890695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:01:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e35a3003-015c-4091-91f1-8f8aba8d71e4 tempest-ProjectReaderTests-1677890695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:01:52 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e35a3003-015c-4091-91f1-8f8aba8d71e4 tempest-ProjectReaderTests-1677890695 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:01:52 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-e35a3003-015c-4091-91f1-8f8aba8d71e4 tempest-ProjectReaderTests-1677890695 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:01:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e35a3003-015c-4091-91f1-8f8aba8d71e4 tempest-ProjectReaderTests-1677890695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e79e1c53-8a80-4794-899a-a5cb08c8670b 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:52 devstack sudo[104073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e79e1c53-8a80-4794-899a-a5cb08c8670b 1073741824 Nov 06 18:01:52 devstack sudo[104073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:52 devstack sudo[104065]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_987dc24f-a6cb-4c70-b2ca-023f3e436541_wxdaoh8g" returned: 1 in 0.403s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_987dc24f-a6cb-4c70-b2ca-023f3e436541_wxdaoh8g' failed. Not Retrying. {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 18:01:52 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4cd0c1-4850-4d0e-92a2-4f8a3c185358]: (4, 'raw') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:01:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_987dc24f-a6cb-4c70-b2ca-023f3e436541_tgg51zfedevstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:53 devstack sudo[104077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_987dc24f-a6cb-4c70-b2ca-023f3e436541_tgg51zfedevstack@QuobyteHD Nov 06 18:01:53 devstack sudo[104077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:53 devstack sudo[104077]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:53 devstack sudo[104073]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_987dc24f-a6cb-4c70-b2ca-023f3e436541_tgg51zfedevstack@QuobyteHD" returned: 0 in 0.428s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_987dc24f-a6cb-4c70-b2ca-023f3e436541_tgg51zfedevstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e35a3003-015c-4091-91f1-8f8aba8d71e4 tempest-ProjectReaderTests-1677890695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e79e1c53-8a80-4794-899a-a5cb08c8670b 1073741824" returned: 0 in 0.549s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e35a3003-015c-4091-91f1-8f8aba8d71e4 tempest-ProjectReaderTests-1677890695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e79e1c53-8a80-4794-899a-a5cb08c8670b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:53 devstack sudo[104086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e79e1c53-8a80-4794-899a-a5cb08c8670b Nov 06 18:01:53 devstack sudo[104086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:53 devstack sudo[104085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_987dc24f-a6cb-4c70-b2ca-023f3e436541_tgg51zfedevstack@QuobyteHD Nov 06 18:01:53 devstack sudo[104085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:53 devstack sudo[104086]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e35a3003-015c-4091-91f1-8f8aba8d71e4 tempest-ProjectReaderTests-1677890695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e79e1c53-8a80-4794-899a-a5cb08c8670b" returned: 0 in 0.360s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e35a3003-015c-4091-91f1-8f8aba8d71e4 tempest-ProjectReaderTests-1677890695 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:01:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e35a3003-015c-4091-91f1-8f8aba8d71e4 tempest-ProjectReaderTests-1677890695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:01:53 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e35a3003-015c-4091-91f1-8f8aba8d71e4 tempest-ProjectReaderTests-1677890695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63c36562-de3b-4b21-b909-7b1ff6d1524e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e79e1c53-8a80-4794-899a-a5cb08c8670b', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:53 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e35a3003-015c-4091-91f1-8f8aba8d71e4 tempest-ProjectReaderTests-1677890695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df74724e-ca5a-49e6-8572-14861099a59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:01:53 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-e35a3003-015c-4091-91f1-8f8aba8d71e4 tempest-ProjectReaderTests-1677890695 None] Volume volume-e79e1c53-8a80-4794-899a-a5cb08c8670b (e79e1c53-8a80-4794-899a-a5cb08c8670b): created successfully Nov 06 18:01:53 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e35a3003-015c-4091-91f1-8f8aba8d71e4 tempest-ProjectReaderTests-1677890695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df74724e-ca5a-49e6-8572-14861099a59a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:53 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e35a3003-015c-4091-91f1-8f8aba8d71e4 tempest-ProjectReaderTests-1677890695 None] Flow 'volume_create_manager' (3cc1e7c9-e096-4cdc-90d8-456c6af68232) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:01:53 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-e35a3003-015c-4091-91f1-8f8aba8d71e4 tempest-ProjectReaderTests-1677890695 None] Created volume successfully. Nov 06 18:01:53 devstack sudo[104085]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_987dc24f-a6cb-4c70-b2ca-023f3e436541_tgg51zfedevstack@QuobyteHD" returned: 1 in 0.595s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_987dc24f-a6cb-4c70-b2ca-023f3e436541_tgg51zfedevstack@QuobyteHD' failed. Not Retrying. {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 18:01:53 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] 987dc24f-a6cb-4c70-b2ca-023f3e436541 was raw, converting to qcow2 {{(pid=87068) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 06 18:01:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_987dc24f-a6cb-4c70-b2ca-023f3e436541_tgg51zfedevstack@QuobyteHD /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e51e7a14-4872-4742-a19f-7e5af8ba2153 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:53 devstack sudo[104094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_987dc24f-a6cb-4c70-b2ca-023f3e436541_tgg51zfedevstack@QuobyteHD /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e51e7a14-4872-4742-a19f-7e5af8ba2153 Nov 06 18:01:53 devstack sudo[104094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:54 devstack sudo[104094]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:54 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 18:01:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:01:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:01:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:01:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:01:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:01:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_987dc24f-a6cb-4c70-b2ca-023f3e436541_tgg51zfedevstack@QuobyteHD /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e51e7a14-4872-4742-a19f-7e5af8ba2153" returned: 0 in 0.571s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:54 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_987dc24f-a6cb-4c70-b2ca-023f3e436541_tgg51zfedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e51e7a14-4872-4742-a19f-7e5af8ba2153 {{(pid=87068) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 18:01:54 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Converted 0.00 MB image at 0.00 MB/s Nov 06 18:01:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e51e7a14-4872-4742-a19f-7e5af8ba2153 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:54 devstack sudo[104099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:01:54 devstack sudo[104099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:54 devstack sudo[104101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e51e7a14-4872-4742-a19f-7e5af8ba2153 1G Nov 06 18:01:54 devstack sudo[104101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:54 devstack sudo[104099]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.321s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:54 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:01:54 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running periodic task VolumeManager._thread_info {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 18:01:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] thread count: 28 {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 18:01:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] thread info: [<_MainThread(MainThread, started 133940619505792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 18:01:54 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ebecf190-05e6-4511-a0f3-97e047746a77 tempest-ProjectReaderTests-1677890695 None] Acquiring lock "cinder-e79e1c53-8a80-4794-899a-a5cb08c8670b-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:01:54 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ebecf190-05e6-4511-a0f3-97e047746a77 tempest-ProjectReaderTests-1677890695 None] Lock "cinder-e79e1c53-8a80-4794-899a-a5cb08c8670b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:01:54 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ebecf190-05e6-4511-a0f3-97e047746a77 tempest-ProjectReaderTests-1677890695 None] Acquiring lock "cinder-quobyte-e79e1c53-8a80-4794-899a-a5cb08c8670b" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:01:54 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ebecf190-05e6-4511-a0f3-97e047746a77 tempest-ProjectReaderTests-1677890695 None] Lock "cinder-quobyte-e79e1c53-8a80-4794-899a-a5cb08c8670b" acquired by "delete_volume" :: waited 0.025s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:01:54 devstack sudo[104101]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e51e7a14-4872-4742-a19f-7e5af8ba2153 1G" returned: 0 in 0.469s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:54 devstack cinder-volume[87068]: DEBUG cinder.volume.volume_utils [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Downloaded image 987dc24f-a6cb-4c70-b2ca-023f3e436541 ((None, [{'url': 'file:///opt/stack/data/glance/images/987dc24f-a6cb-4c70-b2ca-023f3e436541', 'metadata': {}}])) to volume e51e7a14-4872-4742-a19f-7e5af8ba2153 successfully. {{(pid=87068) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 18:01:54 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Temporary image 987dc24f-a6cb-4c70-b2ca-023f3e436541 for user a099c51c5c874ccd847de59b30d0478d is deleted. {{(pid=87068) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 06 18:01:54 devstack cinder-volume[87068]: DEBUG cinder.volume.volume_utils [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Marking volume e51e7a14-4872-4742-a19f-7e5af8ba2153 as bootable. {{(pid=87068) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 18:01:55 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Copying metadata from image 987dc24f-a6cb-4c70-b2ca-023f3e436541 to e51e7a14-4872-4742-a19f-7e5af8ba2153. {{(pid=87068) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 18:01:55 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Creating volume glance metadata for volume e51e7a14-4872-4742-a19f-7e5af8ba2153 backed by image 987dc24f-a6cb-4c70-b2ca-023f3e436541 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '987dc24f-a6cb-4c70-b2ca-023f3e436541', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '02cb72c138e06e4fb74d457f36fe0d13', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87068) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 18:01:55 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8aa10a-10c1-4182-a57c-ed4567bc8936]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:01:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ebecf190-05e6-4511-a0f3-97e047746a77 tempest-ProjectReaderTests-1677890695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e79e1c53-8a80-4794-899a-a5cb08c8670b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (115e34c3-248b-46f1-a301-b38e2b75f393) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e51e7a14-4872-4742-a19f-7e5af8ba2153', 'volume_size': 1, 'image_id': '987dc24f-a6cb-4c70-b2ca-023f3e436541', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/987dc24f-a6cb-4c70-b2ca-023f3e436541', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '02cb72c138e06e4fb74d457f36fe0d13', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8c8e54df574446e5a09c25138517e17e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c11bf2d8fb30b247c202fd50e73d3817760b72c78c19fab71c733eba6ebf89c51a59a93e5092d20127734382a2e3dfb6e7f01f40af7607946f62b5c37c1ff808', 'id': '987dc24f-a6cb-4c70-b2ca-023f3e436541', 'created_at': datetime.datetime(2026, 11, 6, 17, 1, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 17, 1, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/987dc24f-a6cb-4c70-b2ca-023f3e436541/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da146c76-cedb-4d16-abbf-64fa1a0e970f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:01:55 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Volume volume-e51e7a14-4872-4742-a19f-7e5af8ba2153 (e51e7a14-4872-4742-a19f-7e5af8ba2153): created successfully Nov 06 18:01:55 devstack sudo[104107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e79e1c53-8a80-4794-899a-a5cb08c8670b Nov 06 18:01:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da146c76-cedb-4d16-abbf-64fa1a0e970f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:01:55 devstack sudo[104107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Flow 'volume_create_manager' (6ac1b90a-cd56-473e-88d8-68524b829b6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:01:55 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-cf0eb9e5-3a45-4005-a973-e33beb1d3b6b tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Created volume successfully. Nov 06 18:01:55 devstack sudo[104107]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ebecf190-05e6-4511-a0f3-97e047746a77 tempest-ProjectReaderTests-1677890695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e79e1c53-8a80-4794-899a-a5cb08c8670b" returned: 0 in 0.384s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ebecf190-05e6-4511-a0f3-97e047746a77 tempest-ProjectReaderTests-1677890695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e79e1c53-8a80-4794-899a-a5cb08c8670b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:55 devstack sudo[104112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e79e1c53-8a80-4794-899a-a5cb08c8670b Nov 06 18:01:55 devstack sudo[104112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:55 devstack sudo[104112]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ebecf190-05e6-4511-a0f3-97e047746a77 tempest-ProjectReaderTests-1677890695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e79e1c53-8a80-4794-899a-a5cb08c8670b" returned: 0 in 0.306s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ebecf190-05e6-4511-a0f3-97e047746a77 tempest-ProjectReaderTests-1677890695 None] Lock "cinder-quobyte-e79e1c53-8a80-4794-899a-a5cb08c8670b" released by "delete_volume" :: held 0.750s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:01:55 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-ebecf190-05e6-4511-a0f3-97e047746a77 tempest-ProjectReaderTests-1677890695 None] Created reservations ['eda7540d-d8bd-45d0-a61c-2c01d58c311a', 'b97799c3-5eb3-42ff-b095-754d5040987b', 'f183ce5e-212e-4e03-876a-668e3e9a7025', '753c3141-5f0e-40a7-a12e-2e6c0f51c7d5'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:01:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ebecf190-05e6-4511-a0f3-97e047746a77 tempest-ProjectReaderTests-1677890695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:01:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ebecf190-05e6-4511-a0f3-97e047746a77 tempest-ProjectReaderTests-1677890695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:01:55 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ebecf190-05e6-4511-a0f3-97e047746a77 tempest-ProjectReaderTests-1677890695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:01:55 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ebecf190-05e6-4511-a0f3-97e047746a77 tempest-ProjectReaderTests-1677890695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:01:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ebecf190-05e6-4511-a0f3-97e047746a77 tempest-ProjectReaderTests-1677890695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:01:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ebecf190-05e6-4511-a0f3-97e047746a77 tempest-ProjectReaderTests-1677890695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:55 devstack sudo[104149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:01:55 devstack sudo[104149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:56 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-fc082ec4-460f-4c45-86ba-a2c55ac08113 tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Acquiring lock "cinder-e51e7a14-4872-4742-a19f-7e5af8ba2153-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:01:56 devstack sudo[104149]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:56 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-fc082ec4-460f-4c45-86ba-a2c55ac08113 tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Lock "cinder-e51e7a14-4872-4742-a19f-7e5af8ba2153-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:01:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ebecf190-05e6-4511-a0f3-97e047746a77 tempest-ProjectReaderTests-1677890695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.428s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:56 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-ebecf190-05e6-4511-a0f3-97e047746a77 tempest-ProjectReaderTests-1677890695 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:01:56 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-ebecf190-05e6-4511-a0f3-97e047746a77 tempest-ProjectReaderTests-1677890695 None] Deleted volume successfully. Nov 06 18:01:56 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-fc082ec4-460f-4c45-86ba-a2c55ac08113 tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Acquiring lock "cinder-quobyte-e51e7a14-4872-4742-a19f-7e5af8ba2153" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:01:56 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ebecf190-05e6-4511-a0f3-97e047746a77 tempest-ProjectReaderTests-1677890695 None] Lock "cinder-e79e1c53-8a80-4794-899a-a5cb08c8670b-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:01:56 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-fc082ec4-460f-4c45-86ba-a2c55ac08113 tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Lock "cinder-quobyte-e51e7a14-4872-4742-a19f-7e5af8ba2153" acquired by "delete_volume" :: waited 0.026s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:01:56 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac46452-d59a-494d-9540-a5fd3ebd4848]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:01:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fc082ec4-460f-4c45-86ba-a2c55ac08113 tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e51e7a14-4872-4742-a19f-7e5af8ba2153 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:56 devstack sudo[104154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e51e7a14-4872-4742-a19f-7e5af8ba2153 Nov 06 18:01:56 devstack sudo[104154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:56 devstack sudo[104154]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fc082ec4-460f-4c45-86ba-a2c55ac08113 tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e51e7a14-4872-4742-a19f-7e5af8ba2153" returned: 0 in 0.373s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fc082ec4-460f-4c45-86ba-a2c55ac08113 tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e51e7a14-4872-4742-a19f-7e5af8ba2153 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:56 devstack sudo[104159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e51e7a14-4872-4742-a19f-7e5af8ba2153 Nov 06 18:01:56 devstack sudo[104159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:57 devstack sudo[104159]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fc082ec4-460f-4c45-86ba-a2c55ac08113 tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e51e7a14-4872-4742-a19f-7e5af8ba2153" returned: 0 in 0.268s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-fc082ec4-460f-4c45-86ba-a2c55ac08113 tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Lock "cinder-quobyte-e51e7a14-4872-4742-a19f-7e5af8ba2153" released by "delete_volume" :: held 0.699s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:01:57 devstack cinder-volume[87068]: WARNING cinder.quota [None req-fc082ec4-460f-4c45-86ba-a2c55ac08113 tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 06 18:01:57 devstack cinder-volume[87068]: WARNING cinder.quota [None req-fc082ec4-460f-4c45-86ba-a2c55ac08113 tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 06 18:01:57 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-fc082ec4-460f-4c45-86ba-a2c55ac08113 tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Created reservations ['e18a9035-805e-4d00-bc03-b2d7fd1d0c59', 'ea0626fa-b19d-4fcd-986d-654f39e803c6', '7c1a033b-75e4-4941-8ef1-b8b7ca64f2ba', '16d0e561-a5ce-4561-85b9-6d617d2a7779'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:01:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fc082ec4-460f-4c45-86ba-a2c55ac08113 tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:01:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fc082ec4-460f-4c45-86ba-a2c55ac08113 tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:01:57 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fc082ec4-460f-4c45-86ba-a2c55ac08113 tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:01:57 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fc082ec4-460f-4c45-86ba-a2c55ac08113 tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:01:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fc082ec4-460f-4c45-86ba-a2c55ac08113 tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:01:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fc082ec4-460f-4c45-86ba-a2c55ac08113 tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:01:57 devstack sudo[104162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:01:57 devstack sudo[104162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:01:57 devstack sudo[104162]: pam_unix(sudo:session): session closed for user root Nov 06 18:01:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fc082ec4-460f-4c45-86ba-a2c55ac08113 tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.316s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:01:57 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-fc082ec4-460f-4c45-86ba-a2c55ac08113 tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:01:57 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-fc082ec4-460f-4c45-86ba-a2c55ac08113 tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Deleted volume successfully. Nov 06 18:01:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-fc082ec4-460f-4c45-86ba-a2c55ac08113 tempest-VolumeAndVolumeTypeFromImageTest-1401193257 None] Lock "cinder-e51e7a14-4872-4742-a19f-7e5af8ba2153-delete_volume" released by "delete_volume" :: held 1.345s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:02:03 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b6c3278-3a26-4ee4-a165-2575b51f3182 tempest-CreateVolumesFromImageTest-1636374441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:02:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7b6c3278-3a26-4ee4-a165-2575b51f3182 tempest-CreateVolumesFromImageTest-1636374441 None] Flow 'volume_create_manager' (fe91ac39-2647-4642-b7d1-c26b58d538bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:02:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7b6c3278-3a26-4ee4-a165-2575b51f3182 tempest-CreateVolumesFromImageTest-1636374441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5794461-3d47-4602-9b7b-bb95e809247c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7b6c3278-3a26-4ee4-a165-2575b51f3182 tempest-CreateVolumesFromImageTest-1636374441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5794461-3d47-4602-9b7b-bb95e809247c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:02:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-519275283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f1a52aa-b858-4485-a4a7-553babae365e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f32e0a95497455ebfa59580b08a4e1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:02:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:02:03Z,use_quota=True,user_id='520816fe38f24575adb828847f46b037',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7b6c3278-3a26-4ee4-a165-2575b51f3182 tempest-CreateVolumesFromImageTest-1636374441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93717828-87b7-4988-b7b7-c1eff15ea91c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7b6c3278-3a26-4ee4-a165-2575b51f3182 tempest-CreateVolumesFromImageTest-1636374441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93717828-87b7-4988-b7b7-c1eff15ea91c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7b6c3278-3a26-4ee4-a165-2575b51f3182 tempest-CreateVolumesFromImageTest-1636374441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08a0ee90-892a-4e21-a1d0-c8adacdb1d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7b6c3278-3a26-4ee4-a165-2575b51f3182 tempest-CreateVolumesFromImageTest-1636374441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08a0ee90-892a-4e21-a1d0-c8adacdb1d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f1a52aa-b858-4485-a4a7-553babae365e', 'volume_name': 'volume-5f1a52aa-b858-4485-a4a7-553babae365e', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7b6c3278-3a26-4ee4-a165-2575b51f3182 tempest-CreateVolumesFromImageTest-1636374441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5b031a7-6fcc-43de-bab2-38db20cfc1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7b6c3278-3a26-4ee4-a165-2575b51f3182 tempest-CreateVolumesFromImageTest-1636374441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5b031a7-6fcc-43de-bab2-38db20cfc1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7b6c3278-3a26-4ee4-a165-2575b51f3182 tempest-CreateVolumesFromImageTest-1636374441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65aecf5b-fee9-4e5d-9ed3-9ef0eb3ecb42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:03 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-7b6c3278-3a26-4ee4-a165-2575b51f3182 tempest-CreateVolumesFromImageTest-1636374441 None] Volume 5f1a52aa-b858-4485-a4a7-553babae365e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f1a52aa-b858-4485-a4a7-553babae365e', 'volume_size': 1} Nov 06 18:02:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7b6c3278-3a26-4ee4-a165-2575b51f3182 tempest-CreateVolumesFromImageTest-1636374441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:02:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7b6c3278-3a26-4ee4-a165-2575b51f3182 tempest-CreateVolumesFromImageTest-1636374441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:02:03 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7b6c3278-3a26-4ee4-a165-2575b51f3182 tempest-CreateVolumesFromImageTest-1636374441 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:02:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-519275283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f1a52aa-b858-4485-a4a7-553babae365e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f32e0a95497455ebfa59580b08a4e1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:02:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:02:03Z,use_quota=True,user_id='520816fe38f24575adb828847f46b037',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:02:03 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-7b6c3278-3a26-4ee4-a165-2575b51f3182 tempest-CreateVolumesFromImageTest-1636374441 None] Creating volume 5f1a52aa-b858-4485-a4a7-553babae365e {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:02:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7b6c3278-3a26-4ee4-a165-2575b51f3182 tempest-CreateVolumesFromImageTest-1636374441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:02:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7b6c3278-3a26-4ee4-a165-2575b51f3182 tempest-CreateVolumesFromImageTest-1636374441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:02:03 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7b6c3278-3a26-4ee4-a165-2575b51f3182 tempest-CreateVolumesFromImageTest-1636374441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:02:03 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7b6c3278-3a26-4ee4-a165-2575b51f3182 tempest-CreateVolumesFromImageTest-1636374441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:02:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7b6c3278-3a26-4ee4-a165-2575b51f3182 tempest-CreateVolumesFromImageTest-1636374441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:02:03 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7b6c3278-3a26-4ee4-a165-2575b51f3182 tempest-CreateVolumesFromImageTest-1636374441 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:02:03 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-7b6c3278-3a26-4ee4-a165-2575b51f3182 tempest-CreateVolumesFromImageTest-1636374441 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:02:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7b6c3278-3a26-4ee4-a165-2575b51f3182 tempest-CreateVolumesFromImageTest-1636374441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5f1a52aa-b858-4485-a4a7-553babae365e 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:03 devstack sudo[104166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5f1a52aa-b858-4485-a4a7-553babae365e 1073741824 Nov 06 18:02:03 devstack sudo[104166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:03 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-97d6d3c9-b2f5-46fa-8fda-d76802135bf5 tempest-CreateVolumesFromImageTest-1636374441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:02:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-97d6d3c9-b2f5-46fa-8fda-d76802135bf5 tempest-CreateVolumesFromImageTest-1636374441 None] Flow 'volume_create_manager' (9e2a5ce3-a866-46c0-bd41-39b1050e2e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:02:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-97d6d3c9-b2f5-46fa-8fda-d76802135bf5 tempest-CreateVolumesFromImageTest-1636374441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fc341d6-d516-4fc9-b462-c4fa7a206daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-97d6d3c9-b2f5-46fa-8fda-d76802135bf5 tempest-CreateVolumesFromImageTest-1636374441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fc341d6-d516-4fc9-b462-c4fa7a206daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:02:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-716095484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67cbafe0-6b57-4e65-a44d-8dc7fce0f99f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f32e0a95497455ebfa59580b08a4e1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:02:04Z,use_quota=True,user_id='520816fe38f24575adb828847f46b037',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-97d6d3c9-b2f5-46fa-8fda-d76802135bf5 tempest-CreateVolumesFromImageTest-1636374441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8e98164-abc5-4904-8eb0-e58f13e57a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-97d6d3c9-b2f5-46fa-8fda-d76802135bf5 tempest-CreateVolumesFromImageTest-1636374441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8e98164-abc5-4904-8eb0-e58f13e57a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-97d6d3c9-b2f5-46fa-8fda-d76802135bf5 tempest-CreateVolumesFromImageTest-1636374441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ad4802d-7330-47fb-811b-e6c675b0b1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-97d6d3c9-b2f5-46fa-8fda-d76802135bf5 tempest-CreateVolumesFromImageTest-1636374441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ad4802d-7330-47fb-811b-e6c675b0b1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67cbafe0-6b57-4e65-a44d-8dc7fce0f99f', 'volume_name': 'volume-67cbafe0-6b57-4e65-a44d-8dc7fce0f99f', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-97d6d3c9-b2f5-46fa-8fda-d76802135bf5 tempest-CreateVolumesFromImageTest-1636374441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e88d0923-5164-49ad-9e40-4eeb104167c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-97d6d3c9-b2f5-46fa-8fda-d76802135bf5 tempest-CreateVolumesFromImageTest-1636374441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e88d0923-5164-49ad-9e40-4eeb104167c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:04 devstack sudo[104166]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-97d6d3c9-b2f5-46fa-8fda-d76802135bf5 tempest-CreateVolumesFromImageTest-1636374441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ddc0807-264d-4cb8-b05f-3618c3924c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:04 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-97d6d3c9-b2f5-46fa-8fda-d76802135bf5 tempest-CreateVolumesFromImageTest-1636374441 None] Volume 67cbafe0-6b57-4e65-a44d-8dc7fce0f99f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67cbafe0-6b57-4e65-a44d-8dc7fce0f99f', 'volume_size': 1} Nov 06 18:02:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-97d6d3c9-b2f5-46fa-8fda-d76802135bf5 tempest-CreateVolumesFromImageTest-1636374441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:02:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7b6c3278-3a26-4ee4-a165-2575b51f3182 tempest-CreateVolumesFromImageTest-1636374441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5f1a52aa-b858-4485-a4a7-553babae365e 1073741824" returned: 0 in 0.794s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7b6c3278-3a26-4ee4-a165-2575b51f3182 tempest-CreateVolumesFromImageTest-1636374441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5f1a52aa-b858-4485-a4a7-553babae365e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:04 devstack sudo[104172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5f1a52aa-b858-4485-a4a7-553babae365e Nov 06 18:02:04 devstack sudo[104172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:04 devstack sudo[104172]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7b6c3278-3a26-4ee4-a165-2575b51f3182 tempest-CreateVolumesFromImageTest-1636374441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5f1a52aa-b858-4485-a4a7-553babae365e" returned: 0 in 0.370s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:04 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7b6c3278-3a26-4ee4-a165-2575b51f3182 tempest-CreateVolumesFromImageTest-1636374441 None] <== create_volume: return (1247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:02:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7b6c3278-3a26-4ee4-a165-2575b51f3182 tempest-CreateVolumesFromImageTest-1636374441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.254s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:02:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-97d6d3c9-b2f5-46fa-8fda-d76802135bf5 tempest-CreateVolumesFromImageTest-1636374441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.448s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:02:04 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-97d6d3c9-b2f5-46fa-8fda-d76802135bf5 tempest-CreateVolumesFromImageTest-1636374441 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:02:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-716095484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67cbafe0-6b57-4e65-a44d-8dc7fce0f99f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f32e0a95497455ebfa59580b08a4e1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:02:04Z,use_quota=True,user_id='520816fe38f24575adb828847f46b037',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:02:04 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-97d6d3c9-b2f5-46fa-8fda-d76802135bf5 tempest-CreateVolumesFromImageTest-1636374441 None] Creating volume 67cbafe0-6b57-4e65-a44d-8dc7fce0f99f {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:02:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-97d6d3c9-b2f5-46fa-8fda-d76802135bf5 tempest-CreateVolumesFromImageTest-1636374441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:02:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-97d6d3c9-b2f5-46fa-8fda-d76802135bf5 tempest-CreateVolumesFromImageTest-1636374441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:02:04 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-97d6d3c9-b2f5-46fa-8fda-d76802135bf5 tempest-CreateVolumesFromImageTest-1636374441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:02:04 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-97d6d3c9-b2f5-46fa-8fda-d76802135bf5 tempest-CreateVolumesFromImageTest-1636374441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:02:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-97d6d3c9-b2f5-46fa-8fda-d76802135bf5 tempest-CreateVolumesFromImageTest-1636374441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:02:04 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-97d6d3c9-b2f5-46fa-8fda-d76802135bf5 tempest-CreateVolumesFromImageTest-1636374441 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:02:04 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-97d6d3c9-b2f5-46fa-8fda-d76802135bf5 tempest-CreateVolumesFromImageTest-1636374441 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:02:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97d6d3c9-b2f5-46fa-8fda-d76802135bf5 tempest-CreateVolumesFromImageTest-1636374441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-67cbafe0-6b57-4e65-a44d-8dc7fce0f99f 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7b6c3278-3a26-4ee4-a165-2575b51f3182 tempest-CreateVolumesFromImageTest-1636374441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65aecf5b-fee9-4e5d-9ed3-9ef0eb3ecb42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f1a52aa-b858-4485-a4a7-553babae365e', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7b6c3278-3a26-4ee4-a165-2575b51f3182 tempest-CreateVolumesFromImageTest-1636374441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4858ea85-9bf1-41e4-9548-8a15b9e52e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:04 devstack sudo[104175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-67cbafe0-6b57-4e65-a44d-8dc7fce0f99f 1073741824 Nov 06 18:02:04 devstack sudo[104175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:04 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-7b6c3278-3a26-4ee4-a165-2575b51f3182 tempest-CreateVolumesFromImageTest-1636374441 None] Volume volume-5f1a52aa-b858-4485-a4a7-553babae365e (5f1a52aa-b858-4485-a4a7-553babae365e): created successfully Nov 06 18:02:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7b6c3278-3a26-4ee4-a165-2575b51f3182 tempest-CreateVolumesFromImageTest-1636374441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4858ea85-9bf1-41e4-9548-8a15b9e52e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7b6c3278-3a26-4ee4-a165-2575b51f3182 tempest-CreateVolumesFromImageTest-1636374441 None] Flow 'volume_create_manager' (fe91ac39-2647-4642-b7d1-c26b58d538bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:02:04 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-7b6c3278-3a26-4ee4-a165-2575b51f3182 tempest-CreateVolumesFromImageTest-1636374441 None] Created volume successfully. Nov 06 18:02:04 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-c342ff74-36ee-466e-9a86-30297a44b8c8 tempest-CreateVolumesFromImageTest-1636374441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:02:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c342ff74-36ee-466e-9a86-30297a44b8c8 tempest-CreateVolumesFromImageTest-1636374441 None] Flow 'volume_create_manager' (8f7a919e-f47e-4baf-a42c-4a61f7a782d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:02:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c342ff74-36ee-466e-9a86-30297a44b8c8 tempest-CreateVolumesFromImageTest-1636374441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1132f214-3e3f-4b61-bf18-6cc4b85eedfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c342ff74-36ee-466e-9a86-30297a44b8c8 tempest-CreateVolumesFromImageTest-1636374441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1132f214-3e3f-4b61-bf18-6cc4b85eedfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2098777231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=767c1cb8-28c1-4d79-9b2b-9b61d1ca8b7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f32e0a95497455ebfa59580b08a4e1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:02:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:02:05Z,use_quota=True,user_id='520816fe38f24575adb828847f46b037',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c342ff74-36ee-466e-9a86-30297a44b8c8 tempest-CreateVolumesFromImageTest-1636374441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f05de778-cd44-4072-b213-e37f71ab3a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c342ff74-36ee-466e-9a86-30297a44b8c8 tempest-CreateVolumesFromImageTest-1636374441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f05de778-cd44-4072-b213-e37f71ab3a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c342ff74-36ee-466e-9a86-30297a44b8c8 tempest-CreateVolumesFromImageTest-1636374441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cb75b18-f3a5-44df-bf4a-dccd607b9dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c342ff74-36ee-466e-9a86-30297a44b8c8 tempest-CreateVolumesFromImageTest-1636374441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cb75b18-f3a5-44df-bf4a-dccd607b9dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '767c1cb8-28c1-4d79-9b2b-9b61d1ca8b7c', 'volume_name': 'volume-767c1cb8-28c1-4d79-9b2b-9b61d1ca8b7c', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c342ff74-36ee-466e-9a86-30297a44b8c8 tempest-CreateVolumesFromImageTest-1636374441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d20f01f7-f4e7-48b6-b7e0-288ac45213b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c342ff74-36ee-466e-9a86-30297a44b8c8 tempest-CreateVolumesFromImageTest-1636374441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d20f01f7-f4e7-48b6-b7e0-288ac45213b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c342ff74-36ee-466e-9a86-30297a44b8c8 tempest-CreateVolumesFromImageTest-1636374441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad047d7d-4485-4a00-b706-b3ff74823127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:04 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-c342ff74-36ee-466e-9a86-30297a44b8c8 tempest-CreateVolumesFromImageTest-1636374441 None] Volume 767c1cb8-28c1-4d79-9b2b-9b61d1ca8b7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-767c1cb8-28c1-4d79-9b2b-9b61d1ca8b7c', 'volume_size': 1} Nov 06 18:02:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c342ff74-36ee-466e-9a86-30297a44b8c8 tempest-CreateVolumesFromImageTest-1636374441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:02:05 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-63966e4f-49ed-4e01-b97a-69deabe1ea56 tempest-CreateVolumesFromImageTest-1636374441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:02:05 devstack sudo[104175]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-63966e4f-49ed-4e01-b97a-69deabe1ea56 tempest-CreateVolumesFromImageTest-1636374441 None] Flow 'volume_create_manager' (8a7ded1e-c8d9-4249-939a-9da2dcc09d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:02:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-63966e4f-49ed-4e01-b97a-69deabe1ea56 tempest-CreateVolumesFromImageTest-1636374441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74b325e7-6a3d-4d43-9214-972ddd7f99d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97d6d3c9-b2f5-46fa-8fda-d76802135bf5 tempest-CreateVolumesFromImageTest-1636374441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-67cbafe0-6b57-4e65-a44d-8dc7fce0f99f 1073741824" returned: 0 in 0.912s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-63966e4f-49ed-4e01-b97a-69deabe1ea56 tempest-CreateVolumesFromImageTest-1636374441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74b325e7-6a3d-4d43-9214-972ddd7f99d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:02:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-316652109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df51b1e7-ccab-4c1d-ad83-870d2150a96a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f32e0a95497455ebfa59580b08a4e1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:02:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:02:05Z,use_quota=True,user_id='520816fe38f24575adb828847f46b037',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-63966e4f-49ed-4e01-b97a-69deabe1ea56 tempest-CreateVolumesFromImageTest-1636374441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20dadbbc-eaea-4544-9163-2eec3852bc12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-63966e4f-49ed-4e01-b97a-69deabe1ea56 tempest-CreateVolumesFromImageTest-1636374441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20dadbbc-eaea-4544-9163-2eec3852bc12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-63966e4f-49ed-4e01-b97a-69deabe1ea56 tempest-CreateVolumesFromImageTest-1636374441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b6f1ba9-ba3b-4912-b70d-269152b00ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-63966e4f-49ed-4e01-b97a-69deabe1ea56 tempest-CreateVolumesFromImageTest-1636374441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b6f1ba9-ba3b-4912-b70d-269152b00ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df51b1e7-ccab-4c1d-ad83-870d2150a96a', 'volume_name': 'volume-df51b1e7-ccab-4c1d-ad83-870d2150a96a', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-63966e4f-49ed-4e01-b97a-69deabe1ea56 tempest-CreateVolumesFromImageTest-1636374441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7fe3155-544a-41e4-be6c-aedcf02ffee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-63966e4f-49ed-4e01-b97a-69deabe1ea56 tempest-CreateVolumesFromImageTest-1636374441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7fe3155-544a-41e4-be6c-aedcf02ffee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-63966e4f-49ed-4e01-b97a-69deabe1ea56 tempest-CreateVolumesFromImageTest-1636374441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c21247ca-ed81-4534-8f37-178f204400c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:05 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-63966e4f-49ed-4e01-b97a-69deabe1ea56 tempest-CreateVolumesFromImageTest-1636374441 None] Volume df51b1e7-ccab-4c1d-ad83-870d2150a96a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df51b1e7-ccab-4c1d-ad83-870d2150a96a', 'volume_size': 1} Nov 06 18:02:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-63966e4f-49ed-4e01-b97a-69deabe1ea56 tempest-CreateVolumesFromImageTest-1636374441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:02:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97d6d3c9-b2f5-46fa-8fda-d76802135bf5 tempest-CreateVolumesFromImageTest-1636374441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-67cbafe0-6b57-4e65-a44d-8dc7fce0f99f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:05 devstack sudo[104181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-67cbafe0-6b57-4e65-a44d-8dc7fce0f99f Nov 06 18:02:05 devstack sudo[104181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:05 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-0956ca21-4f6a-4c3d-9280-1d884bfee361 tempest-CreateVolumesFromImageTest-1636374441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:02:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0956ca21-4f6a-4c3d-9280-1d884bfee361 tempest-CreateVolumesFromImageTest-1636374441 None] Flow 'volume_create_manager' (61461b19-b609-4884-b641-0f9dbb5b2c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:02:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0956ca21-4f6a-4c3d-9280-1d884bfee361 tempest-CreateVolumesFromImageTest-1636374441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0675775b-279e-42d0-93a8-80a848edd4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0956ca21-4f6a-4c3d-9280-1d884bfee361 tempest-CreateVolumesFromImageTest-1636374441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0675775b-279e-42d0-93a8-80a848edd4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:02:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-641844641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b6a88a4-b407-4751-a10d-bdcbc0b6df22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f32e0a95497455ebfa59580b08a4e1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:02:06Z,use_quota=True,user_id='520816fe38f24575adb828847f46b037',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0956ca21-4f6a-4c3d-9280-1d884bfee361 tempest-CreateVolumesFromImageTest-1636374441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (415c57de-96ae-41aa-a017-18500227c191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:06 devstack sudo[104181]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0956ca21-4f6a-4c3d-9280-1d884bfee361 tempest-CreateVolumesFromImageTest-1636374441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (415c57de-96ae-41aa-a017-18500227c191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0956ca21-4f6a-4c3d-9280-1d884bfee361 tempest-CreateVolumesFromImageTest-1636374441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43b5c186-71d1-40d2-beab-31afc2fbb025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0956ca21-4f6a-4c3d-9280-1d884bfee361 tempest-CreateVolumesFromImageTest-1636374441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43b5c186-71d1-40d2-beab-31afc2fbb025) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b6a88a4-b407-4751-a10d-bdcbc0b6df22', 'volume_name': 'volume-1b6a88a4-b407-4751-a10d-bdcbc0b6df22', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0956ca21-4f6a-4c3d-9280-1d884bfee361 tempest-CreateVolumesFromImageTest-1636374441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2d912b8-9b0c-49e3-a6cb-feae626d7e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0956ca21-4f6a-4c3d-9280-1d884bfee361 tempest-CreateVolumesFromImageTest-1636374441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2d912b8-9b0c-49e3-a6cb-feae626d7e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0956ca21-4f6a-4c3d-9280-1d884bfee361 tempest-CreateVolumesFromImageTest-1636374441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84335f4c-1fe1-469d-86de-844171ffc0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:06 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-0956ca21-4f6a-4c3d-9280-1d884bfee361 tempest-CreateVolumesFromImageTest-1636374441 None] Volume 1b6a88a4-b407-4751-a10d-bdcbc0b6df22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b6a88a4-b407-4751-a10d-bdcbc0b6df22', 'volume_size': 1} Nov 06 18:02:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0956ca21-4f6a-4c3d-9280-1d884bfee361 tempest-CreateVolumesFromImageTest-1636374441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:02:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97d6d3c9-b2f5-46fa-8fda-d76802135bf5 tempest-CreateVolumesFromImageTest-1636374441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-67cbafe0-6b57-4e65-a44d-8dc7fce0f99f" returned: 0 in 0.539s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-97d6d3c9-b2f5-46fa-8fda-d76802135bf5 tempest-CreateVolumesFromImageTest-1636374441 None] <== create_volume: return (1571ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:02:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-97d6d3c9-b2f5-46fa-8fda-d76802135bf5 tempest-CreateVolumesFromImageTest-1636374441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.574s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:02:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c342ff74-36ee-466e-9a86-30297a44b8c8 tempest-CreateVolumesFromImageTest-1636374441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.202s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:02:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c342ff74-36ee-466e-9a86-30297a44b8c8 tempest-CreateVolumesFromImageTest-1636374441 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2098777231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=767c1cb8-28c1-4d79-9b2b-9b61d1ca8b7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f32e0a95497455ebfa59580b08a4e1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:02:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:02:05Z,use_quota=True,user_id='520816fe38f24575adb828847f46b037',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:02:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-c342ff74-36ee-466e-9a86-30297a44b8c8 tempest-CreateVolumesFromImageTest-1636374441 None] Creating volume 767c1cb8-28c1-4d79-9b2b-9b61d1ca8b7c {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:02:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c342ff74-36ee-466e-9a86-30297a44b8c8 tempest-CreateVolumesFromImageTest-1636374441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:02:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c342ff74-36ee-466e-9a86-30297a44b8c8 tempest-CreateVolumesFromImageTest-1636374441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:02:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c342ff74-36ee-466e-9a86-30297a44b8c8 tempest-CreateVolumesFromImageTest-1636374441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:02:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c342ff74-36ee-466e-9a86-30297a44b8c8 tempest-CreateVolumesFromImageTest-1636374441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:02:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c342ff74-36ee-466e-9a86-30297a44b8c8 tempest-CreateVolumesFromImageTest-1636374441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:02:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c342ff74-36ee-466e-9a86-30297a44b8c8 tempest-CreateVolumesFromImageTest-1636374441 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:02:06 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-c342ff74-36ee-466e-9a86-30297a44b8c8 tempest-CreateVolumesFromImageTest-1636374441 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:02:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c342ff74-36ee-466e-9a86-30297a44b8c8 tempest-CreateVolumesFromImageTest-1636374441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-767c1cb8-28c1-4d79-9b2b-9b61d1ca8b7c 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-97d6d3c9-b2f5-46fa-8fda-d76802135bf5 tempest-CreateVolumesFromImageTest-1636374441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ddc0807-264d-4cb8-b05f-3618c3924c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67cbafe0-6b57-4e65-a44d-8dc7fce0f99f', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-97d6d3c9-b2f5-46fa-8fda-d76802135bf5 tempest-CreateVolumesFromImageTest-1636374441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f5c7bb9-ce59-4674-9d0d-27563f553267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:06 devstack sudo[104185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-767c1cb8-28c1-4d79-9b2b-9b61d1ca8b7c 1073741824 Nov 06 18:02:06 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-97d6d3c9-b2f5-46fa-8fda-d76802135bf5 tempest-CreateVolumesFromImageTest-1636374441 None] Volume volume-67cbafe0-6b57-4e65-a44d-8dc7fce0f99f (67cbafe0-6b57-4e65-a44d-8dc7fce0f99f): created successfully Nov 06 18:02:06 devstack sudo[104185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-97d6d3c9-b2f5-46fa-8fda-d76802135bf5 tempest-CreateVolumesFromImageTest-1636374441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f5c7bb9-ce59-4674-9d0d-27563f553267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-97d6d3c9-b2f5-46fa-8fda-d76802135bf5 tempest-CreateVolumesFromImageTest-1636374441 None] Flow 'volume_create_manager' (9e2a5ce3-a866-46c0-bd41-39b1050e2e11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:02:06 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-97d6d3c9-b2f5-46fa-8fda-d76802135bf5 tempest-CreateVolumesFromImageTest-1636374441 None] Created volume successfully. Nov 06 18:02:06 devstack sudo[104185]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c342ff74-36ee-466e-9a86-30297a44b8c8 tempest-CreateVolumesFromImageTest-1636374441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-767c1cb8-28c1-4d79-9b2b-9b61d1ca8b7c 1073741824" returned: 0 in 0.672s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c342ff74-36ee-466e-9a86-30297a44b8c8 tempest-CreateVolumesFromImageTest-1636374441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-767c1cb8-28c1-4d79-9b2b-9b61d1ca8b7c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:06 devstack sudo[104190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-767c1cb8-28c1-4d79-9b2b-9b61d1ca8b7c Nov 06 18:02:06 devstack sudo[104190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:07 devstack sudo[104190]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c342ff74-36ee-466e-9a86-30297a44b8c8 tempest-CreateVolumesFromImageTest-1636374441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-767c1cb8-28c1-4d79-9b2b-9b61d1ca8b7c" returned: 0 in 0.422s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:07 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c342ff74-36ee-466e-9a86-30297a44b8c8 tempest-CreateVolumesFromImageTest-1636374441 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:02:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c342ff74-36ee-466e-9a86-30297a44b8c8 tempest-CreateVolumesFromImageTest-1636374441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:02:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-63966e4f-49ed-4e01-b97a-69deabe1ea56 tempest-CreateVolumesFromImageTest-1636374441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.787s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:02:07 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-63966e4f-49ed-4e01-b97a-69deabe1ea56 tempest-CreateVolumesFromImageTest-1636374441 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:02:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-316652109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df51b1e7-ccab-4c1d-ad83-870d2150a96a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f32e0a95497455ebfa59580b08a4e1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:02:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:02:05Z,use_quota=True,user_id='520816fe38f24575adb828847f46b037',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:02:07 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-63966e4f-49ed-4e01-b97a-69deabe1ea56 tempest-CreateVolumesFromImageTest-1636374441 None] Creating volume df51b1e7-ccab-4c1d-ad83-870d2150a96a {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:02:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-63966e4f-49ed-4e01-b97a-69deabe1ea56 tempest-CreateVolumesFromImageTest-1636374441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:02:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-63966e4f-49ed-4e01-b97a-69deabe1ea56 tempest-CreateVolumesFromImageTest-1636374441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:02:07 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-63966e4f-49ed-4e01-b97a-69deabe1ea56 tempest-CreateVolumesFromImageTest-1636374441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:02:07 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-63966e4f-49ed-4e01-b97a-69deabe1ea56 tempest-CreateVolumesFromImageTest-1636374441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:02:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-63966e4f-49ed-4e01-b97a-69deabe1ea56 tempest-CreateVolumesFromImageTest-1636374441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:02:07 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-63966e4f-49ed-4e01-b97a-69deabe1ea56 tempest-CreateVolumesFromImageTest-1636374441 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:02:07 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-63966e4f-49ed-4e01-b97a-69deabe1ea56 tempest-CreateVolumesFromImageTest-1636374441 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:02:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-63966e4f-49ed-4e01-b97a-69deabe1ea56 tempest-CreateVolumesFromImageTest-1636374441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-df51b1e7-ccab-4c1d-ad83-870d2150a96a 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c342ff74-36ee-466e-9a86-30297a44b8c8 tempest-CreateVolumesFromImageTest-1636374441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad047d7d-4485-4a00-b706-b3ff74823127) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-767c1cb8-28c1-4d79-9b2b-9b61d1ca8b7c', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c342ff74-36ee-466e-9a86-30297a44b8c8 tempest-CreateVolumesFromImageTest-1636374441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59e6eb0e-5177-4dab-b569-0aa23e28f36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:07 devstack sudo[104193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-df51b1e7-ccab-4c1d-ad83-870d2150a96a 1073741824 Nov 06 18:02:07 devstack sudo[104193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:07 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-c342ff74-36ee-466e-9a86-30297a44b8c8 tempest-CreateVolumesFromImageTest-1636374441 None] Volume volume-767c1cb8-28c1-4d79-9b2b-9b61d1ca8b7c (767c1cb8-28c1-4d79-9b2b-9b61d1ca8b7c): created successfully Nov 06 18:02:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c342ff74-36ee-466e-9a86-30297a44b8c8 tempest-CreateVolumesFromImageTest-1636374441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59e6eb0e-5177-4dab-b569-0aa23e28f36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c342ff74-36ee-466e-9a86-30297a44b8c8 tempest-CreateVolumesFromImageTest-1636374441 None] Flow 'volume_create_manager' (8f7a919e-f47e-4baf-a42c-4a61f7a782d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:02:07 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-c342ff74-36ee-466e-9a86-30297a44b8c8 tempest-CreateVolumesFromImageTest-1636374441 None] Created volume successfully. Nov 06 18:02:08 devstack sudo[104193]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-63966e4f-49ed-4e01-b97a-69deabe1ea56 tempest-CreateVolumesFromImageTest-1636374441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-df51b1e7-ccab-4c1d-ad83-870d2150a96a 1073741824" returned: 0 in 0.729s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-63966e4f-49ed-4e01-b97a-69deabe1ea56 tempest-CreateVolumesFromImageTest-1636374441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-df51b1e7-ccab-4c1d-ad83-870d2150a96a {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:08 devstack sudo[104199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-df51b1e7-ccab-4c1d-ad83-870d2150a96a Nov 06 18:02:08 devstack sudo[104199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:08 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5bc953f-ede1-47f0-8df6-0a228b4f1257 tempest-SnapshotDependencyTests-1363145718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:02:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d5bc953f-ede1-47f0-8df6-0a228b4f1257 tempest-SnapshotDependencyTests-1363145718 None] Flow 'volume_create_manager' (dcc64354-be45-4e89-b5df-e31d968e7f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:02:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d5bc953f-ede1-47f0-8df6-0a228b4f1257 tempest-SnapshotDependencyTests-1363145718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b87d64c-5bd9-4c23-8b5c-c2755a32fcd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d5bc953f-ede1-47f0-8df6-0a228b4f1257 tempest-SnapshotDependencyTests-1363145718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b87d64c-5bd9-4c23-8b5c-c2755a32fcd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:02:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1283568322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=164ec181-9075-42bf-9f49-7d208e73b710,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d3c2eacca0f4352a5b2ada38c18317f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:02:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:02:08Z,use_quota=True,user_id='4392056f3fa549f8b5b9fe7906ca2696',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d5bc953f-ede1-47f0-8df6-0a228b4f1257 tempest-SnapshotDependencyTests-1363145718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4806daa-b9bb-435e-9dc2-cff5f5ece938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d5bc953f-ede1-47f0-8df6-0a228b4f1257 tempest-SnapshotDependencyTests-1363145718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4806daa-b9bb-435e-9dc2-cff5f5ece938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d5bc953f-ede1-47f0-8df6-0a228b4f1257 tempest-SnapshotDependencyTests-1363145718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42b97584-c4e0-48a0-ab11-f089a4f22374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d5bc953f-ede1-47f0-8df6-0a228b4f1257 tempest-SnapshotDependencyTests-1363145718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42b97584-c4e0-48a0-ab11-f089a4f22374) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '164ec181-9075-42bf-9f49-7d208e73b710', 'volume_name': 'volume-164ec181-9075-42bf-9f49-7d208e73b710', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:08 devstack sudo[104199]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d5bc953f-ede1-47f0-8df6-0a228b4f1257 tempest-SnapshotDependencyTests-1363145718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de919f0a-2d1f-4753-aeb7-b70a7967bf6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d5bc953f-ede1-47f0-8df6-0a228b4f1257 tempest-SnapshotDependencyTests-1363145718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de919f0a-2d1f-4753-aeb7-b70a7967bf6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d5bc953f-ede1-47f0-8df6-0a228b4f1257 tempest-SnapshotDependencyTests-1363145718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d334b2c8-5963-4e7e-8667-7c823b9316ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:08 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-d5bc953f-ede1-47f0-8df6-0a228b4f1257 tempest-SnapshotDependencyTests-1363145718 None] Volume 164ec181-9075-42bf-9f49-7d208e73b710: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-164ec181-9075-42bf-9f49-7d208e73b710', 'volume_size': 1} Nov 06 18:02:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d5bc953f-ede1-47f0-8df6-0a228b4f1257 tempest-SnapshotDependencyTests-1363145718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:02:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-63966e4f-49ed-4e01-b97a-69deabe1ea56 tempest-CreateVolumesFromImageTest-1636374441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-df51b1e7-ccab-4c1d-ad83-870d2150a96a" returned: 0 in 0.322s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:08 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-63966e4f-49ed-4e01-b97a-69deabe1ea56 tempest-CreateVolumesFromImageTest-1636374441 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:02:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-63966e4f-49ed-4e01-b97a-69deabe1ea56 tempest-CreateVolumesFromImageTest-1636374441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:02:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0956ca21-4f6a-4c3d-9280-1d884bfee361 tempest-CreateVolumesFromImageTest-1636374441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.344s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:02:08 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0956ca21-4f6a-4c3d-9280-1d884bfee361 tempest-CreateVolumesFromImageTest-1636374441 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:02:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-641844641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b6a88a4-b407-4751-a10d-bdcbc0b6df22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f32e0a95497455ebfa59580b08a4e1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:02:06Z,use_quota=True,user_id='520816fe38f24575adb828847f46b037',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:02:08 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-0956ca21-4f6a-4c3d-9280-1d884bfee361 tempest-CreateVolumesFromImageTest-1636374441 None] Creating volume 1b6a88a4-b407-4751-a10d-bdcbc0b6df22 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:02:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0956ca21-4f6a-4c3d-9280-1d884bfee361 tempest-CreateVolumesFromImageTest-1636374441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:02:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0956ca21-4f6a-4c3d-9280-1d884bfee361 tempest-CreateVolumesFromImageTest-1636374441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:02:08 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0956ca21-4f6a-4c3d-9280-1d884bfee361 tempest-CreateVolumesFromImageTest-1636374441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:02:08 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0956ca21-4f6a-4c3d-9280-1d884bfee361 tempest-CreateVolumesFromImageTest-1636374441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:02:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0956ca21-4f6a-4c3d-9280-1d884bfee361 tempest-CreateVolumesFromImageTest-1636374441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:02:08 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0956ca21-4f6a-4c3d-9280-1d884bfee361 tempest-CreateVolumesFromImageTest-1636374441 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:02:08 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-0956ca21-4f6a-4c3d-9280-1d884bfee361 tempest-CreateVolumesFromImageTest-1636374441 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:02:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0956ca21-4f6a-4c3d-9280-1d884bfee361 tempest-CreateVolumesFromImageTest-1636374441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1b6a88a4-b407-4751-a10d-bdcbc0b6df22 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-63966e4f-49ed-4e01-b97a-69deabe1ea56 tempest-CreateVolumesFromImageTest-1636374441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c21247ca-ed81-4534-8f37-178f204400c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df51b1e7-ccab-4c1d-ad83-870d2150a96a', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-63966e4f-49ed-4e01-b97a-69deabe1ea56 tempest-CreateVolumesFromImageTest-1636374441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41af5ef9-d08a-4b0f-b6f1-f6bc79127363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:08 devstack sudo[104202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1b6a88a4-b407-4751-a10d-bdcbc0b6df22 1073741824 Nov 06 18:02:08 devstack sudo[104202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:08 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-63966e4f-49ed-4e01-b97a-69deabe1ea56 tempest-CreateVolumesFromImageTest-1636374441 None] Volume volume-df51b1e7-ccab-4c1d-ad83-870d2150a96a (df51b1e7-ccab-4c1d-ad83-870d2150a96a): created successfully Nov 06 18:02:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-63966e4f-49ed-4e01-b97a-69deabe1ea56 tempest-CreateVolumesFromImageTest-1636374441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41af5ef9-d08a-4b0f-b6f1-f6bc79127363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-63966e4f-49ed-4e01-b97a-69deabe1ea56 tempest-CreateVolumesFromImageTest-1636374441 None] Flow 'volume_create_manager' (8a7ded1e-c8d9-4249-939a-9da2dcc09d68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:02:08 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-63966e4f-49ed-4e01-b97a-69deabe1ea56 tempest-CreateVolumesFromImageTest-1636374441 None] Created volume successfully. Nov 06 18:02:08 devstack sudo[104202]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0956ca21-4f6a-4c3d-9280-1d884bfee361 tempest-CreateVolumesFromImageTest-1636374441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1b6a88a4-b407-4751-a10d-bdcbc0b6df22 1073741824" returned: 0 in 0.442s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0956ca21-4f6a-4c3d-9280-1d884bfee361 tempest-CreateVolumesFromImageTest-1636374441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1b6a88a4-b407-4751-a10d-bdcbc0b6df22 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:08 devstack sudo[104208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1b6a88a4-b407-4751-a10d-bdcbc0b6df22 Nov 06 18:02:08 devstack sudo[104208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:09 devstack sudo[104208]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0956ca21-4f6a-4c3d-9280-1d884bfee361 tempest-CreateVolumesFromImageTest-1636374441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1b6a88a4-b407-4751-a10d-bdcbc0b6df22" returned: 0 in 0.262s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:09 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0956ca21-4f6a-4c3d-9280-1d884bfee361 tempest-CreateVolumesFromImageTest-1636374441 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:02:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0956ca21-4f6a-4c3d-9280-1d884bfee361 tempest-CreateVolumesFromImageTest-1636374441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:02:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d5bc953f-ede1-47f0-8df6-0a228b4f1257 tempest-SnapshotDependencyTests-1363145718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.762s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:02:09 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d5bc953f-ede1-47f0-8df6-0a228b4f1257 tempest-SnapshotDependencyTests-1363145718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:02:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1283568322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=164ec181-9075-42bf-9f49-7d208e73b710,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d3c2eacca0f4352a5b2ada38c18317f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:02:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:02:08Z,use_quota=True,user_id='4392056f3fa549f8b5b9fe7906ca2696',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:02:09 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-d5bc953f-ede1-47f0-8df6-0a228b4f1257 tempest-SnapshotDependencyTests-1363145718 None] Creating volume 164ec181-9075-42bf-9f49-7d208e73b710 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:02:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d5bc953f-ede1-47f0-8df6-0a228b4f1257 tempest-SnapshotDependencyTests-1363145718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:02:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d5bc953f-ede1-47f0-8df6-0a228b4f1257 tempest-SnapshotDependencyTests-1363145718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:02:09 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d5bc953f-ede1-47f0-8df6-0a228b4f1257 tempest-SnapshotDependencyTests-1363145718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:02:09 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d5bc953f-ede1-47f0-8df6-0a228b4f1257 tempest-SnapshotDependencyTests-1363145718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:02:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d5bc953f-ede1-47f0-8df6-0a228b4f1257 tempest-SnapshotDependencyTests-1363145718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:02:09 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d5bc953f-ede1-47f0-8df6-0a228b4f1257 tempest-SnapshotDependencyTests-1363145718 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:02:09 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-d5bc953f-ede1-47f0-8df6-0a228b4f1257 tempest-SnapshotDependencyTests-1363145718 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:02:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d5bc953f-ede1-47f0-8df6-0a228b4f1257 tempest-SnapshotDependencyTests-1363145718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-164ec181-9075-42bf-9f49-7d208e73b710 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0956ca21-4f6a-4c3d-9280-1d884bfee361 tempest-CreateVolumesFromImageTest-1636374441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84335f4c-1fe1-469d-86de-844171ffc0bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b6a88a4-b407-4751-a10d-bdcbc0b6df22', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:09 devstack sudo[104211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-164ec181-9075-42bf-9f49-7d208e73b710 1073741824 Nov 06 18:02:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0956ca21-4f6a-4c3d-9280-1d884bfee361 tempest-CreateVolumesFromImageTest-1636374441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29254c70-4f5c-4e84-a369-b4958e024bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:09 devstack sudo[104211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:09 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-0956ca21-4f6a-4c3d-9280-1d884bfee361 tempest-CreateVolumesFromImageTest-1636374441 None] Volume volume-1b6a88a4-b407-4751-a10d-bdcbc0b6df22 (1b6a88a4-b407-4751-a10d-bdcbc0b6df22): created successfully Nov 06 18:02:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0956ca21-4f6a-4c3d-9280-1d884bfee361 tempest-CreateVolumesFromImageTest-1636374441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29254c70-4f5c-4e84-a369-b4958e024bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0956ca21-4f6a-4c3d-9280-1d884bfee361 tempest-CreateVolumesFromImageTest-1636374441 None] Flow 'volume_create_manager' (61461b19-b609-4884-b641-0f9dbb5b2c51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:02:09 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-0956ca21-4f6a-4c3d-9280-1d884bfee361 tempest-CreateVolumesFromImageTest-1636374441 None] Created volume successfully. Nov 06 18:02:09 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-51b41e17-7239-4ef4-95d3-e60ba35d6468 tempest-CreateVolumesFromImageTest-1636374441 None] Acquiring lock "cinder-1b6a88a4-b407-4751-a10d-bdcbc0b6df22-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:02:09 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-51b41e17-7239-4ef4-95d3-e60ba35d6468 tempest-CreateVolumesFromImageTest-1636374441 None] Lock "cinder-1b6a88a4-b407-4751-a10d-bdcbc0b6df22-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:02:09 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-51b41e17-7239-4ef4-95d3-e60ba35d6468 tempest-CreateVolumesFromImageTest-1636374441 None] Acquiring lock "cinder-quobyte-1b6a88a4-b407-4751-a10d-bdcbc0b6df22" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:02:09 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-51b41e17-7239-4ef4-95d3-e60ba35d6468 tempest-CreateVolumesFromImageTest-1636374441 None] Lock "cinder-quobyte-1b6a88a4-b407-4751-a10d-bdcbc0b6df22" acquired by "delete_volume" :: waited 0.023s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:02:09 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5de50e8-a4db-4bee-a1c5-ff246e0b8b37]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:02:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-51b41e17-7239-4ef4-95d3-e60ba35d6468 tempest-CreateVolumesFromImageTest-1636374441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1b6a88a4-b407-4751-a10d-bdcbc0b6df22 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:09 devstack sudo[104211]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d5bc953f-ede1-47f0-8df6-0a228b4f1257 tempest-SnapshotDependencyTests-1363145718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-164ec181-9075-42bf-9f49-7d208e73b710 1073741824" returned: 0 in 0.550s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:09 devstack sudo[104216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1b6a88a4-b407-4751-a10d-bdcbc0b6df22 Nov 06 18:02:09 devstack sudo[104216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d5bc953f-ede1-47f0-8df6-0a228b4f1257 tempest-SnapshotDependencyTests-1363145718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-164ec181-9075-42bf-9f49-7d208e73b710 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:09 devstack sudo[104219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-164ec181-9075-42bf-9f49-7d208e73b710 Nov 06 18:02:09 devstack sudo[104219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:10 devstack sudo[104216]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:10 devstack sudo[104219]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-51b41e17-7239-4ef4-95d3-e60ba35d6468 tempest-CreateVolumesFromImageTest-1636374441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1b6a88a4-b407-4751-a10d-bdcbc0b6df22" returned: 0 in 0.482s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-51b41e17-7239-4ef4-95d3-e60ba35d6468 tempest-CreateVolumesFromImageTest-1636374441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1b6a88a4-b407-4751-a10d-bdcbc0b6df22 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d5bc953f-ede1-47f0-8df6-0a228b4f1257 tempest-SnapshotDependencyTests-1363145718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-164ec181-9075-42bf-9f49-7d208e73b710" returned: 0 in 0.280s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d5bc953f-ede1-47f0-8df6-0a228b4f1257 tempest-SnapshotDependencyTests-1363145718 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:02:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d5bc953f-ede1-47f0-8df6-0a228b4f1257 tempest-SnapshotDependencyTests-1363145718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:02:10 devstack sudo[104225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1b6a88a4-b407-4751-a10d-bdcbc0b6df22 Nov 06 18:02:10 devstack sudo[104225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d5bc953f-ede1-47f0-8df6-0a228b4f1257 tempest-SnapshotDependencyTests-1363145718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d334b2c8-5963-4e7e-8667-7c823b9316ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-164ec181-9075-42bf-9f49-7d208e73b710', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d5bc953f-ede1-47f0-8df6-0a228b4f1257 tempest-SnapshotDependencyTests-1363145718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04e3c82c-f581-494f-8f58-ac096e9c5084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:10 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-d5bc953f-ede1-47f0-8df6-0a228b4f1257 tempest-SnapshotDependencyTests-1363145718 None] Volume volume-164ec181-9075-42bf-9f49-7d208e73b710 (164ec181-9075-42bf-9f49-7d208e73b710): created successfully Nov 06 18:02:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d5bc953f-ede1-47f0-8df6-0a228b4f1257 tempest-SnapshotDependencyTests-1363145718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04e3c82c-f581-494f-8f58-ac096e9c5084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d5bc953f-ede1-47f0-8df6-0a228b4f1257 tempest-SnapshotDependencyTests-1363145718 None] Flow 'volume_create_manager' (dcc64354-be45-4e89-b5df-e31d968e7f6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:02:10 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-d5bc953f-ede1-47f0-8df6-0a228b4f1257 tempest-SnapshotDependencyTests-1363145718 None] Created volume successfully. Nov 06 18:02:10 devstack sudo[104225]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-51b41e17-7239-4ef4-95d3-e60ba35d6468 tempest-CreateVolumesFromImageTest-1636374441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-1b6a88a4-b407-4751-a10d-bdcbc0b6df22" returned: 0 in 0.287s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:10 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-51b41e17-7239-4ef4-95d3-e60ba35d6468 tempest-CreateVolumesFromImageTest-1636374441 None] Lock "cinder-quobyte-1b6a88a4-b407-4751-a10d-bdcbc0b6df22" released by "delete_volume" :: held 0.824s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:02:10 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-51b41e17-7239-4ef4-95d3-e60ba35d6468 tempest-CreateVolumesFromImageTest-1636374441 None] Created reservations ['26310844-ae95-4e65-9341-8ba042651d2b', 'a420f8b1-da25-4b18-95d8-07b695157736', '3ba9af9b-a920-4a6e-acee-0c73e29b3541', '69033059-6579-4003-8d11-4257aee25a52'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:02:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-51b41e17-7239-4ef4-95d3-e60ba35d6468 tempest-CreateVolumesFromImageTest-1636374441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:02:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-51b41e17-7239-4ef4-95d3-e60ba35d6468 tempest-CreateVolumesFromImageTest-1636374441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:02:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-51b41e17-7239-4ef4-95d3-e60ba35d6468 tempest-CreateVolumesFromImageTest-1636374441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:02:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-51b41e17-7239-4ef4-95d3-e60ba35d6468 tempest-CreateVolumesFromImageTest-1636374441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:02:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-51b41e17-7239-4ef4-95d3-e60ba35d6468 tempest-CreateVolumesFromImageTest-1636374441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:02:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-51b41e17-7239-4ef4-95d3-e60ba35d6468 tempest-CreateVolumesFromImageTest-1636374441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:10 devstack sudo[104228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:02:10 devstack sudo[104228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:10 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ae9618ef-ad67-4f0d-87b4-9acb91fee1ec tempest-CreateVolumesFromImageTest-1636374441 None] Acquiring lock "cinder-df51b1e7-ccab-4c1d-ad83-870d2150a96a-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:02:10 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ae9618ef-ad67-4f0d-87b4-9acb91fee1ec tempest-CreateVolumesFromImageTest-1636374441 None] Lock "cinder-df51b1e7-ccab-4c1d-ad83-870d2150a96a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:02:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e39fcab7-859f-43b3-ac55-82cb8e76bf4b tempest-SnapshotDependencyTests-1363145718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:02:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e39fcab7-859f-43b3-ac55-82cb8e76bf4b tempest-SnapshotDependencyTests-1363145718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:02:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-e39fcab7-859f-43b3-ac55-82cb8e76bf4b tempest-SnapshotDependencyTests-1363145718 None] Creating offline snapshot 38be76ac-a69d-45f0-959d-35e0a58d5752 of volume 164ec181-9075-42bf-9f49-7d208e73b710 {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:02:10 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[38fa48ee-1e00-4547-b302-95fcc928d241]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:02:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e39fcab7-859f-43b3-ac55-82cb8e76bf4b tempest-SnapshotDependencyTests-1363145718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-164ec181-9075-42bf-9f49-7d208e73b710 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:10 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ae9618ef-ad67-4f0d-87b4-9acb91fee1ec tempest-CreateVolumesFromImageTest-1636374441 None] Acquiring lock "cinder-quobyte-df51b1e7-ccab-4c1d-ad83-870d2150a96a" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:02:10 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ae9618ef-ad67-4f0d-87b4-9acb91fee1ec tempest-CreateVolumesFromImageTest-1636374441 None] Lock "cinder-quobyte-df51b1e7-ccab-4c1d-ad83-870d2150a96a" acquired by "delete_volume" :: waited 0.026s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:02:10 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff02a4a-b39b-43d9-b968-d836c6c4139f]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:02:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ae9618ef-ad67-4f0d-87b4-9acb91fee1ec tempest-CreateVolumesFromImageTest-1636374441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-df51b1e7-ccab-4c1d-ad83-870d2150a96a {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:10 devstack sudo[104228]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-51b41e17-7239-4ef4-95d3-e60ba35d6468 tempest-CreateVolumesFromImageTest-1636374441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.379s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:11 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-51b41e17-7239-4ef4-95d3-e60ba35d6468 tempest-CreateVolumesFromImageTest-1636374441 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:02:11 devstack sudo[104230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-164ec181-9075-42bf-9f49-7d208e73b710 Nov 06 18:02:11 devstack sudo[104230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:11 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-51b41e17-7239-4ef4-95d3-e60ba35d6468 tempest-CreateVolumesFromImageTest-1636374441 None] Deleted volume successfully. Nov 06 18:02:11 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-51b41e17-7239-4ef4-95d3-e60ba35d6468 tempest-CreateVolumesFromImageTest-1636374441 None] Lock "cinder-1b6a88a4-b407-4751-a10d-bdcbc0b6df22-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:02:11 devstack sudo[104233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-df51b1e7-ccab-4c1d-ad83-870d2150a96a Nov 06 18:02:11 devstack sudo[104233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:11 devstack sudo[104230]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e39fcab7-859f-43b3-ac55-82cb8e76bf4b tempest-SnapshotDependencyTests-1363145718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-164ec181-9075-42bf-9f49-7d208e73b710" returned: 0 in 0.436s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e39fcab7-859f-43b3-ac55-82cb8e76bf4b tempest-SnapshotDependencyTests-1363145718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-164ec181-9075-42bf-9f49-7d208e73b710,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-164ec181-9075-42bf-9f49-7d208e73b710.38be76ac-a69d-45f0-959d-35e0a58d5752 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:11 devstack sudo[104239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-164ec181-9075-42bf-9f49-7d208e73b710,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-164ec181-9075-42bf-9f49-7d208e73b710.38be76ac-a69d-45f0-959d-35e0a58d5752 1G Nov 06 18:02:11 devstack sudo[104239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:11 devstack sudo[104233]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ae9618ef-ad67-4f0d-87b4-9acb91fee1ec tempest-CreateVolumesFromImageTest-1636374441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-df51b1e7-ccab-4c1d-ad83-870d2150a96a" returned: 0 in 0.434s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ae9618ef-ad67-4f0d-87b4-9acb91fee1ec tempest-CreateVolumesFromImageTest-1636374441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-df51b1e7-ccab-4c1d-ad83-870d2150a96a {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:11 devstack sudo[104244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-df51b1e7-ccab-4c1d-ad83-870d2150a96a Nov 06 18:02:11 devstack sudo[104244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:11 devstack sudo[104244]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ae9618ef-ad67-4f0d-87b4-9acb91fee1ec tempest-CreateVolumesFromImageTest-1636374441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-df51b1e7-ccab-4c1d-ad83-870d2150a96a" returned: 0 in 0.285s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:11 devstack sudo[104239]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e39fcab7-859f-43b3-ac55-82cb8e76bf4b tempest-SnapshotDependencyTests-1363145718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-164ec181-9075-42bf-9f49-7d208e73b710,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-164ec181-9075-42bf-9f49-7d208e73b710.38be76ac-a69d-45f0-959d-35e0a58d5752 1G" returned: 0 in 0.428s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e39fcab7-859f-43b3-ac55-82cb8e76bf4b tempest-SnapshotDependencyTests-1363145718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-164ec181-9075-42bf-9f49-7d208e73b710 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-164ec181-9075-42bf-9f49-7d208e73b710.38be76ac-a69d-45f0-959d-35e0a58d5752 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:11 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ae9618ef-ad67-4f0d-87b4-9acb91fee1ec tempest-CreateVolumesFromImageTest-1636374441 None] Lock "cinder-quobyte-df51b1e7-ccab-4c1d-ad83-870d2150a96a" released by "delete_volume" :: held 0.812s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:02:11 devstack sudo[104251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-164ec181-9075-42bf-9f49-7d208e73b710 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-164ec181-9075-42bf-9f49-7d208e73b710.38be76ac-a69d-45f0-959d-35e0a58d5752 Nov 06 18:02:11 devstack sudo[104251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:11 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-ae9618ef-ad67-4f0d-87b4-9acb91fee1ec tempest-CreateVolumesFromImageTest-1636374441 None] Created reservations ['1af82e45-9f3f-4b21-ac5d-5d5ec58a5e64', '7e7f7573-0511-4c4b-9f9d-3d8122534287', '3ed54eba-3b38-4225-9978-be4aa39150c5', 'b8ed7ddb-9194-4b55-aa53-ca3ee478bf50'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:02:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ae9618ef-ad67-4f0d-87b4-9acb91fee1ec tempest-CreateVolumesFromImageTest-1636374441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:02:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ae9618ef-ad67-4f0d-87b4-9acb91fee1ec tempest-CreateVolumesFromImageTest-1636374441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:02:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ae9618ef-ad67-4f0d-87b4-9acb91fee1ec tempest-CreateVolumesFromImageTest-1636374441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:02:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ae9618ef-ad67-4f0d-87b4-9acb91fee1ec tempest-CreateVolumesFromImageTest-1636374441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:02:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ae9618ef-ad67-4f0d-87b4-9acb91fee1ec tempest-CreateVolumesFromImageTest-1636374441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:02:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ae9618ef-ad67-4f0d-87b4-9acb91fee1ec tempest-CreateVolumesFromImageTest-1636374441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:11 devstack sudo[104253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:02:11 devstack sudo[104253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:12 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d8e305d4-8bc8-4909-9b4f-3ec17be1e7df tempest-CreateVolumesFromImageTest-1636374441 None] Acquiring lock "cinder-767c1cb8-28c1-4d79-9b2b-9b61d1ca8b7c-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:02:12 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d8e305d4-8bc8-4909-9b4f-3ec17be1e7df tempest-CreateVolumesFromImageTest-1636374441 None] Lock "cinder-767c1cb8-28c1-4d79-9b2b-9b61d1ca8b7c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:02:12 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d8e305d4-8bc8-4909-9b4f-3ec17be1e7df tempest-CreateVolumesFromImageTest-1636374441 None] Acquiring lock "cinder-quobyte-767c1cb8-28c1-4d79-9b2b-9b61d1ca8b7c" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:02:12 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d8e305d4-8bc8-4909-9b4f-3ec17be1e7df tempest-CreateVolumesFromImageTest-1636374441 None] Lock "cinder-quobyte-767c1cb8-28c1-4d79-9b2b-9b61d1ca8b7c" acquired by "delete_volume" :: waited 0.023s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:02:12 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1778c3b-0f48-4e19-942c-89fdf9ededf4]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:02:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d8e305d4-8bc8-4909-9b4f-3ec17be1e7df tempest-CreateVolumesFromImageTest-1636374441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-767c1cb8-28c1-4d79-9b2b-9b61d1ca8b7c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:12 devstack sudo[104251]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e39fcab7-859f-43b3-ac55-82cb8e76bf4b tempest-SnapshotDependencyTests-1363145718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-164ec181-9075-42bf-9f49-7d208e73b710 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-164ec181-9075-42bf-9f49-7d208e73b710.38be76ac-a69d-45f0-959d-35e0a58d5752" returned: 0 in 0.412s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:12 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-e39fcab7-859f-43b3-ac55-82cb8e76bf4b tempest-SnapshotDependencyTests-1363145718 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-164ec181-9075-42bf-9f49-7d208e73b710.38be76ac-a69d-45f0-959d-35e0a58d5752 is being set with open permissions: ugo+rw Nov 06 18:02:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e39fcab7-859f-43b3-ac55-82cb8e76bf4b tempest-SnapshotDependencyTests-1363145718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-164ec181-9075-42bf-9f49-7d208e73b710.38be76ac-a69d-45f0-959d-35e0a58d5752 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:12 devstack sudo[104260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-164ec181-9075-42bf-9f49-7d208e73b710.38be76ac-a69d-45f0-959d-35e0a58d5752 Nov 06 18:02:12 devstack sudo[104260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:12 devstack sudo[104253]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ae9618ef-ad67-4f0d-87b4-9acb91fee1ec tempest-CreateVolumesFromImageTest-1636374441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.316s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:12 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-ae9618ef-ad67-4f0d-87b4-9acb91fee1ec tempest-CreateVolumesFromImageTest-1636374441 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:02:12 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-ae9618ef-ad67-4f0d-87b4-9acb91fee1ec tempest-CreateVolumesFromImageTest-1636374441 None] Deleted volume successfully. Nov 06 18:02:12 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ae9618ef-ad67-4f0d-87b4-9acb91fee1ec tempest-CreateVolumesFromImageTest-1636374441 None] Lock "cinder-df51b1e7-ccab-4c1d-ad83-870d2150a96a-delete_volume" released by "delete_volume" :: held 1.445s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:02:12 devstack sudo[104259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-767c1cb8-28c1-4d79-9b2b-9b61d1ca8b7c Nov 06 18:02:12 devstack sudo[104259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:12 devstack sudo[104260]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e39fcab7-859f-43b3-ac55-82cb8e76bf4b tempest-SnapshotDependencyTests-1363145718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-164ec181-9075-42bf-9f49-7d208e73b710.38be76ac-a69d-45f0-959d-35e0a58d5752" returned: 0 in 0.293s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e39fcab7-859f-43b3-ac55-82cb8e76bf4b tempest-SnapshotDependencyTests-1363145718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-164ec181-9075-42bf-9f49-7d208e73b710.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:12 devstack sudo[104268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-164ec181-9075-42bf-9f49-7d208e73b710.info Nov 06 18:02:12 devstack sudo[104268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:12 devstack sudo[104259]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d8e305d4-8bc8-4909-9b4f-3ec17be1e7df tempest-CreateVolumesFromImageTest-1636374441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-767c1cb8-28c1-4d79-9b2b-9b61d1ca8b7c" returned: 0 in 0.391s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d8e305d4-8bc8-4909-9b4f-3ec17be1e7df tempest-CreateVolumesFromImageTest-1636374441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-767c1cb8-28c1-4d79-9b2b-9b61d1ca8b7c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:12 devstack sudo[104270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-767c1cb8-28c1-4d79-9b2b-9b61d1ca8b7c Nov 06 18:02:12 devstack sudo[104270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:12 devstack sudo[104268]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e39fcab7-859f-43b3-ac55-82cb8e76bf4b tempest-SnapshotDependencyTests-1363145718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-164ec181-9075-42bf-9f49-7d208e73b710.info" returned: 0 in 0.278s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:12 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-e39fcab7-859f-43b3-ac55-82cb8e76bf4b tempest-SnapshotDependencyTests-1363145718 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-164ec181-9075-42bf-9f49-7d208e73b710.info is being set with open permissions: ugo+rw Nov 06 18:02:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e39fcab7-859f-43b3-ac55-82cb8e76bf4b tempest-SnapshotDependencyTests-1363145718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-164ec181-9075-42bf-9f49-7d208e73b710.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:12 devstack sudo[104270]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d8e305d4-8bc8-4909-9b4f-3ec17be1e7df tempest-CreateVolumesFromImageTest-1636374441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-767c1cb8-28c1-4d79-9b2b-9b61d1ca8b7c" returned: 0 in 0.261s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:12 devstack sudo[104274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-164ec181-9075-42bf-9f49-7d208e73b710.info Nov 06 18:02:12 devstack sudo[104274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:12 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d8e305d4-8bc8-4909-9b4f-3ec17be1e7df tempest-CreateVolumesFromImageTest-1636374441 None] Lock "cinder-quobyte-767c1cb8-28c1-4d79-9b2b-9b61d1ca8b7c" released by "delete_volume" :: held 0.707s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:02:12 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-d8e305d4-8bc8-4909-9b4f-3ec17be1e7df tempest-CreateVolumesFromImageTest-1636374441 None] Created reservations ['79906f82-94ea-46ce-b96f-19637248183d', '31298f55-1f49-42e1-a7a7-7eca4ae99b9d', '8db1f11f-84e9-4f1b-ad15-6a9f85d896f0', '5dcb33f6-bdaf-49c5-9390-f8c72ae90b76'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:02:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d8e305d4-8bc8-4909-9b4f-3ec17be1e7df tempest-CreateVolumesFromImageTest-1636374441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:02:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d8e305d4-8bc8-4909-9b4f-3ec17be1e7df tempest-CreateVolumesFromImageTest-1636374441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:02:12 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d8e305d4-8bc8-4909-9b4f-3ec17be1e7df tempest-CreateVolumesFromImageTest-1636374441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:02:12 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d8e305d4-8bc8-4909-9b4f-3ec17be1e7df tempest-CreateVolumesFromImageTest-1636374441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:02:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d8e305d4-8bc8-4909-9b4f-3ec17be1e7df tempest-CreateVolumesFromImageTest-1636374441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:02:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d8e305d4-8bc8-4909-9b4f-3ec17be1e7df tempest-CreateVolumesFromImageTest-1636374441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:12 devstack sudo[104276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:02:12 devstack sudo[104276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:13 devstack sudo[104274]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e39fcab7-859f-43b3-ac55-82cb8e76bf4b tempest-SnapshotDependencyTests-1363145718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-164ec181-9075-42bf-9f49-7d208e73b710.info" returned: 0 in 0.260s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e39fcab7-859f-43b3-ac55-82cb8e76bf4b tempest-SnapshotDependencyTests-1363145718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.219s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:02:13 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-e39fcab7-859f-43b3-ac55-82cb8e76bf4b tempest-SnapshotDependencyTests-1363145718 None] Create snapshot completed successfully Nov 06 18:02:13 devstack sudo[104276]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:13 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-dcf30d59-0843-4848-acb7-83dabc91a1a0 tempest-CreateVolumesFromImageTest-1636374441 None] Acquiring lock "cinder-67cbafe0-6b57-4e65-a44d-8dc7fce0f99f-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:02:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d8e305d4-8bc8-4909-9b4f-3ec17be1e7df tempest-CreateVolumesFromImageTest-1636374441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.272s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:13 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-d8e305d4-8bc8-4909-9b4f-3ec17be1e7df tempest-CreateVolumesFromImageTest-1636374441 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:02:13 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-d8e305d4-8bc8-4909-9b4f-3ec17be1e7df tempest-CreateVolumesFromImageTest-1636374441 None] Deleted volume successfully. Nov 06 18:02:13 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-dcf30d59-0843-4848-acb7-83dabc91a1a0 tempest-CreateVolumesFromImageTest-1636374441 None] Lock "cinder-67cbafe0-6b57-4e65-a44d-8dc7fce0f99f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:02:13 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d8e305d4-8bc8-4909-9b4f-3ec17be1e7df tempest-CreateVolumesFromImageTest-1636374441 None] Lock "cinder-767c1cb8-28c1-4d79-9b2b-9b61d1ca8b7c-delete_volume" released by "delete_volume" :: held 1.205s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:02:13 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-dcf30d59-0843-4848-acb7-83dabc91a1a0 tempest-CreateVolumesFromImageTest-1636374441 None] Acquiring lock "cinder-quobyte-67cbafe0-6b57-4e65-a44d-8dc7fce0f99f" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:02:13 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-dcf30d59-0843-4848-acb7-83dabc91a1a0 tempest-CreateVolumesFromImageTest-1636374441 None] Lock "cinder-quobyte-67cbafe0-6b57-4e65-a44d-8dc7fce0f99f" acquired by "delete_volume" :: waited 0.015s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:02:13 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f121d09d-d397-479b-ad35-77d00a810fda]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:02:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-dcf30d59-0843-4848-acb7-83dabc91a1a0 tempest-CreateVolumesFromImageTest-1636374441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-67cbafe0-6b57-4e65-a44d-8dc7fce0f99f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:13 devstack sudo[104280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-67cbafe0-6b57-4e65-a44d-8dc7fce0f99f Nov 06 18:02:13 devstack sudo[104280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:13 devstack sudo[104280]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-dcf30d59-0843-4848-acb7-83dabc91a1a0 tempest-CreateVolumesFromImageTest-1636374441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-67cbafe0-6b57-4e65-a44d-8dc7fce0f99f" returned: 0 in 0.348s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-dcf30d59-0843-4848-acb7-83dabc91a1a0 tempest-CreateVolumesFromImageTest-1636374441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-67cbafe0-6b57-4e65-a44d-8dc7fce0f99f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:13 devstack sudo[104285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-67cbafe0-6b57-4e65-a44d-8dc7fce0f99f Nov 06 18:02:13 devstack sudo[104285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:13 devstack sudo[104285]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-dcf30d59-0843-4848-acb7-83dabc91a1a0 tempest-CreateVolumesFromImageTest-1636374441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-67cbafe0-6b57-4e65-a44d-8dc7fce0f99f" returned: 0 in 0.252s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:13 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-dcf30d59-0843-4848-acb7-83dabc91a1a0 tempest-CreateVolumesFromImageTest-1636374441 None] Lock "cinder-quobyte-67cbafe0-6b57-4e65-a44d-8dc7fce0f99f" released by "delete_volume" :: held 0.644s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:02:13 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-dcf30d59-0843-4848-acb7-83dabc91a1a0 tempest-CreateVolumesFromImageTest-1636374441 None] Created reservations ['1f62af3e-d604-4982-9dd2-1c3f93fb5987', '67596113-0e0d-4d6a-ba0c-95682d53e491', '41fc4fad-3bfb-440f-b71b-2fc25f46a089', 'f74a0de9-ae0e-46cb-b787-e329d7ec7eee'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:02:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-dcf30d59-0843-4848-acb7-83dabc91a1a0 tempest-CreateVolumesFromImageTest-1636374441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:02:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-dcf30d59-0843-4848-acb7-83dabc91a1a0 tempest-CreateVolumesFromImageTest-1636374441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:02:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-dcf30d59-0843-4848-acb7-83dabc91a1a0 tempest-CreateVolumesFromImageTest-1636374441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:02:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-dcf30d59-0843-4848-acb7-83dabc91a1a0 tempest-CreateVolumesFromImageTest-1636374441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:02:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-dcf30d59-0843-4848-acb7-83dabc91a1a0 tempest-CreateVolumesFromImageTest-1636374441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:02:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-dcf30d59-0843-4848-acb7-83dabc91a1a0 tempest-CreateVolumesFromImageTest-1636374441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:14 devstack sudo[104288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:02:14 devstack sudo[104288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:14 devstack sudo[104288]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-dcf30d59-0843-4848-acb7-83dabc91a1a0 tempest-CreateVolumesFromImageTest-1636374441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.265s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:14 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-dcf30d59-0843-4848-acb7-83dabc91a1a0 tempest-CreateVolumesFromImageTest-1636374441 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:02:14 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-dcf30d59-0843-4848-acb7-83dabc91a1a0 tempest-CreateVolumesFromImageTest-1636374441 None] Deleted volume successfully. Nov 06 18:02:14 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-dcf30d59-0843-4848-acb7-83dabc91a1a0 tempest-CreateVolumesFromImageTest-1636374441 None] Lock "cinder-67cbafe0-6b57-4e65-a44d-8dc7fce0f99f-delete_volume" released by "delete_volume" :: held 1.128s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:02:14 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4a307202-79ea-41ac-b03a-9ff6a6b6b7fe tempest-CreateVolumesFromImageTest-1636374441 None] Acquiring lock "cinder-5f1a52aa-b858-4485-a4a7-553babae365e-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:02:14 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4a307202-79ea-41ac-b03a-9ff6a6b6b7fe tempest-CreateVolumesFromImageTest-1636374441 None] Lock "cinder-5f1a52aa-b858-4485-a4a7-553babae365e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:02:14 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4a307202-79ea-41ac-b03a-9ff6a6b6b7fe tempest-CreateVolumesFromImageTest-1636374441 None] Acquiring lock "cinder-quobyte-5f1a52aa-b858-4485-a4a7-553babae365e" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:02:14 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4a307202-79ea-41ac-b03a-9ff6a6b6b7fe tempest-CreateVolumesFromImageTest-1636374441 None] Lock "cinder-quobyte-5f1a52aa-b858-4485-a4a7-553babae365e" acquired by "delete_volume" :: waited 0.029s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:02:14 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd78084b-3c93-4ac6-9712-77e9c160134b]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:02:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4a307202-79ea-41ac-b03a-9ff6a6b6b7fe tempest-CreateVolumesFromImageTest-1636374441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5f1a52aa-b858-4485-a4a7-553babae365e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:14 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ccc7e4d-3234-4ad2-b864-53c5e936710b tempest-SnapshotDependencyTests-1363145718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:02:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0ccc7e4d-3234-4ad2-b864-53c5e936710b tempest-SnapshotDependencyTests-1363145718 None] Flow 'volume_create_manager' (cdcefd7b-2c5d-4bd0-bb76-4cb3190884a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:02:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0ccc7e4d-3234-4ad2-b864-53c5e936710b tempest-SnapshotDependencyTests-1363145718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9692ea2-eb2f-4a83-95f7-9c6ea4491082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0ccc7e4d-3234-4ad2-b864-53c5e936710b tempest-SnapshotDependencyTests-1363145718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9692ea2-eb2f-4a83-95f7-9c6ea4491082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:02:14Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66372b21-98dc-44b9-b715-93ed4844b103,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d3c2eacca0f4352a5b2ada38c18317f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:02:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=38be76ac-a69d-45f0-959d-35e0a58d5752,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:02:14Z,use_quota=True,user_id='4392056f3fa549f8b5b9fe7906ca2696',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0ccc7e4d-3234-4ad2-b864-53c5e936710b tempest-SnapshotDependencyTests-1363145718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16772ee2-f2f5-49d0-8564-9156631e09f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:14 devstack sudo[104291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5f1a52aa-b858-4485-a4a7-553babae365e Nov 06 18:02:14 devstack sudo[104291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0ccc7e4d-3234-4ad2-b864-53c5e936710b tempest-SnapshotDependencyTests-1363145718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16772ee2-f2f5-49d0-8564-9156631e09f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0ccc7e4d-3234-4ad2-b864-53c5e936710b tempest-SnapshotDependencyTests-1363145718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72dba19e-48d4-44f7-a69b-6a816f5ed34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0ccc7e4d-3234-4ad2-b864-53c5e936710b tempest-SnapshotDependencyTests-1363145718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72dba19e-48d4-44f7-a69b-6a816f5ed34e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '66372b21-98dc-44b9-b715-93ed4844b103', 'volume_name': 'volume-66372b21-98dc-44b9-b715-93ed4844b103', 'volume_size': 1, 'snapshot_id': '38be76ac-a69d-45f0-959d-35e0a58d5752'}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0ccc7e4d-3234-4ad2-b864-53c5e936710b tempest-SnapshotDependencyTests-1363145718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c865c7b5-dc67-46b2-95be-58148d6b69af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0ccc7e4d-3234-4ad2-b864-53c5e936710b tempest-SnapshotDependencyTests-1363145718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c865c7b5-dc67-46b2-95be-58148d6b69af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0ccc7e4d-3234-4ad2-b864-53c5e936710b tempest-SnapshotDependencyTests-1363145718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddea08c1-ae98-4896-b1e4-5029076bdd71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:14 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-0ccc7e4d-3234-4ad2-b864-53c5e936710b tempest-SnapshotDependencyTests-1363145718 None] Volume 66372b21-98dc-44b9-b715-93ed4844b103: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-66372b21-98dc-44b9-b715-93ed4844b103', 'volume_size': 1, 'snapshot_id': '38be76ac-a69d-45f0-959d-35e0a58d5752'} Nov 06 18:02:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0ccc7e4d-3234-4ad2-b864-53c5e936710b tempest-SnapshotDependencyTests-1363145718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:02:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0ccc7e4d-3234-4ad2-b864-53c5e936710b tempest-SnapshotDependencyTests-1363145718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:02:14 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-0ccc7e4d-3234-4ad2-b864-53c5e936710b tempest-SnapshotDependencyTests-1363145718 None] Acquiring lock "cinder-quobyte-38be76ac-a69d-45f0-959d-35e0a58d5752-66372b21-98dc-44b9-b715-93ed4844b103" by "_create_volume_from_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:02:14 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-0ccc7e4d-3234-4ad2-b864-53c5e936710b tempest-SnapshotDependencyTests-1363145718 None] Lock "cinder-quobyte-38be76ac-a69d-45f0-959d-35e0a58d5752-66372b21-98dc-44b9-b715-93ed4844b103" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:02:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0ccc7e4d-3234-4ad2-b864-53c5e936710b tempest-SnapshotDependencyTests-1363145718 None] Creating volume 66372b21-98dc-44b9-b715-93ed4844b103 from snapshot 38be76ac-a69d-45f0-959d-35e0a58d5752 {{(pid=87068) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 18:02:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0ccc7e4d-3234-4ad2-b864-53c5e936710b tempest-SnapshotDependencyTests-1363145718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:02:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0ccc7e4d-3234-4ad2-b864-53c5e936710b tempest-SnapshotDependencyTests-1363145718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:02:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0ccc7e4d-3234-4ad2-b864-53c5e936710b tempest-SnapshotDependencyTests-1363145718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:02:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0ccc7e4d-3234-4ad2-b864-53c5e936710b tempest-SnapshotDependencyTests-1363145718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:02:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0ccc7e4d-3234-4ad2-b864-53c5e936710b tempest-SnapshotDependencyTests-1363145718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:02:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0ccc7e4d-3234-4ad2-b864-53c5e936710b tempest-SnapshotDependencyTests-1363145718 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:02:14 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-0ccc7e4d-3234-4ad2-b864-53c5e936710b tempest-SnapshotDependencyTests-1363145718 None] Acquiring lock "cinder-quobyte-66372b21-98dc-44b9-b715-93ed4844b103" by "_copy_volume_from_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:02:14 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-0ccc7e4d-3234-4ad2-b864-53c5e936710b tempest-SnapshotDependencyTests-1363145718 None] Lock "cinder-quobyte-66372b21-98dc-44b9-b715-93ed4844b103" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:02:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0ccc7e4d-3234-4ad2-b864-53c5e936710b tempest-SnapshotDependencyTests-1363145718 None] snapshot: 38be76ac-a69d-45f0-959d-35e0a58d5752, volume: 66372b21-98dc-44b9-b715-93ed4844b103, {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 18:02:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0ccc7e4d-3234-4ad2-b864-53c5e936710b tempest-SnapshotDependencyTests-1363145718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:02:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0ccc7e4d-3234-4ad2-b864-53c5e936710b tempest-SnapshotDependencyTests-1363145718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:02:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0ccc7e4d-3234-4ad2-b864-53c5e936710b tempest-SnapshotDependencyTests-1363145718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:02:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0ccc7e4d-3234-4ad2-b864-53c5e936710b tempest-SnapshotDependencyTests-1363145718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:02:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0ccc7e4d-3234-4ad2-b864-53c5e936710b tempest-SnapshotDependencyTests-1363145718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:02:14 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0355fbae-ac76-4195-ada7-9f969fcc6ca8]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:02:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0ccc7e4d-3234-4ad2-b864-53c5e936710b tempest-SnapshotDependencyTests-1363145718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-164ec181-9075-42bf-9f49-7d208e73b710.38be76ac-a69d-45f0-959d-35e0a58d5752 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:14 devstack sudo[104293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-164ec181-9075-42bf-9f49-7d208e73b710.38be76ac-a69d-45f0-959d-35e0a58d5752 Nov 06 18:02:14 devstack sudo[104293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:14 devstack sudo[104291]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4a307202-79ea-41ac-b03a-9ff6a6b6b7fe tempest-CreateVolumesFromImageTest-1636374441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5f1a52aa-b858-4485-a4a7-553babae365e" returned: 0 in 0.395s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4a307202-79ea-41ac-b03a-9ff6a6b6b7fe tempest-CreateVolumesFromImageTest-1636374441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5f1a52aa-b858-4485-a4a7-553babae365e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:14 devstack sudo[104298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5f1a52aa-b858-4485-a4a7-553babae365e Nov 06 18:02:14 devstack sudo[104298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:15 devstack sudo[104293]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0ccc7e4d-3234-4ad2-b864-53c5e936710b tempest-SnapshotDependencyTests-1363145718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-164ec181-9075-42bf-9f49-7d208e73b710.38be76ac-a69d-45f0-959d-35e0a58d5752" returned: 0 in 0.425s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:15 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-0ccc7e4d-3234-4ad2-b864-53c5e936710b tempest-SnapshotDependencyTests-1363145718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-164ec181-9075-42bf-9f49-7d208e73b710(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:02:15 devstack sudo[104298]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:15 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cbb30b4-26a2-49e7-885c-945c1664e97b]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:02:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0ccc7e4d-3234-4ad2-b864-53c5e936710b tempest-SnapshotDependencyTests-1363145718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-164ec181-9075-42bf-9f49-7d208e73b710 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4a307202-79ea-41ac-b03a-9ff6a6b6b7fe tempest-CreateVolumesFromImageTest-1636374441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5f1a52aa-b858-4485-a4a7-553babae365e" returned: 0 in 0.315s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:15 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4a307202-79ea-41ac-b03a-9ff6a6b6b7fe tempest-CreateVolumesFromImageTest-1636374441 None] Lock "cinder-quobyte-5f1a52aa-b858-4485-a4a7-553babae365e" released by "delete_volume" :: held 0.758s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:02:15 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-4a307202-79ea-41ac-b03a-9ff6a6b6b7fe tempest-CreateVolumesFromImageTest-1636374441 None] Created reservations ['ab4d80cd-6451-46ca-af45-16c1c23fec84', 'a6ae0f42-c462-4525-8310-2b9579aa1a19', '4205b41b-5ea1-4cc5-baaa-1a6c04b4c2ff', '7a7dd2bf-2438-4ea0-a0fd-7384a354cbba'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:02:15 devstack sudo[104304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-164ec181-9075-42bf-9f49-7d208e73b710 Nov 06 18:02:15 devstack sudo[104304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4a307202-79ea-41ac-b03a-9ff6a6b6b7fe tempest-CreateVolumesFromImageTest-1636374441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:02:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4a307202-79ea-41ac-b03a-9ff6a6b6b7fe tempest-CreateVolumesFromImageTest-1636374441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:02:15 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4a307202-79ea-41ac-b03a-9ff6a6b6b7fe tempest-CreateVolumesFromImageTest-1636374441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:02:15 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4a307202-79ea-41ac-b03a-9ff6a6b6b7fe tempest-CreateVolumesFromImageTest-1636374441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:02:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4a307202-79ea-41ac-b03a-9ff6a6b6b7fe tempest-CreateVolumesFromImageTest-1636374441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:02:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4a307202-79ea-41ac-b03a-9ff6a6b6b7fe tempest-CreateVolumesFromImageTest-1636374441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:15 devstack sudo[104306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:02:15 devstack sudo[104306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:15 devstack sudo[104306]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4a307202-79ea-41ac-b03a-9ff6a6b6b7fe tempest-CreateVolumesFromImageTest-1636374441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.259s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:15 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-4a307202-79ea-41ac-b03a-9ff6a6b6b7fe tempest-CreateVolumesFromImageTest-1636374441 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:02:15 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-4a307202-79ea-41ac-b03a-9ff6a6b6b7fe tempest-CreateVolumesFromImageTest-1636374441 None] Deleted volume successfully. Nov 06 18:02:15 devstack sudo[104304]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0ccc7e4d-3234-4ad2-b864-53c5e936710b tempest-SnapshotDependencyTests-1363145718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-164ec181-9075-42bf-9f49-7d208e73b710" returned: 0 in 0.433s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:15 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0ccc7e4d-3234-4ad2-b864-53c5e936710b tempest-SnapshotDependencyTests-1363145718 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-164ec181-9075-42bf-9f49-7d208e73b710 {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 18:02:15 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0ccc7e4d-3234-4ad2-b864-53c5e936710b tempest-SnapshotDependencyTests-1363145718 None] Creating direct copy from snapshot {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 18:02:15 devstack cinder-volume[87068]: DEBUG cinder.utils [None req-0ccc7e4d-3234-4ad2-b864-53c5e936710b tempest-SnapshotDependencyTests-1363145718 None] Path /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-66372b21-98dc-44b9-b715-93ed4844b103 not found in is_blk_device check {{(pid=87068) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 18:02:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0ccc7e4d-3234-4ad2-b864-53c5e936710b tempest-SnapshotDependencyTests-1363145718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-164ec181-9075-42bf-9f49-7d208e73b710 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-66372b21-98dc-44b9-b715-93ed4844b103 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:15 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4a307202-79ea-41ac-b03a-9ff6a6b6b7fe tempest-CreateVolumesFromImageTest-1636374441 None] Lock "cinder-5f1a52aa-b858-4485-a4a7-553babae365e-delete_volume" released by "delete_volume" :: held 1.264s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:02:15 devstack sudo[104312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-164ec181-9075-42bf-9f49-7d208e73b710 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-66372b21-98dc-44b9-b715-93ed4844b103 Nov 06 18:02:15 devstack sudo[104312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:20 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-67ab4066-7798-40aa-8d86-6b66fa7f8e3e tempest-VolumeDependencyTests-197154585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:02:20 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-67ab4066-7798-40aa-8d86-6b66fa7f8e3e tempest-VolumeDependencyTests-197154585 None] Flow 'volume_create_manager' (372f2a89-6115-44a1-9bd8-2de6d1fb0b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:02:20 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-67ab4066-7798-40aa-8d86-6b66fa7f8e3e tempest-VolumeDependencyTests-197154585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbf26d74-f9a0-4d9c-baf6-34eac483d772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:20 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-67ab4066-7798-40aa-8d86-6b66fa7f8e3e tempest-VolumeDependencyTests-197154585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbf26d74-f9a0-4d9c-baf6-34eac483d772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:02:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-424419358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4b2d880-e99f-451c-8753-9782027926eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5868d939f654103a51520e8198f6f95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:02:20Z,use_quota=True,user_id='0819c0fcf961450da1b8ace01992ef8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:20 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-67ab4066-7798-40aa-8d86-6b66fa7f8e3e tempest-VolumeDependencyTests-197154585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dcc39ad-10e5-400c-9bf2-02c760215996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:20 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-67ab4066-7798-40aa-8d86-6b66fa7f8e3e tempest-VolumeDependencyTests-197154585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dcc39ad-10e5-400c-9bf2-02c760215996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:20 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-67ab4066-7798-40aa-8d86-6b66fa7f8e3e tempest-VolumeDependencyTests-197154585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9edfdd48-d73a-469b-8c89-456f2ea1b26e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:20 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-67ab4066-7798-40aa-8d86-6b66fa7f8e3e tempest-VolumeDependencyTests-197154585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9edfdd48-d73a-469b-8c89-456f2ea1b26e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4b2d880-e99f-451c-8753-9782027926eb', 'volume_name': 'volume-a4b2d880-e99f-451c-8753-9782027926eb', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:20 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-67ab4066-7798-40aa-8d86-6b66fa7f8e3e tempest-VolumeDependencyTests-197154585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3290f7c8-2405-4b2a-b890-0afb3f8a4946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:20 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-67ab4066-7798-40aa-8d86-6b66fa7f8e3e tempest-VolumeDependencyTests-197154585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3290f7c8-2405-4b2a-b890-0afb3f8a4946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:20 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-67ab4066-7798-40aa-8d86-6b66fa7f8e3e tempest-VolumeDependencyTests-197154585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cb4390b-7f4a-4fd2-aa52-803fe5793143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:20 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-67ab4066-7798-40aa-8d86-6b66fa7f8e3e tempest-VolumeDependencyTests-197154585 None] Volume a4b2d880-e99f-451c-8753-9782027926eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4b2d880-e99f-451c-8753-9782027926eb', 'volume_size': 1} Nov 06 18:02:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-67ab4066-7798-40aa-8d86-6b66fa7f8e3e tempest-VolumeDependencyTests-197154585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:02:22 devstack sudo[104312]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0ccc7e4d-3234-4ad2-b864-53c5e936710b tempest-SnapshotDependencyTests-1363145718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-164ec181-9075-42bf-9f49-7d208e73b710 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-66372b21-98dc-44b9-b715-93ed4844b103" returned: 0 in 6.750s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:22 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-0ccc7e4d-3234-4ad2-b864-53c5e936710b tempest-SnapshotDependencyTests-1363145718 None] Image conversion details: src /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-164ec181-9075-42bf-9f49-7d208e73b710, size 1024.00 MB, duration 6.75 sec, destination /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-66372b21-98dc-44b9-b715-93ed4844b103 {{(pid=87068) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 18:02:22 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-0ccc7e4d-3234-4ad2-b864-53c5e936710b tempest-SnapshotDependencyTests-1363145718 None] Converted 1024.00 MB image at 151.69 MB/s Nov 06 18:02:22 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-0ccc7e4d-3234-4ad2-b864-53c5e936710b tempest-SnapshotDependencyTests-1363145718 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-66372b21-98dc-44b9-b715-93ed4844b103 is being set with open permissions: ugo+rw Nov 06 18:02:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0ccc7e4d-3234-4ad2-b864-53c5e936710b tempest-SnapshotDependencyTests-1363145718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-66372b21-98dc-44b9-b715-93ed4844b103 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:22 devstack sudo[104326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-66372b21-98dc-44b9-b715-93ed4844b103 Nov 06 18:02:22 devstack sudo[104326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:22 devstack sudo[104326]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0ccc7e4d-3234-4ad2-b864-53c5e936710b tempest-SnapshotDependencyTests-1363145718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-66372b21-98dc-44b9-b715-93ed4844b103" returned: 0 in 0.223s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:22 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-0ccc7e4d-3234-4ad2-b864-53c5e936710b tempest-SnapshotDependencyTests-1363145718 None] Lock "cinder-quobyte-66372b21-98dc-44b9-b715-93ed4844b103" released by "_copy_volume_from_snapshot" :: held 7.918s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:02:22 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-0ccc7e4d-3234-4ad2-b864-53c5e936710b tempest-SnapshotDependencyTests-1363145718 None] Lock "cinder-quobyte-38be76ac-a69d-45f0-959d-35e0a58d5752-66372b21-98dc-44b9-b715-93ed4844b103" released by "_create_volume_from_snapshot" :: held 7.982s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:02:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0ccc7e4d-3234-4ad2-b864-53c5e936710b tempest-SnapshotDependencyTests-1363145718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.996s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:02:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-67ab4066-7798-40aa-8d86-6b66fa7f8e3e tempest-VolumeDependencyTests-197154585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.414s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:02:22 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-67ab4066-7798-40aa-8d86-6b66fa7f8e3e tempest-VolumeDependencyTests-197154585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:02:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-424419358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4b2d880-e99f-451c-8753-9782027926eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5868d939f654103a51520e8198f6f95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:02:20Z,use_quota=True,user_id='0819c0fcf961450da1b8ace01992ef8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:02:22 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-67ab4066-7798-40aa-8d86-6b66fa7f8e3e tempest-VolumeDependencyTests-197154585 None] Creating volume a4b2d880-e99f-451c-8753-9782027926eb {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:02:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-67ab4066-7798-40aa-8d86-6b66fa7f8e3e tempest-VolumeDependencyTests-197154585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:02:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-67ab4066-7798-40aa-8d86-6b66fa7f8e3e tempest-VolumeDependencyTests-197154585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:02:22 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-67ab4066-7798-40aa-8d86-6b66fa7f8e3e tempest-VolumeDependencyTests-197154585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:02:22 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-67ab4066-7798-40aa-8d86-6b66fa7f8e3e tempest-VolumeDependencyTests-197154585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:02:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-67ab4066-7798-40aa-8d86-6b66fa7f8e3e tempest-VolumeDependencyTests-197154585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:02:22 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-67ab4066-7798-40aa-8d86-6b66fa7f8e3e tempest-VolumeDependencyTests-197154585 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:02:22 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-67ab4066-7798-40aa-8d86-6b66fa7f8e3e tempest-VolumeDependencyTests-197154585 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:02:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-67ab4066-7798-40aa-8d86-6b66fa7f8e3e tempest-VolumeDependencyTests-197154585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a4b2d880-e99f-451c-8753-9782027926eb 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:22 devstack sudo[104329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a4b2d880-e99f-451c-8753-9782027926eb 1073741824 Nov 06 18:02:22 devstack sudo[104329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:22 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0ccc7e4d-3234-4ad2-b864-53c5e936710b tempest-SnapshotDependencyTests-1363145718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddea08c1-ae98-4896-b1e4-5029076bdd71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66372b21-98dc-44b9-b715-93ed4844b103', 'volume_size': 1, 'snapshot_id': '38be76ac-a69d-45f0-959d-35e0a58d5752'}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:22 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0ccc7e4d-3234-4ad2-b864-53c5e936710b tempest-SnapshotDependencyTests-1363145718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f804915-3b09-4b0d-8920-ece2fe1d8ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:22 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-0ccc7e4d-3234-4ad2-b864-53c5e936710b tempest-SnapshotDependencyTests-1363145718 None] Volume volume-66372b21-98dc-44b9-b715-93ed4844b103 (66372b21-98dc-44b9-b715-93ed4844b103): created successfully Nov 06 18:02:22 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0ccc7e4d-3234-4ad2-b864-53c5e936710b tempest-SnapshotDependencyTests-1363145718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f804915-3b09-4b0d-8920-ece2fe1d8ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:22 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0ccc7e4d-3234-4ad2-b864-53c5e936710b tempest-SnapshotDependencyTests-1363145718 None] Flow 'volume_create_manager' (cdcefd7b-2c5d-4bd0-bb76-4cb3190884a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:02:22 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-0ccc7e4d-3234-4ad2-b864-53c5e936710b tempest-SnapshotDependencyTests-1363145718 None] Created volume successfully. Nov 06 18:02:23 devstack sudo[104329]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-67ab4066-7798-40aa-8d86-6b66fa7f8e3e tempest-VolumeDependencyTests-197154585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a4b2d880-e99f-451c-8753-9782027926eb 1073741824" returned: 0 in 0.409s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:23 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:UPDATE=203,cinder:SELECT=133,cinder:DELETE=22,cinder:INSERT=60 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:02:23 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=154,cinder:UPDATE=210,cinder:INSERT=51,cinder:DELETE=16 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:02:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-67ab4066-7798-40aa-8d86-6b66fa7f8e3e tempest-VolumeDependencyTests-197154585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a4b2d880-e99f-451c-8753-9782027926eb {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:23 devstack sudo[104335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a4b2d880-e99f-451c-8753-9782027926eb Nov 06 18:02:23 devstack sudo[104335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:23 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-52a885c9-ae83-4540-ad30-418049e23a5f tempest-SnapshotDependencyTests-1363145718 None] Acquiring lock "cinder-38be76ac-a69d-45f0-959d-35e0a58d5752-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:02:23 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-52a885c9-ae83-4540-ad30-418049e23a5f tempest-SnapshotDependencyTests-1363145718 None] Lock "cinder-38be76ac-a69d-45f0-959d-35e0a58d5752-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:02:23 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-52a885c9-ae83-4540-ad30-418049e23a5f tempest-SnapshotDependencyTests-1363145718 None] Acquiring lock "cinder-quobyte-164ec181-9075-42bf-9f49-7d208e73b710" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:02:23 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-52a885c9-ae83-4540-ad30-418049e23a5f tempest-SnapshotDependencyTests-1363145718 None] Lock "cinder-quobyte-164ec181-9075-42bf-9f49-7d208e73b710" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:02:23 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-52a885c9-ae83-4540-ad30-418049e23a5f tempest-SnapshotDependencyTests-1363145718 None] Acquiring lock "cinder-quobyte-38be76ac-a69d-45f0-959d-35e0a58d5752" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:02:23 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-52a885c9-ae83-4540-ad30-418049e23a5f tempest-SnapshotDependencyTests-1363145718 None] Lock "cinder-quobyte-38be76ac-a69d-45f0-959d-35e0a58d5752" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:02:23 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-52a885c9-ae83-4540-ad30-418049e23a5f tempest-SnapshotDependencyTests-1363145718 None] Deleting offline snapshot 38be76ac-a69d-45f0-959d-35e0a58d5752 of volume 164ec181-9075-42bf-9f49-7d208e73b710 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:02:23 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-52a885c9-ae83-4540-ad30-418049e23a5f tempest-SnapshotDependencyTests-1363145718 None] snapshot_file for this snap is: volume-164ec181-9075-42bf-9f49-7d208e73b710.38be76ac-a69d-45f0-959d-35e0a58d5752 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:02:23 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b81944-ef53-42f8-9aa4-13a4b0d5f9c1]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:02:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-52a885c9-ae83-4540-ad30-418049e23a5f tempest-SnapshotDependencyTests-1363145718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-164ec181-9075-42bf-9f49-7d208e73b710.38be76ac-a69d-45f0-959d-35e0a58d5752 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:23 devstack sudo[104335]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-67ab4066-7798-40aa-8d86-6b66fa7f8e3e tempest-VolumeDependencyTests-197154585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a4b2d880-e99f-451c-8753-9782027926eb" returned: 0 in 0.269s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:23 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-67ab4066-7798-40aa-8d86-6b66fa7f8e3e tempest-VolumeDependencyTests-197154585 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:02:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-67ab4066-7798-40aa-8d86-6b66fa7f8e3e tempest-VolumeDependencyTests-197154585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:02:23 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-67ab4066-7798-40aa-8d86-6b66fa7f8e3e tempest-VolumeDependencyTests-197154585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cb4390b-7f4a-4fd2-aa52-803fe5793143) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4b2d880-e99f-451c-8753-9782027926eb', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:23 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-67ab4066-7798-40aa-8d86-6b66fa7f8e3e tempest-VolumeDependencyTests-197154585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff23970d-7e23-419e-9f2f-484d628ac31a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:23 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-67ab4066-7798-40aa-8d86-6b66fa7f8e3e tempest-VolumeDependencyTests-197154585 None] Volume volume-a4b2d880-e99f-451c-8753-9782027926eb (a4b2d880-e99f-451c-8753-9782027926eb): created successfully Nov 06 18:02:23 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-67ab4066-7798-40aa-8d86-6b66fa7f8e3e tempest-VolumeDependencyTests-197154585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff23970d-7e23-419e-9f2f-484d628ac31a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:23 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-67ab4066-7798-40aa-8d86-6b66fa7f8e3e tempest-VolumeDependencyTests-197154585 None] Flow 'volume_create_manager' (372f2a89-6115-44a1-9bd8-2de6d1fb0b5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:02:23 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-67ab4066-7798-40aa-8d86-6b66fa7f8e3e tempest-VolumeDependencyTests-197154585 None] Created volume successfully. Nov 06 18:02:23 devstack sudo[104338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-164ec181-9075-42bf-9f49-7d208e73b710.38be76ac-a69d-45f0-959d-35e0a58d5752 Nov 06 18:02:23 devstack sudo[104338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:23 devstack sudo[104338]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-52a885c9-ae83-4540-ad30-418049e23a5f tempest-SnapshotDependencyTests-1363145718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-164ec181-9075-42bf-9f49-7d208e73b710.38be76ac-a69d-45f0-959d-35e0a58d5752" returned: 0 in 0.352s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:23 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-52a885c9-ae83-4540-ad30-418049e23a5f tempest-SnapshotDependencyTests-1363145718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-164ec181-9075-42bf-9f49-7d208e73b710(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:02:23 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a930012e-27f8-46c3-9fe3-b9988d6e4118]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:02:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-52a885c9-ae83-4540-ad30-418049e23a5f tempest-SnapshotDependencyTests-1363145718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-164ec181-9075-42bf-9f49-7d208e73b710 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:23 devstack sudo[104343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-164ec181-9075-42bf-9f49-7d208e73b710 Nov 06 18:02:23 devstack sudo[104343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:24 devstack sudo[104343]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-52a885c9-ae83-4540-ad30-418049e23a5f tempest-SnapshotDependencyTests-1363145718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-164ec181-9075-42bf-9f49-7d208e73b710" returned: 0 in 0.498s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-52a885c9-ae83-4540-ad30-418049e23a5f tempest-SnapshotDependencyTests-1363145718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-164ec181-9075-42bf-9f49-7d208e73b710.38be76ac-a69d-45f0-959d-35e0a58d5752 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:24 devstack sudo[104348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-164ec181-9075-42bf-9f49-7d208e73b710.38be76ac-a69d-45f0-959d-35e0a58d5752 Nov 06 18:02:24 devstack sudo[104348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-035e2453-28df-43bc-a3ac-9fac57c90e65 tempest-VolumeDependencyTests-197154585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:02:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-035e2453-28df-43bc-a3ac-9fac57c90e65 tempest-VolumeDependencyTests-197154585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:02:24 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-035e2453-28df-43bc-a3ac-9fac57c90e65 tempest-VolumeDependencyTests-197154585 None] Creating offline snapshot cec1b9a1-9c50-4b3b-bf8f-469d6f6c483a of volume a4b2d880-e99f-451c-8753-9782027926eb {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:02:24 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef9c314-3355-4def-806f-6a516bbd8ca4]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:02:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-035e2453-28df-43bc-a3ac-9fac57c90e65 tempest-VolumeDependencyTests-197154585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a4b2d880-e99f-451c-8753-9782027926eb {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:24 devstack sudo[104348]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-52a885c9-ae83-4540-ad30-418049e23a5f tempest-SnapshotDependencyTests-1363145718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-164ec181-9075-42bf-9f49-7d208e73b710.38be76ac-a69d-45f0-959d-35e0a58d5752" returned: 0 in 0.367s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-52a885c9-ae83-4540-ad30-418049e23a5f tempest-SnapshotDependencyTests-1363145718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-164ec181-9075-42bf-9f49-7d208e73b710.38be76ac-a69d-45f0-959d-35e0a58d5752 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:24 devstack sudo[104355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-164ec181-9075-42bf-9f49-7d208e73b710.38be76ac-a69d-45f0-959d-35e0a58d5752 Nov 06 18:02:24 devstack sudo[104355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:24 devstack sudo[104354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a4b2d880-e99f-451c-8753-9782027926eb Nov 06 18:02:24 devstack sudo[104354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:24 devstack sudo[104355]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-52a885c9-ae83-4540-ad30-418049e23a5f tempest-SnapshotDependencyTests-1363145718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-164ec181-9075-42bf-9f49-7d208e73b710.38be76ac-a69d-45f0-959d-35e0a58d5752" returned: 0 in 0.240s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:24 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-52a885c9-ae83-4540-ad30-418049e23a5f tempest-SnapshotDependencyTests-1363145718 None] Lock "cinder-quobyte-38be76ac-a69d-45f0-959d-35e0a58d5752" released by "_delete_snapshot" :: held 1.566s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:02:24 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-52a885c9-ae83-4540-ad30-418049e23a5f tempest-SnapshotDependencyTests-1363145718 None] Lock "cinder-quobyte-164ec181-9075-42bf-9f49-7d208e73b710" released by "delete_snapshot" :: held 1.588s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:02:24 devstack sudo[104354]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-035e2453-28df-43bc-a3ac-9fac57c90e65 tempest-VolumeDependencyTests-197154585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a4b2d880-e99f-451c-8753-9782027926eb" returned: 0 in 0.369s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-035e2453-28df-43bc-a3ac-9fac57c90e65 tempest-VolumeDependencyTests-197154585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a4b2d880-e99f-451c-8753-9782027926eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a4b2d880-e99f-451c-8753-9782027926eb.cec1b9a1-9c50-4b3b-bf8f-469d6f6c483a 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:24 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-52a885c9-ae83-4540-ad30-418049e23a5f tempest-SnapshotDependencyTests-1363145718 None] Created reservations ['7966b026-f71f-459a-b055-cb49c4dd5481', 'ad1694f5-c59e-49da-98fc-c7b7f3a8a209', 'e7f52b73-66a1-492a-a695-23b41190b0d3', '0619669b-0d59-411f-8e90-e944b0943a61'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:02:24 devstack sudo[104362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a4b2d880-e99f-451c-8753-9782027926eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a4b2d880-e99f-451c-8753-9782027926eb.cec1b9a1-9c50-4b3b-bf8f-469d6f6c483a 1G Nov 06 18:02:24 devstack sudo[104362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:25 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-52a885c9-ae83-4540-ad30-418049e23a5f tempest-SnapshotDependencyTests-1363145718 None] Delete snapshot completed successfully. Nov 06 18:02:25 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-52a885c9-ae83-4540-ad30-418049e23a5f tempest-SnapshotDependencyTests-1363145718 None] Lock "cinder-38be76ac-a69d-45f0-959d-35e0a58d5752-delete_snapshot" released by "delete_snapshot" :: held 1.740s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:02:25 devstack sudo[104362]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-035e2453-28df-43bc-a3ac-9fac57c90e65 tempest-VolumeDependencyTests-197154585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a4b2d880-e99f-451c-8753-9782027926eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a4b2d880-e99f-451c-8753-9782027926eb.cec1b9a1-9c50-4b3b-bf8f-469d6f6c483a 1G" returned: 0 in 0.383s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-035e2453-28df-43bc-a3ac-9fac57c90e65 tempest-VolumeDependencyTests-197154585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4b2d880-e99f-451c-8753-9782027926eb -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a4b2d880-e99f-451c-8753-9782027926eb.cec1b9a1-9c50-4b3b-bf8f-469d6f6c483a {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:25 devstack sudo[104367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4b2d880-e99f-451c-8753-9782027926eb -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a4b2d880-e99f-451c-8753-9782027926eb.cec1b9a1-9c50-4b3b-bf8f-469d6f6c483a Nov 06 18:02:25 devstack sudo[104367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:25 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e6707978-7eb0-4189-ac6d-5a763034f861 tempest-SnapshotDependencyTests-1363145718 None] Acquiring lock "cinder-164ec181-9075-42bf-9f49-7d208e73b710-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:02:25 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e6707978-7eb0-4189-ac6d-5a763034f861 tempest-SnapshotDependencyTests-1363145718 None] Lock "cinder-164ec181-9075-42bf-9f49-7d208e73b710-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:02:25 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e6707978-7eb0-4189-ac6d-5a763034f861 tempest-SnapshotDependencyTests-1363145718 None] Acquiring lock "cinder-quobyte-164ec181-9075-42bf-9f49-7d208e73b710" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:02:25 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e6707978-7eb0-4189-ac6d-5a763034f861 tempest-SnapshotDependencyTests-1363145718 None] Lock "cinder-quobyte-164ec181-9075-42bf-9f49-7d208e73b710" acquired by "delete_volume" :: waited 0.017s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:02:25 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b839a0-8bc9-4132-b9f4-3cfa1424b654]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:02:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e6707978-7eb0-4189-ac6d-5a763034f861 tempest-SnapshotDependencyTests-1363145718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-164ec181-9075-42bf-9f49-7d208e73b710 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:25 devstack sudo[104367]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-035e2453-28df-43bc-a3ac-9fac57c90e65 tempest-VolumeDependencyTests-197154585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4b2d880-e99f-451c-8753-9782027926eb -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a4b2d880-e99f-451c-8753-9782027926eb.cec1b9a1-9c50-4b3b-bf8f-469d6f6c483a" returned: 0 in 0.316s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:25 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-035e2453-28df-43bc-a3ac-9fac57c90e65 tempest-VolumeDependencyTests-197154585 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a4b2d880-e99f-451c-8753-9782027926eb.cec1b9a1-9c50-4b3b-bf8f-469d6f6c483a is being set with open permissions: ugo+rw Nov 06 18:02:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-035e2453-28df-43bc-a3ac-9fac57c90e65 tempest-VolumeDependencyTests-197154585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a4b2d880-e99f-451c-8753-9782027926eb.cec1b9a1-9c50-4b3b-bf8f-469d6f6c483a {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:25 devstack sudo[104373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a4b2d880-e99f-451c-8753-9782027926eb.cec1b9a1-9c50-4b3b-bf8f-469d6f6c483a Nov 06 18:02:25 devstack sudo[104373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:25 devstack sudo[104371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-164ec181-9075-42bf-9f49-7d208e73b710 Nov 06 18:02:25 devstack sudo[104371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:25 devstack sudo[104373]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-035e2453-28df-43bc-a3ac-9fac57c90e65 tempest-VolumeDependencyTests-197154585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a4b2d880-e99f-451c-8753-9782027926eb.cec1b9a1-9c50-4b3b-bf8f-469d6f6c483a" returned: 0 in 0.276s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:25 devstack sudo[104371]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-035e2453-28df-43bc-a3ac-9fac57c90e65 tempest-VolumeDependencyTests-197154585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a4b2d880-e99f-451c-8753-9782027926eb.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e6707978-7eb0-4189-ac6d-5a763034f861 tempest-SnapshotDependencyTests-1363145718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-164ec181-9075-42bf-9f49-7d208e73b710" returned: 0 in 0.400s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e6707978-7eb0-4189-ac6d-5a763034f861 tempest-SnapshotDependencyTests-1363145718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-164ec181-9075-42bf-9f49-7d208e73b710 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:26 devstack sudo[104380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a4b2d880-e99f-451c-8753-9782027926eb.info Nov 06 18:02:26 devstack sudo[104380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:26 devstack sudo[104381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-164ec181-9075-42bf-9f49-7d208e73b710 Nov 06 18:02:26 devstack sudo[104381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:26 devstack sudo[104380]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-035e2453-28df-43bc-a3ac-9fac57c90e65 tempest-VolumeDependencyTests-197154585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a4b2d880-e99f-451c-8753-9782027926eb.info" returned: 0 in 0.253s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:26 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-035e2453-28df-43bc-a3ac-9fac57c90e65 tempest-VolumeDependencyTests-197154585 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a4b2d880-e99f-451c-8753-9782027926eb.info is being set with open permissions: ugo+rw Nov 06 18:02:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-035e2453-28df-43bc-a3ac-9fac57c90e65 tempest-VolumeDependencyTests-197154585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a4b2d880-e99f-451c-8753-9782027926eb.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:26 devstack sudo[104386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a4b2d880-e99f-451c-8753-9782027926eb.info Nov 06 18:02:26 devstack sudo[104386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:26 devstack sudo[104381]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e6707978-7eb0-4189-ac6d-5a763034f861 tempest-SnapshotDependencyTests-1363145718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-164ec181-9075-42bf-9f49-7d208e73b710" returned: 0 in 0.268s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:26 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e6707978-7eb0-4189-ac6d-5a763034f861 tempest-SnapshotDependencyTests-1363145718 None] Lock "cinder-quobyte-164ec181-9075-42bf-9f49-7d208e73b710" released by "delete_volume" :: held 0.745s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:02:26 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-e6707978-7eb0-4189-ac6d-5a763034f861 tempest-SnapshotDependencyTests-1363145718 None] Created reservations ['4f9fc251-0ec8-4667-aa96-b89bab1f374c', '7e4920bc-1eb3-4dcc-8720-a8afc0b475ef', '074fc679-4eed-4f74-b5a1-6bd59b1bdc79', '63d77149-0991-489a-89a5-df7bc9eef439'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:02:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e6707978-7eb0-4189-ac6d-5a763034f861 tempest-SnapshotDependencyTests-1363145718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:02:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e6707978-7eb0-4189-ac6d-5a763034f861 tempest-SnapshotDependencyTests-1363145718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:02:26 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e6707978-7eb0-4189-ac6d-5a763034f861 tempest-SnapshotDependencyTests-1363145718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:02:26 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e6707978-7eb0-4189-ac6d-5a763034f861 tempest-SnapshotDependencyTests-1363145718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:02:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e6707978-7eb0-4189-ac6d-5a763034f861 tempest-SnapshotDependencyTests-1363145718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:02:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e6707978-7eb0-4189-ac6d-5a763034f861 tempest-SnapshotDependencyTests-1363145718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:26 devstack sudo[104388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:02:26 devstack sudo[104388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:26 devstack sudo[104386]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-035e2453-28df-43bc-a3ac-9fac57c90e65 tempest-VolumeDependencyTests-197154585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a4b2d880-e99f-451c-8753-9782027926eb.info" returned: 0 in 0.250s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-035e2453-28df-43bc-a3ac-9fac57c90e65 tempest-VolumeDependencyTests-197154585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.943s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:02:26 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-035e2453-28df-43bc-a3ac-9fac57c90e65 tempest-VolumeDependencyTests-197154585 None] Create snapshot completed successfully Nov 06 18:02:26 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-70bd1239-d47c-4521-af95-e17fc7b8963e tempest-SnapshotDependencyTests-1363145718 None] Acquiring lock "cinder-66372b21-98dc-44b9-b715-93ed4844b103-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:02:26 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-70bd1239-d47c-4521-af95-e17fc7b8963e tempest-SnapshotDependencyTests-1363145718 None] Lock "cinder-66372b21-98dc-44b9-b715-93ed4844b103-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:02:26 devstack sudo[104388]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e6707978-7eb0-4189-ac6d-5a763034f861 tempest-SnapshotDependencyTests-1363145718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.288s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:26 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-e6707978-7eb0-4189-ac6d-5a763034f861 tempest-SnapshotDependencyTests-1363145718 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:02:26 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-e6707978-7eb0-4189-ac6d-5a763034f861 tempest-SnapshotDependencyTests-1363145718 None] Deleted volume successfully. Nov 06 18:02:26 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-70bd1239-d47c-4521-af95-e17fc7b8963e tempest-SnapshotDependencyTests-1363145718 None] Acquiring lock "cinder-quobyte-66372b21-98dc-44b9-b715-93ed4844b103" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:02:26 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e6707978-7eb0-4189-ac6d-5a763034f861 tempest-SnapshotDependencyTests-1363145718 None] Lock "cinder-164ec181-9075-42bf-9f49-7d208e73b710-delete_volume" released by "delete_volume" :: held 1.252s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:02:26 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-70bd1239-d47c-4521-af95-e17fc7b8963e tempest-SnapshotDependencyTests-1363145718 None] Lock "cinder-quobyte-66372b21-98dc-44b9-b715-93ed4844b103" acquired by "delete_volume" :: waited 0.016s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:02:26 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a4ab04-3710-4d4d-a787-80fe9c8fc00c]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:02:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-70bd1239-d47c-4521-af95-e17fc7b8963e tempest-SnapshotDependencyTests-1363145718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-66372b21-98dc-44b9-b715-93ed4844b103 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:26 devstack sudo[104392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-66372b21-98dc-44b9-b715-93ed4844b103 Nov 06 18:02:26 devstack sudo[104392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:27 devstack sudo[104392]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-70bd1239-d47c-4521-af95-e17fc7b8963e tempest-SnapshotDependencyTests-1363145718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-66372b21-98dc-44b9-b715-93ed4844b103" returned: 0 in 0.399s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-70bd1239-d47c-4521-af95-e17fc7b8963e tempest-SnapshotDependencyTests-1363145718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-66372b21-98dc-44b9-b715-93ed4844b103 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:27 devstack sudo[104397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-66372b21-98dc-44b9-b715-93ed4844b103 Nov 06 18:02:27 devstack sudo[104397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:27 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-94754209-9953-4f89-8bc8-64219e672632 tempest-VolumeDependencyTests-197154585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:02:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-94754209-9953-4f89-8bc8-64219e672632 tempest-VolumeDependencyTests-197154585 None] Flow 'volume_create_manager' (14d3cc46-7507-4372-90d6-aac571872df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:02:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-94754209-9953-4f89-8bc8-64219e672632 tempest-VolumeDependencyTests-197154585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d9c6df0-ac87-4a04-8949-d5eafa2e98c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-94754209-9953-4f89-8bc8-64219e672632 tempest-VolumeDependencyTests-197154585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d9c6df0-ac87-4a04-8949-d5eafa2e98c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:02:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1484295434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f92011c-5d60-4a26-a5fd-c28b4fc0dc93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5868d939f654103a51520e8198f6f95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:02:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cec1b9a1-9c50-4b3b-bf8f-469d6f6c483a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:02:27Z,use_quota=True,user_id='0819c0fcf961450da1b8ace01992ef8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-94754209-9953-4f89-8bc8-64219e672632 tempest-VolumeDependencyTests-197154585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2f29c32-4736-46b2-a5c3-213a9e001dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-94754209-9953-4f89-8bc8-64219e672632 tempest-VolumeDependencyTests-197154585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2f29c32-4736-46b2-a5c3-213a9e001dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-94754209-9953-4f89-8bc8-64219e672632 tempest-VolumeDependencyTests-197154585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7376148-03cb-4aef-9bdc-a58fccd53eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-94754209-9953-4f89-8bc8-64219e672632 tempest-VolumeDependencyTests-197154585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7376148-03cb-4aef-9bdc-a58fccd53eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8f92011c-5d60-4a26-a5fd-c28b4fc0dc93', 'volume_name': 'volume-8f92011c-5d60-4a26-a5fd-c28b4fc0dc93', 'volume_size': 1, 'snapshot_id': 'cec1b9a1-9c50-4b3b-bf8f-469d6f6c483a'}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-94754209-9953-4f89-8bc8-64219e672632 tempest-VolumeDependencyTests-197154585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cae9678-28a8-44aa-b079-0c7ae56aebaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-94754209-9953-4f89-8bc8-64219e672632 tempest-VolumeDependencyTests-197154585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cae9678-28a8-44aa-b079-0c7ae56aebaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-94754209-9953-4f89-8bc8-64219e672632 tempest-VolumeDependencyTests-197154585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (627204de-9f0a-46ed-aeed-7c6459ac2232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:27 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-94754209-9953-4f89-8bc8-64219e672632 tempest-VolumeDependencyTests-197154585 None] Volume 8f92011c-5d60-4a26-a5fd-c28b4fc0dc93: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8f92011c-5d60-4a26-a5fd-c28b4fc0dc93', 'volume_size': 1, 'snapshot_id': 'cec1b9a1-9c50-4b3b-bf8f-469d6f6c483a'} Nov 06 18:02:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-94754209-9953-4f89-8bc8-64219e672632 tempest-VolumeDependencyTests-197154585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:02:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-94754209-9953-4f89-8bc8-64219e672632 tempest-VolumeDependencyTests-197154585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:02:27 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-94754209-9953-4f89-8bc8-64219e672632 tempest-VolumeDependencyTests-197154585 None] Acquiring lock "cinder-quobyte-cec1b9a1-9c50-4b3b-bf8f-469d6f6c483a-8f92011c-5d60-4a26-a5fd-c28b4fc0dc93" by "_create_volume_from_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:02:27 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-94754209-9953-4f89-8bc8-64219e672632 tempest-VolumeDependencyTests-197154585 None] Lock "cinder-quobyte-cec1b9a1-9c50-4b3b-bf8f-469d6f6c483a-8f92011c-5d60-4a26-a5fd-c28b4fc0dc93" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:02:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-94754209-9953-4f89-8bc8-64219e672632 tempest-VolumeDependencyTests-197154585 None] Creating volume 8f92011c-5d60-4a26-a5fd-c28b4fc0dc93 from snapshot cec1b9a1-9c50-4b3b-bf8f-469d6f6c483a {{(pid=87068) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 18:02:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-94754209-9953-4f89-8bc8-64219e672632 tempest-VolumeDependencyTests-197154585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:02:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-94754209-9953-4f89-8bc8-64219e672632 tempest-VolumeDependencyTests-197154585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:02:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-94754209-9953-4f89-8bc8-64219e672632 tempest-VolumeDependencyTests-197154585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:02:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-94754209-9953-4f89-8bc8-64219e672632 tempest-VolumeDependencyTests-197154585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:02:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-94754209-9953-4f89-8bc8-64219e672632 tempest-VolumeDependencyTests-197154585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:02:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-94754209-9953-4f89-8bc8-64219e672632 tempest-VolumeDependencyTests-197154585 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:02:27 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-94754209-9953-4f89-8bc8-64219e672632 tempest-VolumeDependencyTests-197154585 None] Acquiring lock "cinder-quobyte-8f92011c-5d60-4a26-a5fd-c28b4fc0dc93" by "_copy_volume_from_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:02:27 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-94754209-9953-4f89-8bc8-64219e672632 tempest-VolumeDependencyTests-197154585 None] Lock "cinder-quobyte-8f92011c-5d60-4a26-a5fd-c28b4fc0dc93" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:02:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-94754209-9953-4f89-8bc8-64219e672632 tempest-VolumeDependencyTests-197154585 None] snapshot: cec1b9a1-9c50-4b3b-bf8f-469d6f6c483a, volume: 8f92011c-5d60-4a26-a5fd-c28b4fc0dc93, {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 18:02:27 devstack sudo[104397]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-94754209-9953-4f89-8bc8-64219e672632 tempest-VolumeDependencyTests-197154585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:02:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-94754209-9953-4f89-8bc8-64219e672632 tempest-VolumeDependencyTests-197154585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:02:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-94754209-9953-4f89-8bc8-64219e672632 tempest-VolumeDependencyTests-197154585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:02:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-94754209-9953-4f89-8bc8-64219e672632 tempest-VolumeDependencyTests-197154585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:02:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-94754209-9953-4f89-8bc8-64219e672632 tempest-VolumeDependencyTests-197154585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:02:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-70bd1239-d47c-4521-af95-e17fc7b8963e tempest-SnapshotDependencyTests-1363145718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-66372b21-98dc-44b9-b715-93ed4844b103" returned: 0 in 0.272s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:27 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5df7a90-7f96-46a1-ade4-96a74d168a51]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:02:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-94754209-9953-4f89-8bc8-64219e672632 tempest-VolumeDependencyTests-197154585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a4b2d880-e99f-451c-8753-9782027926eb.cec1b9a1-9c50-4b3b-bf8f-469d6f6c483a {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:27 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-70bd1239-d47c-4521-af95-e17fc7b8963e tempest-SnapshotDependencyTests-1363145718 None] Lock "cinder-quobyte-66372b21-98dc-44b9-b715-93ed4844b103" released by "delete_volume" :: held 0.724s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:02:27 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-70bd1239-d47c-4521-af95-e17fc7b8963e tempest-SnapshotDependencyTests-1363145718 None] Created reservations ['9dc8a729-a952-4ef2-8743-aecf2471464c', '139d13d3-0432-4b7d-a2c3-8827050f6ac6', '3f585449-07fe-4a33-900e-7f7553a101a4', 'be2d889f-d345-4859-b5c7-94d8675189e1'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:02:27 devstack sudo[104400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a4b2d880-e99f-451c-8753-9782027926eb.cec1b9a1-9c50-4b3b-bf8f-469d6f6c483a Nov 06 18:02:27 devstack sudo[104400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-70bd1239-d47c-4521-af95-e17fc7b8963e tempest-SnapshotDependencyTests-1363145718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:02:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-70bd1239-d47c-4521-af95-e17fc7b8963e tempest-SnapshotDependencyTests-1363145718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:02:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-70bd1239-d47c-4521-af95-e17fc7b8963e tempest-SnapshotDependencyTests-1363145718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:02:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-70bd1239-d47c-4521-af95-e17fc7b8963e tempest-SnapshotDependencyTests-1363145718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:02:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-70bd1239-d47c-4521-af95-e17fc7b8963e tempest-SnapshotDependencyTests-1363145718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:02:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-70bd1239-d47c-4521-af95-e17fc7b8963e tempest-SnapshotDependencyTests-1363145718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:27 devstack sudo[104402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:02:27 devstack sudo[104402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:27 devstack sudo[104400]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-94754209-9953-4f89-8bc8-64219e672632 tempest-VolumeDependencyTests-197154585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a4b2d880-e99f-451c-8753-9782027926eb.cec1b9a1-9c50-4b3b-bf8f-469d6f6c483a" returned: 0 in 0.383s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-94754209-9953-4f89-8bc8-64219e672632 tempest-VolumeDependencyTests-197154585 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4b2d880-e99f-451c-8753-9782027926eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:02:27 devstack sudo[104402]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-70bd1239-d47c-4521-af95-e17fc7b8963e tempest-SnapshotDependencyTests-1363145718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.262s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:27 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-70bd1239-d47c-4521-af95-e17fc7b8963e tempest-SnapshotDependencyTests-1363145718 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:02:27 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-70bd1239-d47c-4521-af95-e17fc7b8963e tempest-SnapshotDependencyTests-1363145718 None] Deleted volume successfully. Nov 06 18:02:27 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d705de-35d3-4a5a-8105-c6dd1962badd]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:02:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-94754209-9953-4f89-8bc8-64219e672632 tempest-VolumeDependencyTests-197154585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a4b2d880-e99f-451c-8753-9782027926eb {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:27 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-70bd1239-d47c-4521-af95-e17fc7b8963e tempest-SnapshotDependencyTests-1363145718 None] Lock "cinder-66372b21-98dc-44b9-b715-93ed4844b103-delete_volume" released by "delete_volume" :: held 1.225s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:02:27 devstack sudo[104408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a4b2d880-e99f-451c-8753-9782027926eb Nov 06 18:02:27 devstack sudo[104408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:28 devstack sudo[104408]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-94754209-9953-4f89-8bc8-64219e672632 tempest-VolumeDependencyTests-197154585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a4b2d880-e99f-451c-8753-9782027926eb" returned: 0 in 0.385s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-94754209-9953-4f89-8bc8-64219e672632 tempest-VolumeDependencyTests-197154585 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a4b2d880-e99f-451c-8753-9782027926eb {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 18:02:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-94754209-9953-4f89-8bc8-64219e672632 tempest-VolumeDependencyTests-197154585 None] Creating direct copy from snapshot {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 18:02:28 devstack cinder-volume[87068]: DEBUG cinder.utils [None req-94754209-9953-4f89-8bc8-64219e672632 tempest-VolumeDependencyTests-197154585 None] Path /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8f92011c-5d60-4a26-a5fd-c28b4fc0dc93 not found in is_blk_device check {{(pid=87068) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 18:02:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-94754209-9953-4f89-8bc8-64219e672632 tempest-VolumeDependencyTests-197154585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a4b2d880-e99f-451c-8753-9782027926eb /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8f92011c-5d60-4a26-a5fd-c28b4fc0dc93 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:28 devstack sudo[104414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a4b2d880-e99f-451c-8753-9782027926eb /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8f92011c-5d60-4a26-a5fd-c28b4fc0dc93 Nov 06 18:02:28 devstack sudo[104414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:35 devstack sudo[104414]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-94754209-9953-4f89-8bc8-64219e672632 tempest-VolumeDependencyTests-197154585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a4b2d880-e99f-451c-8753-9782027926eb /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8f92011c-5d60-4a26-a5fd-c28b4fc0dc93" returned: 0 in 6.992s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:35 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-94754209-9953-4f89-8bc8-64219e672632 tempest-VolumeDependencyTests-197154585 None] Image conversion details: src /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a4b2d880-e99f-451c-8753-9782027926eb, size 1024.00 MB, duration 6.99 sec, destination /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8f92011c-5d60-4a26-a5fd-c28b4fc0dc93 {{(pid=87068) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 18:02:35 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-94754209-9953-4f89-8bc8-64219e672632 tempest-VolumeDependencyTests-197154585 None] Converted 1024.00 MB image at 146.42 MB/s Nov 06 18:02:35 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-94754209-9953-4f89-8bc8-64219e672632 tempest-VolumeDependencyTests-197154585 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8f92011c-5d60-4a26-a5fd-c28b4fc0dc93 is being set with open permissions: ugo+rw Nov 06 18:02:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-94754209-9953-4f89-8bc8-64219e672632 tempest-VolumeDependencyTests-197154585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8f92011c-5d60-4a26-a5fd-c28b4fc0dc93 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:35 devstack sudo[104430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8f92011c-5d60-4a26-a5fd-c28b4fc0dc93 Nov 06 18:02:35 devstack sudo[104430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:35 devstack sudo[104430]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-94754209-9953-4f89-8bc8-64219e672632 tempest-VolumeDependencyTests-197154585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8f92011c-5d60-4a26-a5fd-c28b4fc0dc93" returned: 0 in 0.268s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-94754209-9953-4f89-8bc8-64219e672632 tempest-VolumeDependencyTests-197154585 None] Lock "cinder-quobyte-8f92011c-5d60-4a26-a5fd-c28b4fc0dc93" released by "_copy_volume_from_snapshot" :: held 8.115s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:02:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-94754209-9953-4f89-8bc8-64219e672632 tempest-VolumeDependencyTests-197154585 None] Lock "cinder-quobyte-cec1b9a1-9c50-4b3b-bf8f-469d6f6c483a-8f92011c-5d60-4a26-a5fd-c28b4fc0dc93" released by "_create_volume_from_snapshot" :: held 8.199s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:02:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-94754209-9953-4f89-8bc8-64219e672632 tempest-VolumeDependencyTests-197154585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.216s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:02:35 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-94754209-9953-4f89-8bc8-64219e672632 tempest-VolumeDependencyTests-197154585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (627204de-9f0a-46ed-aeed-7c6459ac2232) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f92011c-5d60-4a26-a5fd-c28b4fc0dc93', 'volume_size': 1, 'snapshot_id': 'cec1b9a1-9c50-4b3b-bf8f-469d6f6c483a'}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:35 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-94754209-9953-4f89-8bc8-64219e672632 tempest-VolumeDependencyTests-197154585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d43ee0a5-f1de-47f5-ab2e-b5c19f65521d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:35 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-94754209-9953-4f89-8bc8-64219e672632 tempest-VolumeDependencyTests-197154585 None] Volume volume-8f92011c-5d60-4a26-a5fd-c28b4fc0dc93 (8f92011c-5d60-4a26-a5fd-c28b4fc0dc93): created successfully Nov 06 18:02:35 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-94754209-9953-4f89-8bc8-64219e672632 tempest-VolumeDependencyTests-197154585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d43ee0a5-f1de-47f5-ab2e-b5c19f65521d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:35 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-94754209-9953-4f89-8bc8-64219e672632 tempest-VolumeDependencyTests-197154585 None] Flow 'volume_create_manager' (14d3cc46-7507-4372-90d6-aac571872df5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:02:35 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-94754209-9953-4f89-8bc8-64219e672632 tempest-VolumeDependencyTests-197154585 None] Created volume successfully. Nov 06 18:02:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c1ddfc78-4fa2-4b8c-9c10-5a6e6a9164b9 tempest-VolumeDependencyTests-197154585 None] Acquiring lock "cinder-cec1b9a1-9c50-4b3b-bf8f-469d6f6c483a-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:02:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c1ddfc78-4fa2-4b8c-9c10-5a6e6a9164b9 tempest-VolumeDependencyTests-197154585 None] Lock "cinder-cec1b9a1-9c50-4b3b-bf8f-469d6f6c483a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:02:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c1ddfc78-4fa2-4b8c-9c10-5a6e6a9164b9 tempest-VolumeDependencyTests-197154585 None] Acquiring lock "cinder-quobyte-a4b2d880-e99f-451c-8753-9782027926eb" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:02:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c1ddfc78-4fa2-4b8c-9c10-5a6e6a9164b9 tempest-VolumeDependencyTests-197154585 None] Lock "cinder-quobyte-a4b2d880-e99f-451c-8753-9782027926eb" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:02:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c1ddfc78-4fa2-4b8c-9c10-5a6e6a9164b9 tempest-VolumeDependencyTests-197154585 None] Acquiring lock "cinder-quobyte-cec1b9a1-9c50-4b3b-bf8f-469d6f6c483a" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:02:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c1ddfc78-4fa2-4b8c-9c10-5a6e6a9164b9 tempest-VolumeDependencyTests-197154585 None] Lock "cinder-quobyte-cec1b9a1-9c50-4b3b-bf8f-469d6f6c483a" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:02:36 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-c1ddfc78-4fa2-4b8c-9c10-5a6e6a9164b9 tempest-VolumeDependencyTests-197154585 None] Deleting offline snapshot cec1b9a1-9c50-4b3b-bf8f-469d6f6c483a of volume a4b2d880-e99f-451c-8753-9782027926eb {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:02:36 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-c1ddfc78-4fa2-4b8c-9c10-5a6e6a9164b9 tempest-VolumeDependencyTests-197154585 None] snapshot_file for this snap is: volume-a4b2d880-e99f-451c-8753-9782027926eb.cec1b9a1-9c50-4b3b-bf8f-469d6f6c483a {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:02:36 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[04335e21-c048-4eb8-b09a-bb943428665b]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:02:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c1ddfc78-4fa2-4b8c-9c10-5a6e6a9164b9 tempest-VolumeDependencyTests-197154585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a4b2d880-e99f-451c-8753-9782027926eb.cec1b9a1-9c50-4b3b-bf8f-469d6f6c483a {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:36 devstack sudo[104433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a4b2d880-e99f-451c-8753-9782027926eb.cec1b9a1-9c50-4b3b-bf8f-469d6f6c483a Nov 06 18:02:36 devstack sudo[104433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:36 devstack sudo[104433]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c1ddfc78-4fa2-4b8c-9c10-5a6e6a9164b9 tempest-VolumeDependencyTests-197154585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a4b2d880-e99f-451c-8753-9782027926eb.cec1b9a1-9c50-4b3b-bf8f-469d6f6c483a" returned: 0 in 0.408s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:36 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-c1ddfc78-4fa2-4b8c-9c10-5a6e6a9164b9 tempest-VolumeDependencyTests-197154585 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4b2d880-e99f-451c-8753-9782027926eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:02:36 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef71b5f-523c-4ba6-9791-8671031c3750]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:02:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c1ddfc78-4fa2-4b8c-9c10-5a6e6a9164b9 tempest-VolumeDependencyTests-197154585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a4b2d880-e99f-451c-8753-9782027926eb {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:36 devstack sudo[104439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a4b2d880-e99f-451c-8753-9782027926eb Nov 06 18:02:36 devstack sudo[104439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:37 devstack sudo[104439]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c1ddfc78-4fa2-4b8c-9c10-5a6e6a9164b9 tempest-VolumeDependencyTests-197154585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a4b2d880-e99f-451c-8753-9782027926eb" returned: 0 in 0.539s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c1ddfc78-4fa2-4b8c-9c10-5a6e6a9164b9 tempest-VolumeDependencyTests-197154585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a4b2d880-e99f-451c-8753-9782027926eb.cec1b9a1-9c50-4b3b-bf8f-469d6f6c483a {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:37 devstack sudo[104444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a4b2d880-e99f-451c-8753-9782027926eb.cec1b9a1-9c50-4b3b-bf8f-469d6f6c483a Nov 06 18:02:37 devstack sudo[104444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:37 devstack sudo[104444]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c1ddfc78-4fa2-4b8c-9c10-5a6e6a9164b9 tempest-VolumeDependencyTests-197154585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a4b2d880-e99f-451c-8753-9782027926eb.cec1b9a1-9c50-4b3b-bf8f-469d6f6c483a" returned: 0 in 0.377s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c1ddfc78-4fa2-4b8c-9c10-5a6e6a9164b9 tempest-VolumeDependencyTests-197154585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a4b2d880-e99f-451c-8753-9782027926eb.cec1b9a1-9c50-4b3b-bf8f-469d6f6c483a {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:37 devstack sudo[104449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a4b2d880-e99f-451c-8753-9782027926eb.cec1b9a1-9c50-4b3b-bf8f-469d6f6c483a Nov 06 18:02:37 devstack sudo[104449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:37 devstack sudo[104449]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c1ddfc78-4fa2-4b8c-9c10-5a6e6a9164b9 tempest-VolumeDependencyTests-197154585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a4b2d880-e99f-451c-8753-9782027926eb.cec1b9a1-9c50-4b3b-bf8f-469d6f6c483a" returned: 0 in 0.252s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c1ddfc78-4fa2-4b8c-9c10-5a6e6a9164b9 tempest-VolumeDependencyTests-197154585 None] Lock "cinder-quobyte-cec1b9a1-9c50-4b3b-bf8f-469d6f6c483a" released by "_delete_snapshot" :: held 1.688s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:02:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c1ddfc78-4fa2-4b8c-9c10-5a6e6a9164b9 tempest-VolumeDependencyTests-197154585 None] Lock "cinder-quobyte-a4b2d880-e99f-451c-8753-9782027926eb" released by "delete_snapshot" :: held 1.719s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:02:37 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-c1ddfc78-4fa2-4b8c-9c10-5a6e6a9164b9 tempest-VolumeDependencyTests-197154585 None] Created reservations ['3544bc55-137d-4ac5-97d1-8cf0df9a517b', '73fe6b4f-bf4a-420b-8540-1d9265651e25', 'c784a7b2-1ff3-421d-bfa9-c31365858883', '0e4acc3e-91cb-497c-9a30-d47854f82acb'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:02:37 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-c1ddfc78-4fa2-4b8c-9c10-5a6e6a9164b9 tempest-VolumeDependencyTests-197154585 None] Delete snapshot completed successfully. Nov 06 18:02:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c1ddfc78-4fa2-4b8c-9c10-5a6e6a9164b9 tempest-VolumeDependencyTests-197154585 None] Lock "cinder-cec1b9a1-9c50-4b3b-bf8f-469d6f6c483a-delete_snapshot" released by "delete_snapshot" :: held 1.856s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:02:38 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d1661e53-274f-4669-a6b0-c2e876aabf64 tempest-VolumeDependencyTests-197154585 None] Acquiring lock "cinder-a4b2d880-e99f-451c-8753-9782027926eb-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:02:38 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d1661e53-274f-4669-a6b0-c2e876aabf64 tempest-VolumeDependencyTests-197154585 None] Lock "cinder-a4b2d880-e99f-451c-8753-9782027926eb-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:02:38 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d1661e53-274f-4669-a6b0-c2e876aabf64 tempest-VolumeDependencyTests-197154585 None] Acquiring lock "cinder-quobyte-a4b2d880-e99f-451c-8753-9782027926eb" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:02:38 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d1661e53-274f-4669-a6b0-c2e876aabf64 tempest-VolumeDependencyTests-197154585 None] Lock "cinder-quobyte-a4b2d880-e99f-451c-8753-9782027926eb" acquired by "delete_volume" :: waited 0.017s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:02:38 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4efe5657-b7d3-4702-ac1c-f4eb384f55c2]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:02:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d1661e53-274f-4669-a6b0-c2e876aabf64 tempest-VolumeDependencyTests-197154585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a4b2d880-e99f-451c-8753-9782027926eb {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:38 devstack sudo[104452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a4b2d880-e99f-451c-8753-9782027926eb Nov 06 18:02:38 devstack sudo[104452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:38 devstack sudo[104452]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d1661e53-274f-4669-a6b0-c2e876aabf64 tempest-VolumeDependencyTests-197154585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a4b2d880-e99f-451c-8753-9782027926eb" returned: 0 in 0.430s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d1661e53-274f-4669-a6b0-c2e876aabf64 tempest-VolumeDependencyTests-197154585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a4b2d880-e99f-451c-8753-9782027926eb {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:38 devstack sudo[104457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a4b2d880-e99f-451c-8753-9782027926eb Nov 06 18:02:38 devstack sudo[104457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:39 devstack sudo[104457]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d1661e53-274f-4669-a6b0-c2e876aabf64 tempest-VolumeDependencyTests-197154585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a4b2d880-e99f-451c-8753-9782027926eb" returned: 0 in 0.256s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:39 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d1661e53-274f-4669-a6b0-c2e876aabf64 tempest-VolumeDependencyTests-197154585 None] Lock "cinder-quobyte-a4b2d880-e99f-451c-8753-9782027926eb" released by "delete_volume" :: held 0.762s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:02:39 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-d1661e53-274f-4669-a6b0-c2e876aabf64 tempest-VolumeDependencyTests-197154585 None] Created reservations ['dd46b056-107b-4ac3-8dbc-2d0159ba7fea', '68b06008-0acc-4a4a-a4ac-f4fb7dd3e96a', 'f395f001-fd87-4334-ac98-bf5b7e4db12d', 'd2a89be0-de9c-4b99-8222-39bfea8d523e'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:02:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d1661e53-274f-4669-a6b0-c2e876aabf64 tempest-VolumeDependencyTests-197154585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:02:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d1661e53-274f-4669-a6b0-c2e876aabf64 tempest-VolumeDependencyTests-197154585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:02:39 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d1661e53-274f-4669-a6b0-c2e876aabf64 tempest-VolumeDependencyTests-197154585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:02:39 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d1661e53-274f-4669-a6b0-c2e876aabf64 tempest-VolumeDependencyTests-197154585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:02:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d1661e53-274f-4669-a6b0-c2e876aabf64 tempest-VolumeDependencyTests-197154585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:02:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d1661e53-274f-4669-a6b0-c2e876aabf64 tempest-VolumeDependencyTests-197154585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:39 devstack sudo[104461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:02:39 devstack sudo[104461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:39 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c6610275-4631-4af6-8b67-766953940388 tempest-VolumeDependencyTests-197154585 None] Acquiring lock "cinder-8f92011c-5d60-4a26-a5fd-c28b4fc0dc93-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:02:39 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c6610275-4631-4af6-8b67-766953940388 tempest-VolumeDependencyTests-197154585 None] Lock "cinder-8f92011c-5d60-4a26-a5fd-c28b4fc0dc93-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:02:39 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c6610275-4631-4af6-8b67-766953940388 tempest-VolumeDependencyTests-197154585 None] Acquiring lock "cinder-quobyte-8f92011c-5d60-4a26-a5fd-c28b4fc0dc93" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:02:39 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c6610275-4631-4af6-8b67-766953940388 tempest-VolumeDependencyTests-197154585 None] Lock "cinder-quobyte-8f92011c-5d60-4a26-a5fd-c28b4fc0dc93" acquired by "delete_volume" :: waited 0.021s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:02:39 devstack sudo[104461]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d1661e53-274f-4669-a6b0-c2e876aabf64 tempest-VolumeDependencyTests-197154585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.360s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:39 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-d1661e53-274f-4669-a6b0-c2e876aabf64 tempest-VolumeDependencyTests-197154585 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:02:39 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-d1661e53-274f-4669-a6b0-c2e876aabf64 tempest-VolumeDependencyTests-197154585 None] Deleted volume successfully. Nov 06 18:02:39 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4264317b-082c-4b8a-863f-55efdbbfa79c]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:02:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c6610275-4631-4af6-8b67-766953940388 tempest-VolumeDependencyTests-197154585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8f92011c-5d60-4a26-a5fd-c28b4fc0dc93 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:39 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d1661e53-274f-4669-a6b0-c2e876aabf64 tempest-VolumeDependencyTests-197154585 None] Lock "cinder-a4b2d880-e99f-451c-8753-9782027926eb-delete_volume" released by "delete_volume" :: held 1.380s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:02:39 devstack sudo[104464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8f92011c-5d60-4a26-a5fd-c28b4fc0dc93 Nov 06 18:02:39 devstack sudo[104464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:40 devstack sudo[104464]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c6610275-4631-4af6-8b67-766953940388 tempest-VolumeDependencyTests-197154585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8f92011c-5d60-4a26-a5fd-c28b4fc0dc93" returned: 0 in 0.407s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c6610275-4631-4af6-8b67-766953940388 tempest-VolumeDependencyTests-197154585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8f92011c-5d60-4a26-a5fd-c28b4fc0dc93 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:40 devstack sudo[104469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8f92011c-5d60-4a26-a5fd-c28b4fc0dc93 Nov 06 18:02:40 devstack sudo[104469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:40 devstack sudo[104469]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c6610275-4631-4af6-8b67-766953940388 tempest-VolumeDependencyTests-197154585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8f92011c-5d60-4a26-a5fd-c28b4fc0dc93" returned: 0 in 0.282s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c6610275-4631-4af6-8b67-766953940388 tempest-VolumeDependencyTests-197154585 None] Lock "cinder-quobyte-8f92011c-5d60-4a26-a5fd-c28b4fc0dc93" released by "delete_volume" :: held 0.758s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:02:40 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-c6610275-4631-4af6-8b67-766953940388 tempest-VolumeDependencyTests-197154585 None] Created reservations ['2b111f3c-62c1-4c7f-b602-0f423a43a388', 'b3d398a1-b410-4715-afd1-5df75199204f', '1ddc3449-1015-473b-92cf-17da81c4befa', '65c7688d-28dc-45c0-892c-7a3257c15fce'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:02:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c6610275-4631-4af6-8b67-766953940388 tempest-VolumeDependencyTests-197154585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:02:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c6610275-4631-4af6-8b67-766953940388 tempest-VolumeDependencyTests-197154585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:02:40 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c6610275-4631-4af6-8b67-766953940388 tempest-VolumeDependencyTests-197154585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:02:40 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c6610275-4631-4af6-8b67-766953940388 tempest-VolumeDependencyTests-197154585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:02:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c6610275-4631-4af6-8b67-766953940388 tempest-VolumeDependencyTests-197154585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:02:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c6610275-4631-4af6-8b67-766953940388 tempest-VolumeDependencyTests-197154585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:40 devstack sudo[104472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:02:40 devstack sudo[104472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:40 devstack sudo[104472]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c6610275-4631-4af6-8b67-766953940388 tempest-VolumeDependencyTests-197154585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.279s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:40 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-c6610275-4631-4af6-8b67-766953940388 tempest-VolumeDependencyTests-197154585 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:02:40 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-c6610275-4631-4af6-8b67-766953940388 tempest-VolumeDependencyTests-197154585 None] Deleted volume successfully. Nov 06 18:02:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c6610275-4631-4af6-8b67-766953940388 tempest-VolumeDependencyTests-197154585 None] Lock "cinder-8f92011c-5d60-4a26-a5fd-c28b4fc0dc93-delete_volume" released by "delete_volume" :: held 1.280s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:02:46 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-8da6abc2-be75-4d37-ac8e-8f5280757b97 tempest-CinderUnicodeTest-1671550791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:02:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8da6abc2-be75-4d37-ac8e-8f5280757b97 tempest-CinderUnicodeTest-1671550791 None] Flow 'volume_create_manager' (6b61e71d-a01e-48b9-9fa5-0031179143cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:02:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8da6abc2-be75-4d37-ac8e-8f5280757b97 tempest-CinderUnicodeTest-1671550791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df913f47-5262-41b2-bdcf-86eef6b32947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8da6abc2-be75-4d37-ac8e-8f5280757b97 tempest-CinderUnicodeTest-1671550791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df913f47-5262-41b2-bdcf-86eef6b32947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff99591e-5cc1-4c4d-9c39-11998a9f6e25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bf9b247442f4f15952ed5ae423d75b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:02:46Z,use_quota=True,user_id='bec229660d2c46d195315288cc1031ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8da6abc2-be75-4d37-ac8e-8f5280757b97 tempest-CinderUnicodeTest-1671550791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbe15784-ca30-40bb-8cef-281e7d0e3b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8da6abc2-be75-4d37-ac8e-8f5280757b97 tempest-CinderUnicodeTest-1671550791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbe15784-ca30-40bb-8cef-281e7d0e3b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8da6abc2-be75-4d37-ac8e-8f5280757b97 tempest-CinderUnicodeTest-1671550791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b00da0f5-0e0b-4f10-9011-842b92f01594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8da6abc2-be75-4d37-ac8e-8f5280757b97 tempest-CinderUnicodeTest-1671550791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b00da0f5-0e0b-4f10-9011-842b92f01594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff99591e-5cc1-4c4d-9c39-11998a9f6e25', 'volume_name': 'volume-ff99591e-5cc1-4c4d-9c39-11998a9f6e25', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8da6abc2-be75-4d37-ac8e-8f5280757b97 tempest-CinderUnicodeTest-1671550791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ebf9b5e-2520-4227-a4d9-8b07c5927a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8da6abc2-be75-4d37-ac8e-8f5280757b97 tempest-CinderUnicodeTest-1671550791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ebf9b5e-2520-4227-a4d9-8b07c5927a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8da6abc2-be75-4d37-ac8e-8f5280757b97 tempest-CinderUnicodeTest-1671550791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2b320f0-006e-40d5-a4d5-236712341805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:46 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-8da6abc2-be75-4d37-ac8e-8f5280757b97 tempest-CinderUnicodeTest-1671550791 None] Volume ff99591e-5cc1-4c4d-9c39-11998a9f6e25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff99591e-5cc1-4c4d-9c39-11998a9f6e25', 'volume_size': 1} Nov 06 18:02:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8da6abc2-be75-4d37-ac8e-8f5280757b97 tempest-CinderUnicodeTest-1671550791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:02:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8da6abc2-be75-4d37-ac8e-8f5280757b97 tempest-CinderUnicodeTest-1671550791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:02:46 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8da6abc2-be75-4d37-ac8e-8f5280757b97 tempest-CinderUnicodeTest-1671550791 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff99591e-5cc1-4c4d-9c39-11998a9f6e25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bf9b247442f4f15952ed5ae423d75b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:02:46Z,use_quota=True,user_id='bec229660d2c46d195315288cc1031ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:02:46 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-8da6abc2-be75-4d37-ac8e-8f5280757b97 tempest-CinderUnicodeTest-1671550791 None] Creating volume ff99591e-5cc1-4c4d-9c39-11998a9f6e25 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:02:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8da6abc2-be75-4d37-ac8e-8f5280757b97 tempest-CinderUnicodeTest-1671550791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:02:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8da6abc2-be75-4d37-ac8e-8f5280757b97 tempest-CinderUnicodeTest-1671550791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:02:46 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8da6abc2-be75-4d37-ac8e-8f5280757b97 tempest-CinderUnicodeTest-1671550791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:02:46 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8da6abc2-be75-4d37-ac8e-8f5280757b97 tempest-CinderUnicodeTest-1671550791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:02:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8da6abc2-be75-4d37-ac8e-8f5280757b97 tempest-CinderUnicodeTest-1671550791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:02:46 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8da6abc2-be75-4d37-ac8e-8f5280757b97 tempest-CinderUnicodeTest-1671550791 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:02:46 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-8da6abc2-be75-4d37-ac8e-8f5280757b97 tempest-CinderUnicodeTest-1671550791 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:02:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8da6abc2-be75-4d37-ac8e-8f5280757b97 tempest-CinderUnicodeTest-1671550791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ff99591e-5cc1-4c4d-9c39-11998a9f6e25 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:46 devstack sudo[104476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ff99591e-5cc1-4c4d-9c39-11998a9f6e25 1073741824 Nov 06 18:02:46 devstack sudo[104476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:46 devstack sudo[104476]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8da6abc2-be75-4d37-ac8e-8f5280757b97 tempest-CinderUnicodeTest-1671550791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ff99591e-5cc1-4c4d-9c39-11998a9f6e25 1073741824" returned: 0 in 0.427s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8da6abc2-be75-4d37-ac8e-8f5280757b97 tempest-CinderUnicodeTest-1671550791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ff99591e-5cc1-4c4d-9c39-11998a9f6e25 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:46 devstack sudo[104481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ff99591e-5cc1-4c4d-9c39-11998a9f6e25 Nov 06 18:02:46 devstack sudo[104481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:47 devstack sudo[104481]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8da6abc2-be75-4d37-ac8e-8f5280757b97 tempest-CinderUnicodeTest-1671550791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ff99591e-5cc1-4c4d-9c39-11998a9f6e25" returned: 0 in 0.249s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8da6abc2-be75-4d37-ac8e-8f5280757b97 tempest-CinderUnicodeTest-1671550791 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:02:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8da6abc2-be75-4d37-ac8e-8f5280757b97 tempest-CinderUnicodeTest-1671550791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:02:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8da6abc2-be75-4d37-ac8e-8f5280757b97 tempest-CinderUnicodeTest-1671550791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2b320f0-006e-40d5-a4d5-236712341805) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff99591e-5cc1-4c4d-9c39-11998a9f6e25', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8da6abc2-be75-4d37-ac8e-8f5280757b97 tempest-CinderUnicodeTest-1671550791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (333e7d9f-b3f0-4b7a-8d18-b17d0972e35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:47 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-8da6abc2-be75-4d37-ac8e-8f5280757b97 tempest-CinderUnicodeTest-1671550791 None] Volume volume-ff99591e-5cc1-4c4d-9c39-11998a9f6e25 (ff99591e-5cc1-4c4d-9c39-11998a9f6e25): created successfully Nov 06 18:02:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8da6abc2-be75-4d37-ac8e-8f5280757b97 tempest-CinderUnicodeTest-1671550791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (333e7d9f-b3f0-4b7a-8d18-b17d0972e35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8da6abc2-be75-4d37-ac8e-8f5280757b97 tempest-CinderUnicodeTest-1671550791 None] Flow 'volume_create_manager' (6b61e71d-a01e-48b9-9fa5-0031179143cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:02:47 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-8da6abc2-be75-4d37-ac8e-8f5280757b97 tempest-CinderUnicodeTest-1671550791 None] Created volume successfully. Nov 06 18:02:47 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c73e647-35c9-412f-bc00-5a0b204a593d tempest-CinderUnicodeTest-1671550791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:02:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9c73e647-35c9-412f-bc00-5a0b204a593d tempest-CinderUnicodeTest-1671550791 None] Flow 'volume_create_manager' (48268143-abbc-42fc-aa05-316db5c94eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:02:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9c73e647-35c9-412f-bc00-5a0b204a593d tempest-CinderUnicodeTest-1671550791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4ba2bd4-f6dd-4c1a-bca2-1a67025f2da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9c73e647-35c9-412f-bc00-5a0b204a593d tempest-CinderUnicodeTest-1671550791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4ba2bd4-f6dd-4c1a-bca2-1a67025f2da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:02:48Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1133391754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40865693-5575-4677-abf4-c8d36b01bb61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bf9b247442f4f15952ed5ae423d75b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:02:48Z,use_quota=True,user_id='bec229660d2c46d195315288cc1031ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9c73e647-35c9-412f-bc00-5a0b204a593d tempest-CinderUnicodeTest-1671550791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce7f5a97-5887-4cd5-ab44-5300083ffe25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9c73e647-35c9-412f-bc00-5a0b204a593d tempest-CinderUnicodeTest-1671550791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce7f5a97-5887-4cd5-ab44-5300083ffe25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9c73e647-35c9-412f-bc00-5a0b204a593d tempest-CinderUnicodeTest-1671550791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee3f69b4-af19-4f20-9891-73b03d5c28b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9c73e647-35c9-412f-bc00-5a0b204a593d tempest-CinderUnicodeTest-1671550791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee3f69b4-af19-4f20-9891-73b03d5c28b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40865693-5575-4677-abf4-c8d36b01bb61', 'volume_name': 'volume-40865693-5575-4677-abf4-c8d36b01bb61', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9c73e647-35c9-412f-bc00-5a0b204a593d tempest-CinderUnicodeTest-1671550791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa127d8a-bbf0-484c-9cb4-0de9b5511deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9c73e647-35c9-412f-bc00-5a0b204a593d tempest-CinderUnicodeTest-1671550791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa127d8a-bbf0-484c-9cb4-0de9b5511deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9c73e647-35c9-412f-bc00-5a0b204a593d tempest-CinderUnicodeTest-1671550791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afcc547b-0775-4a3e-9df6-8e57418efcbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:47 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-9c73e647-35c9-412f-bc00-5a0b204a593d tempest-CinderUnicodeTest-1671550791 None] Volume 40865693-5575-4677-abf4-c8d36b01bb61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40865693-5575-4677-abf4-c8d36b01bb61', 'volume_size': 1} Nov 06 18:02:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9c73e647-35c9-412f-bc00-5a0b204a593d tempest-CinderUnicodeTest-1671550791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:02:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9c73e647-35c9-412f-bc00-5a0b204a593d tempest-CinderUnicodeTest-1671550791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:02:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9c73e647-35c9-412f-bc00-5a0b204a593d tempest-CinderUnicodeTest-1671550791 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:02:48Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1133391754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40865693-5575-4677-abf4-c8d36b01bb61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bf9b247442f4f15952ed5ae423d75b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:02:48Z,use_quota=True,user_id='bec229660d2c46d195315288cc1031ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:02:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-9c73e647-35c9-412f-bc00-5a0b204a593d tempest-CinderUnicodeTest-1671550791 None] Creating volume 40865693-5575-4677-abf4-c8d36b01bb61 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:02:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9c73e647-35c9-412f-bc00-5a0b204a593d tempest-CinderUnicodeTest-1671550791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:02:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9c73e647-35c9-412f-bc00-5a0b204a593d tempest-CinderUnicodeTest-1671550791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:02:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9c73e647-35c9-412f-bc00-5a0b204a593d tempest-CinderUnicodeTest-1671550791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:02:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9c73e647-35c9-412f-bc00-5a0b204a593d tempest-CinderUnicodeTest-1671550791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:02:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9c73e647-35c9-412f-bc00-5a0b204a593d tempest-CinderUnicodeTest-1671550791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:02:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9c73e647-35c9-412f-bc00-5a0b204a593d tempest-CinderUnicodeTest-1671550791 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:02:47 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-9c73e647-35c9-412f-bc00-5a0b204a593d tempest-CinderUnicodeTest-1671550791 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:02:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9c73e647-35c9-412f-bc00-5a0b204a593d tempest-CinderUnicodeTest-1671550791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-40865693-5575-4677-abf4-c8d36b01bb61 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:48 devstack sudo[104484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-40865693-5575-4677-abf4-c8d36b01bb61 1073741824 Nov 06 18:02:48 devstack sudo[104484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:48 devstack sudo[104484]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9c73e647-35c9-412f-bc00-5a0b204a593d tempest-CinderUnicodeTest-1671550791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-40865693-5575-4677-abf4-c8d36b01bb61 1073741824" returned: 0 in 0.423s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9c73e647-35c9-412f-bc00-5a0b204a593d tempest-CinderUnicodeTest-1671550791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-40865693-5575-4677-abf4-c8d36b01bb61 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:48 devstack sudo[104490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-40865693-5575-4677-abf4-c8d36b01bb61 Nov 06 18:02:48 devstack sudo[104490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:48 devstack sudo[104490]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9c73e647-35c9-412f-bc00-5a0b204a593d tempest-CinderUnicodeTest-1671550791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-40865693-5575-4677-abf4-c8d36b01bb61" returned: 0 in 0.266s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:48 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9c73e647-35c9-412f-bc00-5a0b204a593d tempest-CinderUnicodeTest-1671550791 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:02:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9c73e647-35c9-412f-bc00-5a0b204a593d tempest-CinderUnicodeTest-1671550791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:02:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9c73e647-35c9-412f-bc00-5a0b204a593d tempest-CinderUnicodeTest-1671550791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afcc547b-0775-4a3e-9df6-8e57418efcbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40865693-5575-4677-abf4-c8d36b01bb61', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9c73e647-35c9-412f-bc00-5a0b204a593d tempest-CinderUnicodeTest-1671550791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c81354be-baef-4d7f-8ca1-7b77dc94d2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:02:48 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-9c73e647-35c9-412f-bc00-5a0b204a593d tempest-CinderUnicodeTest-1671550791 None] Volume volume-40865693-5575-4677-abf4-c8d36b01bb61 (40865693-5575-4677-abf4-c8d36b01bb61): created successfully Nov 06 18:02:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9c73e647-35c9-412f-bc00-5a0b204a593d tempest-CinderUnicodeTest-1671550791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c81354be-baef-4d7f-8ca1-7b77dc94d2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:02:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9c73e647-35c9-412f-bc00-5a0b204a593d tempest-CinderUnicodeTest-1671550791 None] Flow 'volume_create_manager' (48268143-abbc-42fc-aa05-316db5c94eac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:02:48 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-9c73e647-35c9-412f-bc00-5a0b204a593d tempest-CinderUnicodeTest-1671550791 None] Created volume successfully. Nov 06 18:02:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8a05453a-7f1d-4f99-bd80-a3e1daf17753 tempest-CinderUnicodeTest-1671550791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:02:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8a05453a-7f1d-4f99-bd80-a3e1daf17753 tempest-CinderUnicodeTest-1671550791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:02:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-8a05453a-7f1d-4f99-bd80-a3e1daf17753 tempest-CinderUnicodeTest-1671550791 None] Creating offline snapshot 8451c773-be73-4583-9a1a-63b5c513d9aa of volume 40865693-5575-4677-abf4-c8d36b01bb61 {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:02:49 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[02813ae1-39f9-4c5e-b2ea-c61806a9d2d0]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:02:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8a05453a-7f1d-4f99-bd80-a3e1daf17753 tempest-CinderUnicodeTest-1671550791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-40865693-5575-4677-abf4-c8d36b01bb61 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:49 devstack sudo[104493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-40865693-5575-4677-abf4-c8d36b01bb61 Nov 06 18:02:49 devstack sudo[104493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:49 devstack sudo[104493]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8a05453a-7f1d-4f99-bd80-a3e1daf17753 tempest-CinderUnicodeTest-1671550791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-40865693-5575-4677-abf4-c8d36b01bb61" returned: 0 in 0.380s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8a05453a-7f1d-4f99-bd80-a3e1daf17753 tempest-CinderUnicodeTest-1671550791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-40865693-5575-4677-abf4-c8d36b01bb61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-40865693-5575-4677-abf4-c8d36b01bb61.8451c773-be73-4583-9a1a-63b5c513d9aa 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:49 devstack sudo[104498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-40865693-5575-4677-abf4-c8d36b01bb61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-40865693-5575-4677-abf4-c8d36b01bb61.8451c773-be73-4583-9a1a-63b5c513d9aa 1G Nov 06 18:02:49 devstack sudo[104498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:49 devstack sudo[104498]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8a05453a-7f1d-4f99-bd80-a3e1daf17753 tempest-CinderUnicodeTest-1671550791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-40865693-5575-4677-abf4-c8d36b01bb61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-40865693-5575-4677-abf4-c8d36b01bb61.8451c773-be73-4583-9a1a-63b5c513d9aa 1G" returned: 0 in 0.431s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8a05453a-7f1d-4f99-bd80-a3e1daf17753 tempest-CinderUnicodeTest-1671550791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40865693-5575-4677-abf4-c8d36b01bb61 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-40865693-5575-4677-abf4-c8d36b01bb61.8451c773-be73-4583-9a1a-63b5c513d9aa {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:50 devstack sudo[104505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40865693-5575-4677-abf4-c8d36b01bb61 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-40865693-5575-4677-abf4-c8d36b01bb61.8451c773-be73-4583-9a1a-63b5c513d9aa Nov 06 18:02:50 devstack sudo[104505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:50 devstack sudo[104505]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8a05453a-7f1d-4f99-bd80-a3e1daf17753 tempest-CinderUnicodeTest-1671550791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40865693-5575-4677-abf4-c8d36b01bb61 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-40865693-5575-4677-abf4-c8d36b01bb61.8451c773-be73-4583-9a1a-63b5c513d9aa" returned: 0 in 0.303s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:50 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-8a05453a-7f1d-4f99-bd80-a3e1daf17753 tempest-CinderUnicodeTest-1671550791 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-40865693-5575-4677-abf4-c8d36b01bb61.8451c773-be73-4583-9a1a-63b5c513d9aa is being set with open permissions: ugo+rw Nov 06 18:02:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8a05453a-7f1d-4f99-bd80-a3e1daf17753 tempest-CinderUnicodeTest-1671550791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-40865693-5575-4677-abf4-c8d36b01bb61.8451c773-be73-4583-9a1a-63b5c513d9aa {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:50 devstack sudo[104510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-40865693-5575-4677-abf4-c8d36b01bb61.8451c773-be73-4583-9a1a-63b5c513d9aa Nov 06 18:02:50 devstack sudo[104510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:50 devstack sudo[104510]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8a05453a-7f1d-4f99-bd80-a3e1daf17753 tempest-CinderUnicodeTest-1671550791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-40865693-5575-4677-abf4-c8d36b01bb61.8451c773-be73-4583-9a1a-63b5c513d9aa" returned: 0 in 0.258s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8a05453a-7f1d-4f99-bd80-a3e1daf17753 tempest-CinderUnicodeTest-1671550791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-40865693-5575-4677-abf4-c8d36b01bb61.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:50 devstack sudo[104513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-40865693-5575-4677-abf4-c8d36b01bb61.info Nov 06 18:02:50 devstack sudo[104513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:50 devstack sudo[104513]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8a05453a-7f1d-4f99-bd80-a3e1daf17753 tempest-CinderUnicodeTest-1671550791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-40865693-5575-4677-abf4-c8d36b01bb61.info" returned: 0 in 0.263s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:50 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-8a05453a-7f1d-4f99-bd80-a3e1daf17753 tempest-CinderUnicodeTest-1671550791 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-40865693-5575-4677-abf4-c8d36b01bb61.info is being set with open permissions: ugo+rw Nov 06 18:02:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8a05453a-7f1d-4f99-bd80-a3e1daf17753 tempest-CinderUnicodeTest-1671550791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-40865693-5575-4677-abf4-c8d36b01bb61.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:50 devstack sudo[104518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-40865693-5575-4677-abf4-c8d36b01bb61.info Nov 06 18:02:50 devstack sudo[104518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:51 devstack sudo[104518]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8a05453a-7f1d-4f99-bd80-a3e1daf17753 tempest-CinderUnicodeTest-1671550791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-40865693-5575-4677-abf4-c8d36b01bb61.info" returned: 0 in 0.250s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8a05453a-7f1d-4f99-bd80-a3e1daf17753 tempest-CinderUnicodeTest-1671550791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.983s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:02:51 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-8a05453a-7f1d-4f99-bd80-a3e1daf17753 tempest-CinderUnicodeTest-1671550791 None] Create snapshot completed successfully Nov 06 18:02:51 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1c1261bf-8497-43d8-b730-9d4790f93d50 tempest-CinderUnicodeTest-1671550791 None] Acquiring lock "cinder-8451c773-be73-4583-9a1a-63b5c513d9aa-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:02:51 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1c1261bf-8497-43d8-b730-9d4790f93d50 tempest-CinderUnicodeTest-1671550791 None] Lock "cinder-8451c773-be73-4583-9a1a-63b5c513d9aa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:02:51 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1c1261bf-8497-43d8-b730-9d4790f93d50 tempest-CinderUnicodeTest-1671550791 None] Acquiring lock "cinder-quobyte-40865693-5575-4677-abf4-c8d36b01bb61" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:02:51 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1c1261bf-8497-43d8-b730-9d4790f93d50 tempest-CinderUnicodeTest-1671550791 None] Lock "cinder-quobyte-40865693-5575-4677-abf4-c8d36b01bb61" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:02:51 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1c1261bf-8497-43d8-b730-9d4790f93d50 tempest-CinderUnicodeTest-1671550791 None] Acquiring lock "cinder-quobyte-8451c773-be73-4583-9a1a-63b5c513d9aa" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:02:51 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1c1261bf-8497-43d8-b730-9d4790f93d50 tempest-CinderUnicodeTest-1671550791 None] Lock "cinder-quobyte-8451c773-be73-4583-9a1a-63b5c513d9aa" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:02:51 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-1c1261bf-8497-43d8-b730-9d4790f93d50 tempest-CinderUnicodeTest-1671550791 None] Deleting offline snapshot 8451c773-be73-4583-9a1a-63b5c513d9aa of volume 40865693-5575-4677-abf4-c8d36b01bb61 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:02:51 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-1c1261bf-8497-43d8-b730-9d4790f93d50 tempest-CinderUnicodeTest-1671550791 None] snapshot_file for this snap is: volume-40865693-5575-4677-abf4-c8d36b01bb61.8451c773-be73-4583-9a1a-63b5c513d9aa {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:02:51 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[752aade4-839a-457f-af57-05e95988a66d]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:02:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1c1261bf-8497-43d8-b730-9d4790f93d50 tempest-CinderUnicodeTest-1671550791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-40865693-5575-4677-abf4-c8d36b01bb61.8451c773-be73-4583-9a1a-63b5c513d9aa {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:51 devstack sudo[104522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-40865693-5575-4677-abf4-c8d36b01bb61.8451c773-be73-4583-9a1a-63b5c513d9aa Nov 06 18:02:51 devstack sudo[104522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:51 devstack sudo[104522]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1c1261bf-8497-43d8-b730-9d4790f93d50 tempest-CinderUnicodeTest-1671550791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-40865693-5575-4677-abf4-c8d36b01bb61.8451c773-be73-4583-9a1a-63b5c513d9aa" returned: 0 in 0.365s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:51 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-1c1261bf-8497-43d8-b730-9d4790f93d50 tempest-CinderUnicodeTest-1671550791 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40865693-5575-4677-abf4-c8d36b01bb61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:02:51 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a324ba7-d38d-4195-9c5b-bf97313112a9]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:02:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1c1261bf-8497-43d8-b730-9d4790f93d50 tempest-CinderUnicodeTest-1671550791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-40865693-5575-4677-abf4-c8d36b01bb61 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:51 devstack sudo[104528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-40865693-5575-4677-abf4-c8d36b01bb61 Nov 06 18:02:51 devstack sudo[104528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:52 devstack sudo[104528]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1c1261bf-8497-43d8-b730-9d4790f93d50 tempest-CinderUnicodeTest-1671550791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-40865693-5575-4677-abf4-c8d36b01bb61" returned: 0 in 0.382s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1c1261bf-8497-43d8-b730-9d4790f93d50 tempest-CinderUnicodeTest-1671550791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-40865693-5575-4677-abf4-c8d36b01bb61.8451c773-be73-4583-9a1a-63b5c513d9aa {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:52 devstack sudo[104533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-40865693-5575-4677-abf4-c8d36b01bb61.8451c773-be73-4583-9a1a-63b5c513d9aa Nov 06 18:02:52 devstack sudo[104533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:52 devstack sudo[104533]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1c1261bf-8497-43d8-b730-9d4790f93d50 tempest-CinderUnicodeTest-1671550791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-40865693-5575-4677-abf4-c8d36b01bb61.8451c773-be73-4583-9a1a-63b5c513d9aa" returned: 0 in 0.374s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1c1261bf-8497-43d8-b730-9d4790f93d50 tempest-CinderUnicodeTest-1671550791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-40865693-5575-4677-abf4-c8d36b01bb61.8451c773-be73-4583-9a1a-63b5c513d9aa {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:52 devstack sudo[104538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-40865693-5575-4677-abf4-c8d36b01bb61.8451c773-be73-4583-9a1a-63b5c513d9aa Nov 06 18:02:52 devstack sudo[104538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:52 devstack sudo[104538]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1c1261bf-8497-43d8-b730-9d4790f93d50 tempest-CinderUnicodeTest-1671550791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-40865693-5575-4677-abf4-c8d36b01bb61.8451c773-be73-4583-9a1a-63b5c513d9aa" returned: 0 in 0.264s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:52 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1c1261bf-8497-43d8-b730-9d4790f93d50 tempest-CinderUnicodeTest-1671550791 None] Lock "cinder-quobyte-8451c773-be73-4583-9a1a-63b5c513d9aa" released by "_delete_snapshot" :: held 1.505s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:02:52 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1c1261bf-8497-43d8-b730-9d4790f93d50 tempest-CinderUnicodeTest-1671550791 None] Lock "cinder-quobyte-40865693-5575-4677-abf4-c8d36b01bb61" released by "delete_snapshot" :: held 1.529s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:02:52 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-1c1261bf-8497-43d8-b730-9d4790f93d50 tempest-CinderUnicodeTest-1671550791 None] Created reservations ['143619b1-3a20-476b-87ca-1c4a37b38802', '3942b392-cb2c-4860-bd19-3ff044dd7804', 'c9aa4671-7ec9-49bc-9034-528a2de3dfaf', 'b0acea98-5d68-49fa-91ca-a3ff0b9d9c31'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:02:52 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-1c1261bf-8497-43d8-b730-9d4790f93d50 tempest-CinderUnicodeTest-1671550791 None] Delete snapshot completed successfully. Nov 06 18:02:52 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1c1261bf-8497-43d8-b730-9d4790f93d50 tempest-CinderUnicodeTest-1671550791 None] Lock "cinder-8451c773-be73-4583-9a1a-63b5c513d9aa-delete_snapshot" released by "delete_snapshot" :: held 1.672s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:02:53 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ceb459cf-8dbb-4de4-8945-f50d441eee47 tempest-CinderUnicodeTest-1671550791 None] Acquiring lock "cinder-40865693-5575-4677-abf4-c8d36b01bb61-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:02:53 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ceb459cf-8dbb-4de4-8945-f50d441eee47 tempest-CinderUnicodeTest-1671550791 None] Lock "cinder-40865693-5575-4677-abf4-c8d36b01bb61-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:02:53 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ceb459cf-8dbb-4de4-8945-f50d441eee47 tempest-CinderUnicodeTest-1671550791 None] Acquiring lock "cinder-quobyte-40865693-5575-4677-abf4-c8d36b01bb61" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:02:53 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ceb459cf-8dbb-4de4-8945-f50d441eee47 tempest-CinderUnicodeTest-1671550791 None] Lock "cinder-quobyte-40865693-5575-4677-abf4-c8d36b01bb61" acquired by "delete_volume" :: waited 0.017s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:02:53 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2877aa02-3ed0-428c-9b36-a0de069f6f67]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:02:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ceb459cf-8dbb-4de4-8945-f50d441eee47 tempest-CinderUnicodeTest-1671550791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-40865693-5575-4677-abf4-c8d36b01bb61 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:53 devstack sudo[104547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-40865693-5575-4677-abf4-c8d36b01bb61 Nov 06 18:02:53 devstack sudo[104547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:53 devstack sudo[104547]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ceb459cf-8dbb-4de4-8945-f50d441eee47 tempest-CinderUnicodeTest-1671550791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-40865693-5575-4677-abf4-c8d36b01bb61" returned: 0 in 0.406s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ceb459cf-8dbb-4de4-8945-f50d441eee47 tempest-CinderUnicodeTest-1671550791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-40865693-5575-4677-abf4-c8d36b01bb61 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:54 devstack sudo[104552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-40865693-5575-4677-abf4-c8d36b01bb61 Nov 06 18:02:54 devstack sudo[104552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:54 devstack sudo[104552]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ceb459cf-8dbb-4de4-8945-f50d441eee47 tempest-CinderUnicodeTest-1671550791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-40865693-5575-4677-abf4-c8d36b01bb61" returned: 0 in 0.296s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:54 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ceb459cf-8dbb-4de4-8945-f50d441eee47 tempest-CinderUnicodeTest-1671550791 None] Lock "cinder-quobyte-40865693-5575-4677-abf4-c8d36b01bb61" released by "delete_volume" :: held 0.774s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:02:54 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-ceb459cf-8dbb-4de4-8945-f50d441eee47 tempest-CinderUnicodeTest-1671550791 None] Created reservations ['fbb45ed4-7de6-471e-9c4c-091ff711c30b', '58651f8c-85c6-49f0-b8bf-d38a72aaa545', '56441699-6d6a-4e76-a61d-3797a9c60ddc', '83e123c4-739f-4c19-b280-94bb84c2183b'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:02:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ceb459cf-8dbb-4de4-8945-f50d441eee47 tempest-CinderUnicodeTest-1671550791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:02:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ceb459cf-8dbb-4de4-8945-f50d441eee47 tempest-CinderUnicodeTest-1671550791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:02:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ceb459cf-8dbb-4de4-8945-f50d441eee47 tempest-CinderUnicodeTest-1671550791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:02:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ceb459cf-8dbb-4de4-8945-f50d441eee47 tempest-CinderUnicodeTest-1671550791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:02:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ceb459cf-8dbb-4de4-8945-f50d441eee47 tempest-CinderUnicodeTest-1671550791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:02:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ceb459cf-8dbb-4de4-8945-f50d441eee47 tempest-CinderUnicodeTest-1671550791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:54 devstack sudo[104555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:02:54 devstack sudo[104555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:54 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 18:02:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:02:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:02:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:02:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:02:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:02:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:54 devstack sudo[104557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:02:54 devstack sudo[104557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:54 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f5711732-883f-40f5-a22d-cd75d2c39534 tempest-CinderUnicodeTest-1671550791 None] Acquiring lock "cinder-ff99591e-5cc1-4c4d-9c39-11998a9f6e25-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:02:54 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f5711732-883f-40f5-a22d-cd75d2c39534 tempest-CinderUnicodeTest-1671550791 None] Lock "cinder-ff99591e-5cc1-4c4d-9c39-11998a9f6e25-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:02:54 devstack sudo[104555]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:54 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f5711732-883f-40f5-a22d-cd75d2c39534 tempest-CinderUnicodeTest-1671550791 None] Acquiring lock "cinder-quobyte-ff99591e-5cc1-4c4d-9c39-11998a9f6e25" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:02:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ceb459cf-8dbb-4de4-8945-f50d441eee47 tempest-CinderUnicodeTest-1671550791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.282s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:54 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-ceb459cf-8dbb-4de4-8945-f50d441eee47 tempest-CinderUnicodeTest-1671550791 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:02:54 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-ceb459cf-8dbb-4de4-8945-f50d441eee47 tempest-CinderUnicodeTest-1671550791 None] Deleted volume successfully. Nov 06 18:02:54 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f5711732-883f-40f5-a22d-cd75d2c39534 tempest-CinderUnicodeTest-1671550791 None] Lock "cinder-quobyte-ff99591e-5cc1-4c4d-9c39-11998a9f6e25" acquired by "delete_volume" :: waited 0.025s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:02:54 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ceb459cf-8dbb-4de4-8945-f50d441eee47 tempest-CinderUnicodeTest-1671550791 None] Lock "cinder-40865693-5575-4677-abf4-c8d36b01bb61-delete_volume" released by "delete_volume" :: held 1.298s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:02:54 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76745b1-d7b6-47ca-ae75-9935c1c2cd37]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:02:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f5711732-883f-40f5-a22d-cd75d2c39534 tempest-CinderUnicodeTest-1671550791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ff99591e-5cc1-4c4d-9c39-11998a9f6e25 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:54 devstack sudo[104557]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.327s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:54 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:02:54 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running periodic task VolumeManager._thread_info {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 18:02:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] thread count: 28 {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 18:02:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] thread info: [<_MainThread(MainThread, started 133940619505792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 18:02:54 devstack sudo[104560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ff99591e-5cc1-4c4d-9c39-11998a9f6e25 Nov 06 18:02:54 devstack sudo[104560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:55 devstack sudo[104560]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f5711732-883f-40f5-a22d-cd75d2c39534 tempest-CinderUnicodeTest-1671550791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ff99591e-5cc1-4c4d-9c39-11998a9f6e25" returned: 0 in 0.389s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f5711732-883f-40f5-a22d-cd75d2c39534 tempest-CinderUnicodeTest-1671550791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ff99591e-5cc1-4c4d-9c39-11998a9f6e25 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:55 devstack sudo[104566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ff99591e-5cc1-4c4d-9c39-11998a9f6e25 Nov 06 18:02:55 devstack sudo[104566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:55 devstack sudo[104566]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f5711732-883f-40f5-a22d-cd75d2c39534 tempest-CinderUnicodeTest-1671550791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ff99591e-5cc1-4c4d-9c39-11998a9f6e25" returned: 0 in 0.258s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f5711732-883f-40f5-a22d-cd75d2c39534 tempest-CinderUnicodeTest-1671550791 None] Lock "cinder-quobyte-ff99591e-5cc1-4c4d-9c39-11998a9f6e25" released by "delete_volume" :: held 0.704s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:02:55 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-f5711732-883f-40f5-a22d-cd75d2c39534 tempest-CinderUnicodeTest-1671550791 None] Created reservations ['ad4083cf-f263-4643-bd36-654a04cc0e54', '957f8380-9dfd-40cf-84f0-018bba7d8f39', '0152b51e-9620-43b7-b6cd-574329344be4', '0eb7b912-d30d-432a-a687-0456c0a1b712'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:02:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f5711732-883f-40f5-a22d-cd75d2c39534 tempest-CinderUnicodeTest-1671550791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:02:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f5711732-883f-40f5-a22d-cd75d2c39534 tempest-CinderUnicodeTest-1671550791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:02:55 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f5711732-883f-40f5-a22d-cd75d2c39534 tempest-CinderUnicodeTest-1671550791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:02:55 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f5711732-883f-40f5-a22d-cd75d2c39534 tempest-CinderUnicodeTest-1671550791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:02:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f5711732-883f-40f5-a22d-cd75d2c39534 tempest-CinderUnicodeTest-1671550791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:02:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f5711732-883f-40f5-a22d-cd75d2c39534 tempest-CinderUnicodeTest-1671550791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:02:55 devstack sudo[104569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:02:55 devstack sudo[104569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:02:55 devstack sudo[104569]: pam_unix(sudo:session): session closed for user root Nov 06 18:02:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f5711732-883f-40f5-a22d-cd75d2c39534 tempest-CinderUnicodeTest-1671550791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.278s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:02:55 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-f5711732-883f-40f5-a22d-cd75d2c39534 tempest-CinderUnicodeTest-1671550791 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:02:55 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-f5711732-883f-40f5-a22d-cd75d2c39534 tempest-CinderUnicodeTest-1671550791 None] Deleted volume successfully. Nov 06 18:02:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f5711732-883f-40f5-a22d-cd75d2c39534 tempest-CinderUnicodeTest-1671550791 None] Lock "cinder-ff99591e-5cc1-4c4d-9c39-11998a9f6e25-delete_volume" released by "delete_volume" :: held 1.227s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:03:05 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:UPDATE=87,cinder:SELECT=59,cinder:INSERT=17,cinder:DELETE=3 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:03:05 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:UPDATE=69,cinder:DELETE=9,cinder:SELECT=63,cinder:INSERT=24 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:03:08 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7d18ee5-8775-4949-9aca-270f63845e9d tempest-CreateVolumesFromImageTest-228325488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:03:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c7d18ee5-8775-4949-9aca-270f63845e9d tempest-CreateVolumesFromImageTest-228325488 None] Flow 'volume_create_manager' (2e61c573-fe9e-4901-89c0-db0beb98c41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:03:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c7d18ee5-8775-4949-9aca-270f63845e9d tempest-CreateVolumesFromImageTest-228325488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ffc98fc-8d51-4789-b3ea-2cc579878f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c7d18ee5-8775-4949-9aca-270f63845e9d tempest-CreateVolumesFromImageTest-228325488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ffc98fc-8d51-4789-b3ea-2cc579878f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1229057432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4652306-74be-47b0-8eb6-0b797d30e5d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72f78f280f214096901c8195cea48f73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:03:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:03:08Z,use_quota=True,user_id='e8954f2c996440949cc2423fc77d0ac8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c7d18ee5-8775-4949-9aca-270f63845e9d tempest-CreateVolumesFromImageTest-228325488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7464f65-1c67-401b-8e46-81d881cf2b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c7d18ee5-8775-4949-9aca-270f63845e9d tempest-CreateVolumesFromImageTest-228325488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7464f65-1c67-401b-8e46-81d881cf2b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c7d18ee5-8775-4949-9aca-270f63845e9d tempest-CreateVolumesFromImageTest-228325488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9310fa2b-6ebc-4ce9-8ad8-34e65d906c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c7d18ee5-8775-4949-9aca-270f63845e9d tempest-CreateVolumesFromImageTest-228325488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9310fa2b-6ebc-4ce9-8ad8-34e65d906c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4652306-74be-47b0-8eb6-0b797d30e5d8', 'volume_name': 'volume-e4652306-74be-47b0-8eb6-0b797d30e5d8', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c7d18ee5-8775-4949-9aca-270f63845e9d tempest-CreateVolumesFromImageTest-228325488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2fe3db4-a311-497a-a95b-e5047134b08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c7d18ee5-8775-4949-9aca-270f63845e9d tempest-CreateVolumesFromImageTest-228325488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2fe3db4-a311-497a-a95b-e5047134b08d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c7d18ee5-8775-4949-9aca-270f63845e9d tempest-CreateVolumesFromImageTest-228325488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fa06251-fe3b-4ad6-b40e-626458c4ba45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:08 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-c7d18ee5-8775-4949-9aca-270f63845e9d tempest-CreateVolumesFromImageTest-228325488 None] Volume e4652306-74be-47b0-8eb6-0b797d30e5d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4652306-74be-47b0-8eb6-0b797d30e5d8', 'volume_size': 1} Nov 06 18:03:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c7d18ee5-8775-4949-9aca-270f63845e9d tempest-CreateVolumesFromImageTest-228325488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c7d18ee5-8775-4949-9aca-270f63845e9d tempest-CreateVolumesFromImageTest-228325488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:08 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c7d18ee5-8775-4949-9aca-270f63845e9d tempest-CreateVolumesFromImageTest-228325488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1229057432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4652306-74be-47b0-8eb6-0b797d30e5d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72f78f280f214096901c8195cea48f73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:03:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:03:08Z,use_quota=True,user_id='e8954f2c996440949cc2423fc77d0ac8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:03:08 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-c7d18ee5-8775-4949-9aca-270f63845e9d tempest-CreateVolumesFromImageTest-228325488 None] Creating volume e4652306-74be-47b0-8eb6-0b797d30e5d8 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:03:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c7d18ee5-8775-4949-9aca-270f63845e9d tempest-CreateVolumesFromImageTest-228325488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c7d18ee5-8775-4949-9aca-270f63845e9d tempest-CreateVolumesFromImageTest-228325488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:08 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c7d18ee5-8775-4949-9aca-270f63845e9d tempest-CreateVolumesFromImageTest-228325488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:03:08 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c7d18ee5-8775-4949-9aca-270f63845e9d tempest-CreateVolumesFromImageTest-228325488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:03:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c7d18ee5-8775-4949-9aca-270f63845e9d tempest-CreateVolumesFromImageTest-228325488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:08 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c7d18ee5-8775-4949-9aca-270f63845e9d tempest-CreateVolumesFromImageTest-228325488 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:03:08 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-c7d18ee5-8775-4949-9aca-270f63845e9d tempest-CreateVolumesFromImageTest-228325488 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:03:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c7d18ee5-8775-4949-9aca-270f63845e9d tempest-CreateVolumesFromImageTest-228325488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e4652306-74be-47b0-8eb6-0b797d30e5d8 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:08 devstack sudo[104647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e4652306-74be-47b0-8eb6-0b797d30e5d8 1073741824 Nov 06 18:03:08 devstack sudo[104647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:08 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-49433fbc-d297-417e-b63c-6b0533ababbe tempest-CreateVolumesFromImageTest-228325488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:03:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-49433fbc-d297-417e-b63c-6b0533ababbe tempest-CreateVolumesFromImageTest-228325488 None] Flow 'volume_create_manager' (ca12f7d9-58d0-4012-8c2d-38e414c73bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:03:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-49433fbc-d297-417e-b63c-6b0533ababbe tempest-CreateVolumesFromImageTest-228325488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2c9dc22-a1c3-44f9-a8ed-d89a9d152b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-49433fbc-d297-417e-b63c-6b0533ababbe tempest-CreateVolumesFromImageTest-228325488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2c9dc22-a1c3-44f9-a8ed-d89a9d152b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1807967047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab78cbf7-2a14-4bf0-b563-7964fa4d2a79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72f78f280f214096901c8195cea48f73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:03:09Z,use_quota=True,user_id='e8954f2c996440949cc2423fc77d0ac8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-49433fbc-d297-417e-b63c-6b0533ababbe tempest-CreateVolumesFromImageTest-228325488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3199b3a8-ffef-44b6-bc47-8e2e651fbb83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-49433fbc-d297-417e-b63c-6b0533ababbe tempest-CreateVolumesFromImageTest-228325488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3199b3a8-ffef-44b6-bc47-8e2e651fbb83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-49433fbc-d297-417e-b63c-6b0533ababbe tempest-CreateVolumesFromImageTest-228325488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfac2f4c-e99a-4033-a929-a06ee2ee2522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-49433fbc-d297-417e-b63c-6b0533ababbe tempest-CreateVolumesFromImageTest-228325488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfac2f4c-e99a-4033-a929-a06ee2ee2522) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab78cbf7-2a14-4bf0-b563-7964fa4d2a79', 'volume_name': 'volume-ab78cbf7-2a14-4bf0-b563-7964fa4d2a79', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-49433fbc-d297-417e-b63c-6b0533ababbe tempest-CreateVolumesFromImageTest-228325488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa40d12b-a8cc-479d-93f0-05a5b9fdef5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-49433fbc-d297-417e-b63c-6b0533ababbe tempest-CreateVolumesFromImageTest-228325488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa40d12b-a8cc-479d-93f0-05a5b9fdef5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-49433fbc-d297-417e-b63c-6b0533ababbe tempest-CreateVolumesFromImageTest-228325488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3164092f-5e21-4eb5-a671-bafd32e21037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:08 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-49433fbc-d297-417e-b63c-6b0533ababbe tempest-CreateVolumesFromImageTest-228325488 None] Volume ab78cbf7-2a14-4bf0-b563-7964fa4d2a79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab78cbf7-2a14-4bf0-b563-7964fa4d2a79', 'volume_size': 1} Nov 06 18:03:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-49433fbc-d297-417e-b63c-6b0533ababbe tempest-CreateVolumesFromImageTest-228325488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:09 devstack sudo[104647]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c7d18ee5-8775-4949-9aca-270f63845e9d tempest-CreateVolumesFromImageTest-228325488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e4652306-74be-47b0-8eb6-0b797d30e5d8 1073741824" returned: 0 in 0.815s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c7d18ee5-8775-4949-9aca-270f63845e9d tempest-CreateVolumesFromImageTest-228325488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e4652306-74be-47b0-8eb6-0b797d30e5d8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:09 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5272997-dc79-4a70-a5ab-773a6e40a77a tempest-VolumeDependencyTests-535782399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:03:09 devstack sudo[104652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e4652306-74be-47b0-8eb6-0b797d30e5d8 Nov 06 18:03:09 devstack sudo[104652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d5272997-dc79-4a70-a5ab-773a6e40a77a tempest-VolumeDependencyTests-535782399 None] Flow 'volume_create_manager' (8540f1f9-a1b5-4da7-ad31-06b34b3ed55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:03:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d5272997-dc79-4a70-a5ab-773a6e40a77a tempest-VolumeDependencyTests-535782399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3c9bc0d-46bf-4150-ac90-9bf4aca88e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d5272997-dc79-4a70-a5ab-773a6e40a77a tempest-VolumeDependencyTests-535782399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3c9bc0d-46bf-4150-ac90-9bf4aca88e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-571044240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aa09fe7-4865-42f0-b514-6a2402eb2d69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5254ce269ffd4bb5ba45f32c2b4c562d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:03:09Z,use_quota=True,user_id='e82da70cb0594cb983990b3797db6e0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d5272997-dc79-4a70-a5ab-773a6e40a77a tempest-VolumeDependencyTests-535782399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f7b545d-de30-43d8-a16c-671c69115b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d5272997-dc79-4a70-a5ab-773a6e40a77a tempest-VolumeDependencyTests-535782399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f7b545d-de30-43d8-a16c-671c69115b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d5272997-dc79-4a70-a5ab-773a6e40a77a tempest-VolumeDependencyTests-535782399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8388a2e9-0f81-4123-b13b-f56b7d0efd64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d5272997-dc79-4a70-a5ab-773a6e40a77a tempest-VolumeDependencyTests-535782399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8388a2e9-0f81-4123-b13b-f56b7d0efd64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7aa09fe7-4865-42f0-b514-6a2402eb2d69', 'volume_name': 'volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d5272997-dc79-4a70-a5ab-773a6e40a77a tempest-VolumeDependencyTests-535782399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e7ce1cc-1e67-465c-8c18-fd1cea781cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d5272997-dc79-4a70-a5ab-773a6e40a77a tempest-VolumeDependencyTests-535782399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e7ce1cc-1e67-465c-8c18-fd1cea781cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d5272997-dc79-4a70-a5ab-773a6e40a77a tempest-VolumeDependencyTests-535782399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92f9643d-1d85-4c18-925d-74e1666e0795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:09 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-d5272997-dc79-4a70-a5ab-773a6e40a77a tempest-VolumeDependencyTests-535782399 None] Volume 7aa09fe7-4865-42f0-b514-6a2402eb2d69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69', 'volume_size': 1} Nov 06 18:03:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d5272997-dc79-4a70-a5ab-773a6e40a77a tempest-VolumeDependencyTests-535782399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:09 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-160d0a5f-6679-457b-a37a-db7ecb5a451d tempest-CreateVolumesFromImageTest-228325488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:03:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-160d0a5f-6679-457b-a37a-db7ecb5a451d tempest-CreateVolumesFromImageTest-228325488 None] Flow 'volume_create_manager' (c03ca77e-1cc3-44be-a744-0c817242cec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:03:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-160d0a5f-6679-457b-a37a-db7ecb5a451d tempest-CreateVolumesFromImageTest-228325488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58c151af-acf3-400c-93fb-43b876afe63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-160d0a5f-6679-457b-a37a-db7ecb5a451d tempest-CreateVolumesFromImageTest-228325488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58c151af-acf3-400c-93fb-43b876afe63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1965230638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2f719e5-f586-4521-b51b-74bd9b58f818,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72f78f280f214096901c8195cea48f73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:03:09Z,use_quota=True,user_id='e8954f2c996440949cc2423fc77d0ac8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-160d0a5f-6679-457b-a37a-db7ecb5a451d tempest-CreateVolumesFromImageTest-228325488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb7c7df6-771c-4cf4-ae73-8dfd6ec6fe8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-160d0a5f-6679-457b-a37a-db7ecb5a451d tempest-CreateVolumesFromImageTest-228325488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb7c7df6-771c-4cf4-ae73-8dfd6ec6fe8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-160d0a5f-6679-457b-a37a-db7ecb5a451d tempest-CreateVolumesFromImageTest-228325488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd249bfc-363c-495a-9bc1-58f6d7dd4d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-160d0a5f-6679-457b-a37a-db7ecb5a451d tempest-CreateVolumesFromImageTest-228325488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd249bfc-363c-495a-9bc1-58f6d7dd4d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2f719e5-f586-4521-b51b-74bd9b58f818', 'volume_name': 'volume-a2f719e5-f586-4521-b51b-74bd9b58f818', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-160d0a5f-6679-457b-a37a-db7ecb5a451d tempest-CreateVolumesFromImageTest-228325488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c6a34b6-f130-482a-bb31-5a75ce0e914d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-160d0a5f-6679-457b-a37a-db7ecb5a451d tempest-CreateVolumesFromImageTest-228325488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c6a34b6-f130-482a-bb31-5a75ce0e914d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-160d0a5f-6679-457b-a37a-db7ecb5a451d tempest-CreateVolumesFromImageTest-228325488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3396d425-81f3-49b7-888c-f4f149925939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:09 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-160d0a5f-6679-457b-a37a-db7ecb5a451d tempest-CreateVolumesFromImageTest-228325488 None] Volume a2f719e5-f586-4521-b51b-74bd9b58f818: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2f719e5-f586-4521-b51b-74bd9b58f818', 'volume_size': 1} Nov 06 18:03:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-160d0a5f-6679-457b-a37a-db7ecb5a451d tempest-CreateVolumesFromImageTest-228325488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:09 devstack sudo[104652]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c7d18ee5-8775-4949-9aca-270f63845e9d tempest-CreateVolumesFromImageTest-228325488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e4652306-74be-47b0-8eb6-0b797d30e5d8" returned: 0 in 0.508s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:09 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c7d18ee5-8775-4949-9aca-270f63845e9d tempest-CreateVolumesFromImageTest-228325488 None] <== create_volume: return (1409ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:03:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c7d18ee5-8775-4949-9aca-270f63845e9d tempest-CreateVolumesFromImageTest-228325488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.412s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-49433fbc-d297-417e-b63c-6b0533ababbe tempest-CreateVolumesFromImageTest-228325488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.892s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:09 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-49433fbc-d297-417e-b63c-6b0533ababbe tempest-CreateVolumesFromImageTest-228325488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1807967047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab78cbf7-2a14-4bf0-b563-7964fa4d2a79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72f78f280f214096901c8195cea48f73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:03:09Z,use_quota=True,user_id='e8954f2c996440949cc2423fc77d0ac8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:03:09 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-49433fbc-d297-417e-b63c-6b0533ababbe tempest-CreateVolumesFromImageTest-228325488 None] Creating volume ab78cbf7-2a14-4bf0-b563-7964fa4d2a79 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:03:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-49433fbc-d297-417e-b63c-6b0533ababbe tempest-CreateVolumesFromImageTest-228325488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-49433fbc-d297-417e-b63c-6b0533ababbe tempest-CreateVolumesFromImageTest-228325488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:09 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-49433fbc-d297-417e-b63c-6b0533ababbe tempest-CreateVolumesFromImageTest-228325488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:03:09 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-49433fbc-d297-417e-b63c-6b0533ababbe tempest-CreateVolumesFromImageTest-228325488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:03:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-49433fbc-d297-417e-b63c-6b0533ababbe tempest-CreateVolumesFromImageTest-228325488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:09 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-49433fbc-d297-417e-b63c-6b0533ababbe tempest-CreateVolumesFromImageTest-228325488 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:03:09 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-49433fbc-d297-417e-b63c-6b0533ababbe tempest-CreateVolumesFromImageTest-228325488 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:03:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-49433fbc-d297-417e-b63c-6b0533ababbe tempest-CreateVolumesFromImageTest-228325488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ab78cbf7-2a14-4bf0-b563-7964fa4d2a79 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:09 devstack sudo[104655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ab78cbf7-2a14-4bf0-b563-7964fa4d2a79 1073741824 Nov 06 18:03:09 devstack sudo[104655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c7d18ee5-8775-4949-9aca-270f63845e9d tempest-CreateVolumesFromImageTest-228325488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fa06251-fe3b-4ad6-b40e-626458c4ba45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4652306-74be-47b0-8eb6-0b797d30e5d8', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c7d18ee5-8775-4949-9aca-270f63845e9d tempest-CreateVolumesFromImageTest-228325488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad9819c8-807f-42fc-a9f6-6f4504fd2746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:09 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-709410a8-c954-42b2-8d18-1d7bde38a958 tempest-CreateVolumesFromImageTest-228325488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:03:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-709410a8-c954-42b2-8d18-1d7bde38a958 tempest-CreateVolumesFromImageTest-228325488 None] Flow 'volume_create_manager' (41b8003f-d13f-4d17-90c5-7fcc3eaed3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:03:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-709410a8-c954-42b2-8d18-1d7bde38a958 tempest-CreateVolumesFromImageTest-228325488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c551550-822d-4f46-a716-3a5016bf6bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:09 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-c7d18ee5-8775-4949-9aca-270f63845e9d tempest-CreateVolumesFromImageTest-228325488 None] Volume volume-e4652306-74be-47b0-8eb6-0b797d30e5d8 (e4652306-74be-47b0-8eb6-0b797d30e5d8): created successfully Nov 06 18:03:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c7d18ee5-8775-4949-9aca-270f63845e9d tempest-CreateVolumesFromImageTest-228325488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad9819c8-807f-42fc-a9f6-6f4504fd2746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c7d18ee5-8775-4949-9aca-270f63845e9d tempest-CreateVolumesFromImageTest-228325488 None] Flow 'volume_create_manager' (2e61c573-fe9e-4901-89c0-db0beb98c41f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:03:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-709410a8-c954-42b2-8d18-1d7bde38a958 tempest-CreateVolumesFromImageTest-228325488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c551550-822d-4f46-a716-3a5016bf6bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-4922577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e6e0450-a0cb-40ac-ac0b-173329aa4285,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72f78f280f214096901c8195cea48f73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:03:10Z,use_quota=True,user_id='e8954f2c996440949cc2423fc77d0ac8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-709410a8-c954-42b2-8d18-1d7bde38a958 tempest-CreateVolumesFromImageTest-228325488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21c3c6d1-41c8-42e6-8c40-26895c7c6911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-709410a8-c954-42b2-8d18-1d7bde38a958 tempest-CreateVolumesFromImageTest-228325488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21c3c6d1-41c8-42e6-8c40-26895c7c6911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-709410a8-c954-42b2-8d18-1d7bde38a958 tempest-CreateVolumesFromImageTest-228325488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c83e4ece-5ceb-4e7b-91f9-51b6ab7f3fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-709410a8-c954-42b2-8d18-1d7bde38a958 tempest-CreateVolumesFromImageTest-228325488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c83e4ece-5ceb-4e7b-91f9-51b6ab7f3fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e6e0450-a0cb-40ac-ac0b-173329aa4285', 'volume_name': 'volume-5e6e0450-a0cb-40ac-ac0b-173329aa4285', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-709410a8-c954-42b2-8d18-1d7bde38a958 tempest-CreateVolumesFromImageTest-228325488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51e42316-b994-4dc9-9414-3f207172262d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-709410a8-c954-42b2-8d18-1d7bde38a958 tempest-CreateVolumesFromImageTest-228325488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51e42316-b994-4dc9-9414-3f207172262d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-709410a8-c954-42b2-8d18-1d7bde38a958 tempest-CreateVolumesFromImageTest-228325488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebe7ead1-76c9-4a2d-abde-a79a1b63a33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:09 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-709410a8-c954-42b2-8d18-1d7bde38a958 tempest-CreateVolumesFromImageTest-228325488 None] Volume 5e6e0450-a0cb-40ac-ac0b-173329aa4285: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e6e0450-a0cb-40ac-ac0b-173329aa4285', 'volume_size': 1} Nov 06 18:03:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-709410a8-c954-42b2-8d18-1d7bde38a958 tempest-CreateVolumesFromImageTest-228325488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:09 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-c7d18ee5-8775-4949-9aca-270f63845e9d tempest-CreateVolumesFromImageTest-228325488 None] Created volume successfully. Nov 06 18:03:10 devstack sudo[104655]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-49433fbc-d297-417e-b63c-6b0533ababbe tempest-CreateVolumesFromImageTest-228325488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ab78cbf7-2a14-4bf0-b563-7964fa4d2a79 1073741824" returned: 0 in 0.679s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-49433fbc-d297-417e-b63c-6b0533ababbe tempest-CreateVolumesFromImageTest-228325488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ab78cbf7-2a14-4bf0-b563-7964fa4d2a79 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:10 devstack sudo[104661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ab78cbf7-2a14-4bf0-b563-7964fa4d2a79 Nov 06 18:03:10 devstack sudo[104661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:10 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-da3df4a5-1961-4365-90ce-2235d276bc60 tempest-CreateVolumesFromImageTest-228325488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:03:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-da3df4a5-1961-4365-90ce-2235d276bc60 tempest-CreateVolumesFromImageTest-228325488 None] Flow 'volume_create_manager' (60b59725-96c0-4867-919d-15bbd893be0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:03:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-da3df4a5-1961-4365-90ce-2235d276bc60 tempest-CreateVolumesFromImageTest-228325488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0908d962-07ac-4eee-a0b2-9f389e2bd672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-da3df4a5-1961-4365-90ce-2235d276bc60 tempest-CreateVolumesFromImageTest-228325488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0908d962-07ac-4eee-a0b2-9f389e2bd672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1920773271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f773070-492f-4b99-a52c-60d6cd41ae68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72f78f280f214096901c8195cea48f73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:03:10Z,use_quota=True,user_id='e8954f2c996440949cc2423fc77d0ac8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-da3df4a5-1961-4365-90ce-2235d276bc60 tempest-CreateVolumesFromImageTest-228325488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ee5d538-ab02-4269-a191-411968856884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-da3df4a5-1961-4365-90ce-2235d276bc60 tempest-CreateVolumesFromImageTest-228325488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ee5d538-ab02-4269-a191-411968856884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-da3df4a5-1961-4365-90ce-2235d276bc60 tempest-CreateVolumesFromImageTest-228325488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bc521a1-234d-455f-95a7-7e2d5b77f458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-da3df4a5-1961-4365-90ce-2235d276bc60 tempest-CreateVolumesFromImageTest-228325488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bc521a1-234d-455f-95a7-7e2d5b77f458) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f773070-492f-4b99-a52c-60d6cd41ae68', 'volume_name': 'volume-8f773070-492f-4b99-a52c-60d6cd41ae68', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-da3df4a5-1961-4365-90ce-2235d276bc60 tempest-CreateVolumesFromImageTest-228325488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4555d53e-8acf-49c2-aeff-8ed1259bab6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-da3df4a5-1961-4365-90ce-2235d276bc60 tempest-CreateVolumesFromImageTest-228325488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4555d53e-8acf-49c2-aeff-8ed1259bab6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-da3df4a5-1961-4365-90ce-2235d276bc60 tempest-CreateVolumesFromImageTest-228325488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (568331bd-f5c8-4f19-bbb9-f0c29fa2def5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:10 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-da3df4a5-1961-4365-90ce-2235d276bc60 tempest-CreateVolumesFromImageTest-228325488 None] Volume 8f773070-492f-4b99-a52c-60d6cd41ae68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f773070-492f-4b99-a52c-60d6cd41ae68', 'volume_size': 1} Nov 06 18:03:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-da3df4a5-1961-4365-90ce-2235d276bc60 tempest-CreateVolumesFromImageTest-228325488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:10 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-7040bc7f-5391-4c48-a2ce-c009b9becea0 tempest-ProjectMemberTests-819176810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:03:10 devstack sudo[104661]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7040bc7f-5391-4c48-a2ce-c009b9becea0 tempest-ProjectMemberTests-819176810 None] Flow 'volume_create_manager' (52865b09-3a83-4861-9067-8a30289a1bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:03:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7040bc7f-5391-4c48-a2ce-c009b9becea0 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (657c1476-350a-4f05-b435-b6c9ce46dab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-49433fbc-d297-417e-b63c-6b0533ababbe tempest-CreateVolumesFromImageTest-228325488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ab78cbf7-2a14-4bf0-b563-7964fa4d2a79" returned: 0 in 0.324s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-49433fbc-d297-417e-b63c-6b0533ababbe tempest-CreateVolumesFromImageTest-228325488 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:03:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-49433fbc-d297-417e-b63c-6b0533ababbe tempest-CreateVolumesFromImageTest-228325488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d5272997-dc79-4a70-a5ab-773a6e40a77a tempest-VolumeDependencyTests-535782399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.347s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d5272997-dc79-4a70-a5ab-773a6e40a77a tempest-VolumeDependencyTests-535782399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-571044240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aa09fe7-4865-42f0-b514-6a2402eb2d69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5254ce269ffd4bb5ba45f32c2b4c562d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:03:09Z,use_quota=True,user_id='e82da70cb0594cb983990b3797db6e0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:03:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-d5272997-dc79-4a70-a5ab-773a6e40a77a tempest-VolumeDependencyTests-535782399 None] Creating volume 7aa09fe7-4865-42f0-b514-6a2402eb2d69 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:03:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d5272997-dc79-4a70-a5ab-773a6e40a77a tempest-VolumeDependencyTests-535782399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d5272997-dc79-4a70-a5ab-773a6e40a77a tempest-VolumeDependencyTests-535782399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d5272997-dc79-4a70-a5ab-773a6e40a77a tempest-VolumeDependencyTests-535782399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:03:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d5272997-dc79-4a70-a5ab-773a6e40a77a tempest-VolumeDependencyTests-535782399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:03:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d5272997-dc79-4a70-a5ab-773a6e40a77a tempest-VolumeDependencyTests-535782399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d5272997-dc79-4a70-a5ab-773a6e40a77a tempest-VolumeDependencyTests-535782399 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:03:10 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-d5272997-dc79-4a70-a5ab-773a6e40a77a tempest-VolumeDependencyTests-535782399 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:03:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d5272997-dc79-4a70-a5ab-773a6e40a77a tempest-VolumeDependencyTests-535782399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7040bc7f-5391-4c48-a2ce-c009b9becea0 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (657c1476-350a-4f05-b435-b6c9ce46dab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1201889493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92a1b7d6-0bcc-4e4f-bb47-cb8a92301504,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b97cd7ef94764995a9e8c62cda23171f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:03:11Z,use_quota=True,user_id='a34e6465a98c4c289547d49a900a6bde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7040bc7f-5391-4c48-a2ce-c009b9becea0 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71d6a8d5-3caa-4505-920a-69e2836c5e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:10 devstack sudo[104665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69 1073741824 Nov 06 18:03:10 devstack sudo[104665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7040bc7f-5391-4c48-a2ce-c009b9becea0 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71d6a8d5-3caa-4505-920a-69e2836c5e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7040bc7f-5391-4c48-a2ce-c009b9becea0 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6b62f45-1fc7-40a8-9e21-6e87c445dc80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7040bc7f-5391-4c48-a2ce-c009b9becea0 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6b62f45-1fc7-40a8-9e21-6e87c445dc80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92a1b7d6-0bcc-4e4f-bb47-cb8a92301504', 'volume_name': 'volume-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7040bc7f-5391-4c48-a2ce-c009b9becea0 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (260a735f-b072-428c-b5ca-44a25ff89eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7040bc7f-5391-4c48-a2ce-c009b9becea0 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (260a735f-b072-428c-b5ca-44a25ff89eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7040bc7f-5391-4c48-a2ce-c009b9becea0 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8027ce8-9f0a-4f66-9543-3bc4df010b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:10 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-7040bc7f-5391-4c48-a2ce-c009b9becea0 tempest-ProjectMemberTests-819176810 None] Volume 92a1b7d6-0bcc-4e4f-bb47-cb8a92301504: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504', 'volume_size': 1} Nov 06 18:03:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7040bc7f-5391-4c48-a2ce-c009b9becea0 tempest-ProjectMemberTests-819176810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-49433fbc-d297-417e-b63c-6b0533ababbe tempest-CreateVolumesFromImageTest-228325488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3164092f-5e21-4eb5-a671-bafd32e21037) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab78cbf7-2a14-4bf0-b563-7964fa4d2a79', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-49433fbc-d297-417e-b63c-6b0533ababbe tempest-CreateVolumesFromImageTest-228325488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (848dfe63-3b7d-4f88-a7be-5cab26af3cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:10 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-49433fbc-d297-417e-b63c-6b0533ababbe tempest-CreateVolumesFromImageTest-228325488 None] Volume volume-ab78cbf7-2a14-4bf0-b563-7964fa4d2a79 (ab78cbf7-2a14-4bf0-b563-7964fa4d2a79): created successfully Nov 06 18:03:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-49433fbc-d297-417e-b63c-6b0533ababbe tempest-CreateVolumesFromImageTest-228325488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (848dfe63-3b7d-4f88-a7be-5cab26af3cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-49433fbc-d297-417e-b63c-6b0533ababbe tempest-CreateVolumesFromImageTest-228325488 None] Flow 'volume_create_manager' (ca12f7d9-58d0-4012-8c2d-38e414c73bd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:03:10 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-49433fbc-d297-417e-b63c-6b0533ababbe tempest-CreateVolumesFromImageTest-228325488 None] Created volume successfully. Nov 06 18:03:11 devstack sudo[104665]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d5272997-dc79-4a70-a5ab-773a6e40a77a tempest-VolumeDependencyTests-535782399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69 1073741824" returned: 0 in 0.475s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d5272997-dc79-4a70-a5ab-773a6e40a77a tempest-VolumeDependencyTests-535782399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:11 devstack sudo[104672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69 Nov 06 18:03:11 devstack sudo[104672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:11 devstack sudo[104672]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d5272997-dc79-4a70-a5ab-773a6e40a77a tempest-VolumeDependencyTests-535782399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69" returned: 0 in 0.275s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d5272997-dc79-4a70-a5ab-773a6e40a77a tempest-VolumeDependencyTests-535782399 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:03:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d5272997-dc79-4a70-a5ab-773a6e40a77a tempest-VolumeDependencyTests-535782399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-160d0a5f-6679-457b-a37a-db7ecb5a451d tempest-CreateVolumesFromImageTest-228325488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.021s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-160d0a5f-6679-457b-a37a-db7ecb5a451d tempest-CreateVolumesFromImageTest-228325488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1965230638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2f719e5-f586-4521-b51b-74bd9b58f818,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72f78f280f214096901c8195cea48f73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:03:09Z,use_quota=True,user_id='e8954f2c996440949cc2423fc77d0ac8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:03:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-160d0a5f-6679-457b-a37a-db7ecb5a451d tempest-CreateVolumesFromImageTest-228325488 None] Creating volume a2f719e5-f586-4521-b51b-74bd9b58f818 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:03:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-160d0a5f-6679-457b-a37a-db7ecb5a451d tempest-CreateVolumesFromImageTest-228325488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-160d0a5f-6679-457b-a37a-db7ecb5a451d tempest-CreateVolumesFromImageTest-228325488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-160d0a5f-6679-457b-a37a-db7ecb5a451d tempest-CreateVolumesFromImageTest-228325488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:03:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-160d0a5f-6679-457b-a37a-db7ecb5a451d tempest-CreateVolumesFromImageTest-228325488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:03:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-160d0a5f-6679-457b-a37a-db7ecb5a451d tempest-CreateVolumesFromImageTest-228325488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-160d0a5f-6679-457b-a37a-db7ecb5a451d tempest-CreateVolumesFromImageTest-228325488 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:03:11 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-160d0a5f-6679-457b-a37a-db7ecb5a451d tempest-CreateVolumesFromImageTest-228325488 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:03:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-160d0a5f-6679-457b-a37a-db7ecb5a451d tempest-CreateVolumesFromImageTest-228325488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a2f719e5-f586-4521-b51b-74bd9b58f818 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:11 devstack sudo[104675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a2f719e5-f586-4521-b51b-74bd9b58f818 1073741824 Nov 06 18:03:11 devstack sudo[104675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d5272997-dc79-4a70-a5ab-773a6e40a77a tempest-VolumeDependencyTests-535782399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92f9643d-1d85-4c18-925d-74e1666e0795) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d5272997-dc79-4a70-a5ab-773a6e40a77a tempest-VolumeDependencyTests-535782399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8370e043-0a6b-4ccf-a1aa-a5f9be87a3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:11 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-d5272997-dc79-4a70-a5ab-773a6e40a77a tempest-VolumeDependencyTests-535782399 None] Volume volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69 (7aa09fe7-4865-42f0-b514-6a2402eb2d69): created successfully Nov 06 18:03:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d5272997-dc79-4a70-a5ab-773a6e40a77a tempest-VolumeDependencyTests-535782399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8370e043-0a6b-4ccf-a1aa-a5f9be87a3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d5272997-dc79-4a70-a5ab-773a6e40a77a tempest-VolumeDependencyTests-535782399 None] Flow 'volume_create_manager' (8540f1f9-a1b5-4da7-ad31-06b34b3ed55e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:03:11 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-d5272997-dc79-4a70-a5ab-773a6e40a77a tempest-VolumeDependencyTests-535782399 None] Created volume successfully. Nov 06 18:03:11 devstack sudo[104675]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-160d0a5f-6679-457b-a37a-db7ecb5a451d tempest-CreateVolumesFromImageTest-228325488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a2f719e5-f586-4521-b51b-74bd9b58f818 1073741824" returned: 0 in 0.444s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-160d0a5f-6679-457b-a37a-db7ecb5a451d tempest-CreateVolumesFromImageTest-228325488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a2f719e5-f586-4521-b51b-74bd9b58f818 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:12 devstack sudo[104681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a2f719e5-f586-4521-b51b-74bd9b58f818 Nov 06 18:03:12 devstack sudo[104681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:12 devstack sudo[104681]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-160d0a5f-6679-457b-a37a-db7ecb5a451d tempest-CreateVolumesFromImageTest-228325488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a2f719e5-f586-4521-b51b-74bd9b58f818" returned: 0 in 0.275s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:12 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-160d0a5f-6679-457b-a37a-db7ecb5a451d tempest-CreateVolumesFromImageTest-228325488 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:03:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-160d0a5f-6679-457b-a37a-db7ecb5a451d tempest-CreateVolumesFromImageTest-228325488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-709410a8-c954-42b2-8d18-1d7bde38a958 tempest-CreateVolumesFromImageTest-228325488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.454s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:12 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-709410a8-c954-42b2-8d18-1d7bde38a958 tempest-CreateVolumesFromImageTest-228325488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-4922577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e6e0450-a0cb-40ac-ac0b-173329aa4285,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72f78f280f214096901c8195cea48f73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:03:10Z,use_quota=True,user_id='e8954f2c996440949cc2423fc77d0ac8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:03:12 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-709410a8-c954-42b2-8d18-1d7bde38a958 tempest-CreateVolumesFromImageTest-228325488 None] Creating volume 5e6e0450-a0cb-40ac-ac0b-173329aa4285 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:03:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-709410a8-c954-42b2-8d18-1d7bde38a958 tempest-CreateVolumesFromImageTest-228325488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-709410a8-c954-42b2-8d18-1d7bde38a958 tempest-CreateVolumesFromImageTest-228325488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:12 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-709410a8-c954-42b2-8d18-1d7bde38a958 tempest-CreateVolumesFromImageTest-228325488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:03:12 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-709410a8-c954-42b2-8d18-1d7bde38a958 tempest-CreateVolumesFromImageTest-228325488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:03:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-709410a8-c954-42b2-8d18-1d7bde38a958 tempest-CreateVolumesFromImageTest-228325488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:12 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-709410a8-c954-42b2-8d18-1d7bde38a958 tempest-CreateVolumesFromImageTest-228325488 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:03:12 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-709410a8-c954-42b2-8d18-1d7bde38a958 tempest-CreateVolumesFromImageTest-228325488 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:03:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-709410a8-c954-42b2-8d18-1d7bde38a958 tempest-CreateVolumesFromImageTest-228325488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5e6e0450-a0cb-40ac-ac0b-173329aa4285 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-160d0a5f-6679-457b-a37a-db7ecb5a451d tempest-CreateVolumesFromImageTest-228325488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3396d425-81f3-49b7-888c-f4f149925939) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2f719e5-f586-4521-b51b-74bd9b58f818', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:12 devstack sudo[104685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5e6e0450-a0cb-40ac-ac0b-173329aa4285 1073741824 Nov 06 18:03:12 devstack sudo[104685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-160d0a5f-6679-457b-a37a-db7ecb5a451d tempest-CreateVolumesFromImageTest-228325488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b4e7aec-43b2-4fa1-88b8-00d234193034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:12 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-160d0a5f-6679-457b-a37a-db7ecb5a451d tempest-CreateVolumesFromImageTest-228325488 None] Volume volume-a2f719e5-f586-4521-b51b-74bd9b58f818 (a2f719e5-f586-4521-b51b-74bd9b58f818): created successfully Nov 06 18:03:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-160d0a5f-6679-457b-a37a-db7ecb5a451d tempest-CreateVolumesFromImageTest-228325488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b4e7aec-43b2-4fa1-88b8-00d234193034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-160d0a5f-6679-457b-a37a-db7ecb5a451d tempest-CreateVolumesFromImageTest-228325488 None] Flow 'volume_create_manager' (c03ca77e-1cc3-44be-a744-0c817242cec3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:03:12 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-160d0a5f-6679-457b-a37a-db7ecb5a451d tempest-CreateVolumesFromImageTest-228325488 None] Created volume successfully. Nov 06 18:03:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d5c9f8dd-6038-4060-85c8-125fa8b11f0d tempest-VolumeDependencyTests-535782399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:12 devstack sudo[104685]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-709410a8-c954-42b2-8d18-1d7bde38a958 tempest-CreateVolumesFromImageTest-228325488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5e6e0450-a0cb-40ac-ac0b-173329aa4285 1073741824" returned: 0 in 0.505s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-709410a8-c954-42b2-8d18-1d7bde38a958 tempest-CreateVolumesFromImageTest-228325488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5e6e0450-a0cb-40ac-ac0b-173329aa4285 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:12 devstack sudo[104691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5e6e0450-a0cb-40ac-ac0b-173329aa4285 Nov 06 18:03:12 devstack sudo[104691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:13 devstack sudo[104691]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-709410a8-c954-42b2-8d18-1d7bde38a958 tempest-CreateVolumesFromImageTest-228325488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5e6e0450-a0cb-40ac-ac0b-173329aa4285" returned: 0 in 0.276s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:13 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-709410a8-c954-42b2-8d18-1d7bde38a958 tempest-CreateVolumesFromImageTest-228325488 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:03:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-709410a8-c954-42b2-8d18-1d7bde38a958 tempest-CreateVolumesFromImageTest-228325488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-da3df4a5-1961-4365-90ce-2235d276bc60 tempest-CreateVolumesFromImageTest-228325488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.480s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:13 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-da3df4a5-1961-4365-90ce-2235d276bc60 tempest-CreateVolumesFromImageTest-228325488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1920773271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f773070-492f-4b99-a52c-60d6cd41ae68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72f78f280f214096901c8195cea48f73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:03:10Z,use_quota=True,user_id='e8954f2c996440949cc2423fc77d0ac8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:03:13 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-da3df4a5-1961-4365-90ce-2235d276bc60 tempest-CreateVolumesFromImageTest-228325488 None] Creating volume 8f773070-492f-4b99-a52c-60d6cd41ae68 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:03:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-da3df4a5-1961-4365-90ce-2235d276bc60 tempest-CreateVolumesFromImageTest-228325488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-da3df4a5-1961-4365-90ce-2235d276bc60 tempest-CreateVolumesFromImageTest-228325488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:13 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-da3df4a5-1961-4365-90ce-2235d276bc60 tempest-CreateVolumesFromImageTest-228325488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:03:13 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-da3df4a5-1961-4365-90ce-2235d276bc60 tempest-CreateVolumesFromImageTest-228325488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:03:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-da3df4a5-1961-4365-90ce-2235d276bc60 tempest-CreateVolumesFromImageTest-228325488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:13 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-da3df4a5-1961-4365-90ce-2235d276bc60 tempest-CreateVolumesFromImageTest-228325488 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:03:13 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-da3df4a5-1961-4365-90ce-2235d276bc60 tempest-CreateVolumesFromImageTest-228325488 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:03:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-da3df4a5-1961-4365-90ce-2235d276bc60 tempest-CreateVolumesFromImageTest-228325488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8f773070-492f-4b99-a52c-60d6cd41ae68 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-709410a8-c954-42b2-8d18-1d7bde38a958 tempest-CreateVolumesFromImageTest-228325488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebe7ead1-76c9-4a2d-abde-a79a1b63a33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e6e0450-a0cb-40ac-ac0b-173329aa4285', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:13 devstack sudo[104694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8f773070-492f-4b99-a52c-60d6cd41ae68 1073741824 Nov 06 18:03:13 devstack sudo[104694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-709410a8-c954-42b2-8d18-1d7bde38a958 tempest-CreateVolumesFromImageTest-228325488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7882005f-56e8-4c78-8a69-9108f7bf46bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:13 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-709410a8-c954-42b2-8d18-1d7bde38a958 tempest-CreateVolumesFromImageTest-228325488 None] Volume volume-5e6e0450-a0cb-40ac-ac0b-173329aa4285 (5e6e0450-a0cb-40ac-ac0b-173329aa4285): created successfully Nov 06 18:03:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-709410a8-c954-42b2-8d18-1d7bde38a958 tempest-CreateVolumesFromImageTest-228325488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7882005f-56e8-4c78-8a69-9108f7bf46bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-709410a8-c954-42b2-8d18-1d7bde38a958 tempest-CreateVolumesFromImageTest-228325488 None] Flow 'volume_create_manager' (41b8003f-d13f-4d17-90c5-7fcc3eaed3e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:03:13 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-709410a8-c954-42b2-8d18-1d7bde38a958 tempest-CreateVolumesFromImageTest-228325488 None] Created volume successfully. Nov 06 18:03:13 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:03:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Flow 'volume_create_manager' (01f7632d-74a1-4955-9ac8-0b30a4d17869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:03:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4979ddc-f1b9-4316-aa14-bb76b21936e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4979ddc-f1b9-4316-aa14-bb76b21936e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:03:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24444b32-392d-454b-9e29-9fee7be696aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1de702676a3a46cca53abd3c64595ef4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:03:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:03:13Z,use_quota=True,user_id='1cec33fb3e074f73a578488512799dd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f4775ae8-60bb-4a07-93be-0aedd763aacb),volume_type_id=f4775ae8-60bb-4a07-93be-0aedd763aacb)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5222b88f-0784-4ab9-96ab-af0c0f645feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5222b88f-0784-4ab9-96ab-af0c0f645feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d617f84b-8cce-476c-a74f-772159ff1c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:13 devstack cinder-volume[87068]: DEBUG cinder.image.glance [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Creating Keystone auth plugin from conf {{(pid=87068) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 18:03:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d617f84b-8cce-476c-a74f-772159ff1c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '24444b32-392d-454b-9e29-9fee7be696aa', 'volume_name': 'volume-24444b32-392d-454b-9e29-9fee7be696aa', 'volume_size': 1, 'image_id': '25422115-5981-48d3-a7b2-1de0cd99b66c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25422115-5981-48d3-a7b2-1de0cd99b66c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '048475ed7e3f73af7a7372fdc6356094', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1de702676a3a46cca53abd3c64595ef4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6c3c52f1fd4cf1793f45d489c02af95787f801ffa1b47ebcd46758d58512b7fc935971a7a14fc84269f66e419d7b6968cfa2adad57f2b18e8ecbda22dc302dae', 'id': '25422115-5981-48d3-a7b2-1de0cd99b66c', 'created_at': datetime.datetime(2026, 11, 6, 17, 3, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 17, 3, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25422115-5981-48d3-a7b2-1de0cd99b66c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9cc09c8-2872-4158-a2d0-30ca4546bc32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9cc09c8-2872-4158-a2d0-30ca4546bc32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (172b88d4-c72d-4e22-9564-21af10078b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:13 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Volume 24444b32-392d-454b-9e29-9fee7be696aa: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-24444b32-392d-454b-9e29-9fee7be696aa', 'volume_size': 1, 'image_id': '25422115-5981-48d3-a7b2-1de0cd99b66c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25422115-5981-48d3-a7b2-1de0cd99b66c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '048475ed7e3f73af7a7372fdc6356094', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1de702676a3a46cca53abd3c64595ef4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6c3c52f1fd4cf1793f45d489c02af95787f801ffa1b47ebcd46758d58512b7fc935971a7a14fc84269f66e419d7b6968cfa2adad57f2b18e8ecbda22dc302dae', 'id': '25422115-5981-48d3-a7b2-1de0cd99b66c', 'created_at': datetime.datetime(2026, 11, 6, 17, 3, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 17, 3, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25422115-5981-48d3-a7b2-1de0cd99b66c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 06 18:03:13 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Trying to clone 24444b32-392d-454b-9e29-9fee7be696aa from image 25422115-5981-48d3-a7b2-1de0cd99b66c at location (None, [{'url': 'file:///opt/stack/data/glance/images/25422115-5981-48d3-a7b2-1de0cd99b66c', 'metadata': {}}]). {{(pid=87068) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 18:03:13 devstack sudo[104694]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-da3df4a5-1961-4365-90ce-2235d276bc60 tempest-CreateVolumesFromImageTest-228325488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8f773070-492f-4b99-a52c-60d6cd41ae68 1073741824" returned: 0 in 0.559s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:13 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_25422115-5981-48d3-a7b2-1de0cd99b66c_n5t3wo03devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87068) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 06 18:03:13 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Image download 0.00 MB at 0.00 MB/s Nov 06 18:03:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-da3df4a5-1961-4365-90ce-2235d276bc60 tempest-CreateVolumesFromImageTest-228325488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8f773070-492f-4b99-a52c-60d6cd41ae68 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:13 devstack sudo[104699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8f773070-492f-4b99-a52c-60d6cd41ae68 Nov 06 18:03:13 devstack sudo[104699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:13 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e4531c-18de-4410-839d-725d89eb6e5b]: (4, 'raw') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:03:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_25422115-5981-48d3-a7b2-1de0cd99b66c_n5t3wo03devstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:13 devstack sudo[104701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_25422115-5981-48d3-a7b2-1de0cd99b66c_n5t3wo03devstack@QuobyteHD Nov 06 18:03:13 devstack sudo[104701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:14 devstack sudo[104699]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-da3df4a5-1961-4365-90ce-2235d276bc60 tempest-CreateVolumesFromImageTest-228325488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8f773070-492f-4b99-a52c-60d6cd41ae68" returned: 0 in 0.272s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-da3df4a5-1961-4365-90ce-2235d276bc60 tempest-CreateVolumesFromImageTest-228325488 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:03:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-da3df4a5-1961-4365-90ce-2235d276bc60 tempest-CreateVolumesFromImageTest-228325488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7040bc7f-5391-4c48-a2ce-c009b9becea0 tempest-ProjectMemberTests-819176810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.228s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7040bc7f-5391-4c48-a2ce-c009b9becea0 tempest-ProjectMemberTests-819176810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1201889493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92a1b7d6-0bcc-4e4f-bb47-cb8a92301504,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b97cd7ef94764995a9e8c62cda23171f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:03:11Z,use_quota=True,user_id='a34e6465a98c4c289547d49a900a6bde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:03:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-7040bc7f-5391-4c48-a2ce-c009b9becea0 tempest-ProjectMemberTests-819176810 None] Creating volume 92a1b7d6-0bcc-4e4f-bb47-cb8a92301504 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:03:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7040bc7f-5391-4c48-a2ce-c009b9becea0 tempest-ProjectMemberTests-819176810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7040bc7f-5391-4c48-a2ce-c009b9becea0 tempest-ProjectMemberTests-819176810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7040bc7f-5391-4c48-a2ce-c009b9becea0 tempest-ProjectMemberTests-819176810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:03:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7040bc7f-5391-4c48-a2ce-c009b9becea0 tempest-ProjectMemberTests-819176810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:03:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7040bc7f-5391-4c48-a2ce-c009b9becea0 tempest-ProjectMemberTests-819176810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7040bc7f-5391-4c48-a2ce-c009b9becea0 tempest-ProjectMemberTests-819176810 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:03:14 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-7040bc7f-5391-4c48-a2ce-c009b9becea0 tempest-ProjectMemberTests-819176810 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:03:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7040bc7f-5391-4c48-a2ce-c009b9becea0 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-da3df4a5-1961-4365-90ce-2235d276bc60 tempest-CreateVolumesFromImageTest-228325488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (568331bd-f5c8-4f19-bbb9-f0c29fa2def5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f773070-492f-4b99-a52c-60d6cd41ae68', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:14 devstack sudo[104704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504 1073741824 Nov 06 18:03:14 devstack sudo[104704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-da3df4a5-1961-4365-90ce-2235d276bc60 tempest-CreateVolumesFromImageTest-228325488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f97ed34-16eb-4839-9db5-1c1e80dd9b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:14 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-da3df4a5-1961-4365-90ce-2235d276bc60 tempest-CreateVolumesFromImageTest-228325488 None] Volume volume-8f773070-492f-4b99-a52c-60d6cd41ae68 (8f773070-492f-4b99-a52c-60d6cd41ae68): created successfully Nov 06 18:03:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-da3df4a5-1961-4365-90ce-2235d276bc60 tempest-CreateVolumesFromImageTest-228325488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f97ed34-16eb-4839-9db5-1c1e80dd9b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-da3df4a5-1961-4365-90ce-2235d276bc60 tempest-CreateVolumesFromImageTest-228325488 None] Flow 'volume_create_manager' (60b59725-96c0-4867-919d-15bbd893be0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:03:14 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-da3df4a5-1961-4365-90ce-2235d276bc60 tempest-CreateVolumesFromImageTest-228325488 None] Created volume successfully. Nov 06 18:03:14 devstack sudo[104701]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_25422115-5981-48d3-a7b2-1de0cd99b66c_n5t3wo03devstack@QuobyteHD" returned: 0 in 0.370s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25422115-5981-48d3-a7b2-1de0cd99b66c_n5t3wo03devstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:14 devstack sudo[104708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25422115-5981-48d3-a7b2-1de0cd99b66c_n5t3wo03devstack@QuobyteHD Nov 06 18:03:14 devstack sudo[104708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:14 devstack sudo[104708]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25422115-5981-48d3-a7b2-1de0cd99b66c_n5t3wo03devstack@QuobyteHD" returned: 1 in 0.355s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25422115-5981-48d3-a7b2-1de0cd99b66c_n5t3wo03devstack@QuobyteHD' failed. Not Retrying. {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 18:03:14 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Temporary image 25422115-5981-48d3-a7b2-1de0cd99b66c is fetched for user 1cec33fb3e074f73a578488512799dd5. {{(pid=87068) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 06 18:03:14 devstack sudo[104704]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7040bc7f-5391-4c48-a2ce-c009b9becea0 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504 1073741824" returned: 0 in 0.481s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7040bc7f-5391-4c48-a2ce-c009b9becea0 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:14 devstack sudo[104718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504 Nov 06 18:03:14 devstack sudo[104718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:14 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9de762b-60ba-44bd-b968-a704ef85aaec]: (4, 'raw') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:03:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_25422115-5981-48d3-a7b2-1de0cd99b66c_n5t3wo03devstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:14 devstack sudo[104720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_25422115-5981-48d3-a7b2-1de0cd99b66c_n5t3wo03devstack@QuobyteHD Nov 06 18:03:14 devstack sudo[104720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:14 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-0467407e-311e-4ea2-ae4b-7939b0b48bc2 tempest-CreateVolumesFromImageTest-228325488 None] Acquiring lock "cinder-8f773070-492f-4b99-a52c-60d6cd41ae68-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:03:14 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-0467407e-311e-4ea2-ae4b-7939b0b48bc2 tempest-CreateVolumesFromImageTest-228325488 None] Lock "cinder-8f773070-492f-4b99-a52c-60d6cd41ae68-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:03:14 devstack sudo[104718]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7040bc7f-5391-4c48-a2ce-c009b9becea0 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504" returned: 0 in 0.279s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7040bc7f-5391-4c48-a2ce-c009b9becea0 tempest-ProjectMemberTests-819176810 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:03:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7040bc7f-5391-4c48-a2ce-c009b9becea0 tempest-ProjectMemberTests-819176810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d5c9f8dd-6038-4060-85c8-125fa8b11f0d tempest-VolumeDependencyTests-535782399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.239s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7040bc7f-5391-4c48-a2ce-c009b9becea0 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8027ce8-9f0a-4f66-9543-3bc4df010b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7040bc7f-5391-4c48-a2ce-c009b9becea0 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c775675-dfde-44f8-b4cf-b40ca87d140f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-d5c9f8dd-6038-4060-85c8-125fa8b11f0d tempest-VolumeDependencyTests-535782399 None] Creating offline snapshot 76a316bf-a082-4468-b71e-df2b787a152d of volume 7aa09fe7-4865-42f0-b514-6a2402eb2d69 {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:03:14 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-7040bc7f-5391-4c48-a2ce-c009b9becea0 tempest-ProjectMemberTests-819176810 None] Volume volume-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504 (92a1b7d6-0bcc-4e4f-bb47-cb8a92301504): created successfully Nov 06 18:03:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7040bc7f-5391-4c48-a2ce-c009b9becea0 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c775675-dfde-44f8-b4cf-b40ca87d140f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7040bc7f-5391-4c48-a2ce-c009b9becea0 tempest-ProjectMemberTests-819176810 None] Flow 'volume_create_manager' (52865b09-3a83-4861-9067-8a30289a1bf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:03:14 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeba5d87-c90f-43e0-8d9a-5358b0653d18]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:03:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d5c9f8dd-6038-4060-85c8-125fa8b11f0d tempest-VolumeDependencyTests-535782399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:14 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-0467407e-311e-4ea2-ae4b-7939b0b48bc2 tempest-CreateVolumesFromImageTest-228325488 None] Acquiring lock "cinder-quobyte-8f773070-492f-4b99-a52c-60d6cd41ae68" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:03:14 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-0467407e-311e-4ea2-ae4b-7939b0b48bc2 tempest-CreateVolumesFromImageTest-228325488 None] Lock "cinder-quobyte-8f773070-492f-4b99-a52c-60d6cd41ae68" acquired by "delete_volume" :: waited 0.023s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:03:14 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-7040bc7f-5391-4c48-a2ce-c009b9becea0 tempest-ProjectMemberTests-819176810 None] Created volume successfully. Nov 06 18:03:14 devstack sudo[104720]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_25422115-5981-48d3-a7b2-1de0cd99b66c_n5t3wo03devstack@QuobyteHD" returned: 0 in 0.388s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25422115-5981-48d3-a7b2-1de0cd99b66c_n5t3wo03devstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:15 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0636ea3d-1e44-4e00-8943-539ab1dae7e1]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:03:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0467407e-311e-4ea2-ae4b-7939b0b48bc2 tempest-CreateVolumesFromImageTest-228325488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8f773070-492f-4b99-a52c-60d6cd41ae68 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:15 devstack sudo[104723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69 Nov 06 18:03:15 devstack sudo[104723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:15 devstack sudo[104726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25422115-5981-48d3-a7b2-1de0cd99b66c_n5t3wo03devstack@QuobyteHD Nov 06 18:03:15 devstack sudo[104726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:15 devstack sudo[104727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8f773070-492f-4b99-a52c-60d6cd41ae68 Nov 06 18:03:15 devstack sudo[104727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:15 devstack sudo[104723]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d5c9f8dd-6038-4060-85c8-125fa8b11f0d tempest-VolumeDependencyTests-535782399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69" returned: 0 in 0.408s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d5c9f8dd-6038-4060-85c8-125fa8b11f0d tempest-VolumeDependencyTests-535782399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69.76a316bf-a082-4468-b71e-df2b787a152d 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:15 devstack sudo[104726]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25422115-5981-48d3-a7b2-1de0cd99b66c_n5t3wo03devstack@QuobyteHD" returned: 1 in 0.357s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25422115-5981-48d3-a7b2-1de0cd99b66c_n5t3wo03devstack@QuobyteHD' failed. Not Retrying. {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 18:03:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:15 devstack sudo[104739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69.76a316bf-a082-4468-b71e-df2b787a152d 1G Nov 06 18:03:15 devstack sudo[104739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:15 devstack sudo[104727]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0467407e-311e-4ea2-ae4b-7939b0b48bc2 tempest-CreateVolumesFromImageTest-228325488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8f773070-492f-4b99-a52c-60d6cd41ae68" returned: 0 in 0.403s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0467407e-311e-4ea2-ae4b-7939b0b48bc2 tempest-CreateVolumesFromImageTest-228325488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8f773070-492f-4b99-a52c-60d6cd41ae68 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:15 devstack sudo[104742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8f773070-492f-4b99-a52c-60d6cd41ae68 Nov 06 18:03:15 devstack sudo[104742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:15 devstack sudo[104742]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0467407e-311e-4ea2-ae4b-7939b0b48bc2 tempest-CreateVolumesFromImageTest-228325488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-8f773070-492f-4b99-a52c-60d6cd41ae68" returned: 0 in 0.272s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:15 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-0467407e-311e-4ea2-ae4b-7939b0b48bc2 tempest-CreateVolumesFromImageTest-228325488 None] Lock "cinder-quobyte-8f773070-492f-4b99-a52c-60d6cd41ae68" released by "delete_volume" :: held 0.752s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:03:15 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-0467407e-311e-4ea2-ae4b-7939b0b48bc2 tempest-CreateVolumesFromImageTest-228325488 None] Created reservations ['125f9466-ec70-42b3-87c4-1bfef95cd664', '954687e7-94da-4cf8-8c8a-d8e82f2e3395', 'b1e2d0ed-a6e7-444c-a545-790a4d2fe105', '39bf9a4f-e0a0-4622-adc9-81252a63343f'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:03:15 devstack sudo[104739]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d5c9f8dd-6038-4060-85c8-125fa8b11f0d tempest-VolumeDependencyTests-535782399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69.76a316bf-a082-4468-b71e-df2b787a152d 1G" returned: 0 in 0.453s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d5c9f8dd-6038-4060-85c8-125fa8b11f0d tempest-VolumeDependencyTests-535782399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69.76a316bf-a082-4468-b71e-df2b787a152d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:15 devstack sudo[104749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69.76a316bf-a082-4468-b71e-df2b787a152d Nov 06 18:03:15 devstack sudo[104749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0467407e-311e-4ea2-ae4b-7939b0b48bc2 tempest-CreateVolumesFromImageTest-228325488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0467407e-311e-4ea2-ae4b-7939b0b48bc2 tempest-CreateVolumesFromImageTest-228325488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:15 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0467407e-311e-4ea2-ae4b-7939b0b48bc2 tempest-CreateVolumesFromImageTest-228325488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:03:15 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0467407e-311e-4ea2-ae4b-7939b0b48bc2 tempest-CreateVolumesFromImageTest-228325488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:03:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0467407e-311e-4ea2-ae4b-7939b0b48bc2 tempest-CreateVolumesFromImageTest-228325488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0467407e-311e-4ea2-ae4b-7939b0b48bc2 tempest-CreateVolumesFromImageTest-228325488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:15 devstack sudo[104751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:03:15 devstack sudo[104751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:16 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-87a98e9b-83a8-47c4-9208-07b3ad147764 tempest-CreateVolumesFromImageTest-228325488 None] Acquiring lock "cinder-5e6e0450-a0cb-40ac-ac0b-173329aa4285-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:03:16 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-87a98e9b-83a8-47c4-9208-07b3ad147764 tempest-CreateVolumesFromImageTest-228325488 None] Lock "cinder-5e6e0450-a0cb-40ac-ac0b-173329aa4285-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:03:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-042643d6-18eb-4a25-85b5-42af3e57dbf1 tempest-ProjectMemberTests-819176810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:16 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-87a98e9b-83a8-47c4-9208-07b3ad147764 tempest-CreateVolumesFromImageTest-228325488 None] Acquiring lock "cinder-quobyte-5e6e0450-a0cb-40ac-ac0b-173329aa4285" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:03:16 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-87a98e9b-83a8-47c4-9208-07b3ad147764 tempest-CreateVolumesFromImageTest-228325488 None] Lock "cinder-quobyte-5e6e0450-a0cb-40ac-ac0b-173329aa4285" acquired by "delete_volume" :: waited 0.021s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:03:16 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c134432-5d3c-423a-abbc-b2749594d634]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:03:16 devstack sudo[104749]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-87a98e9b-83a8-47c4-9208-07b3ad147764 tempest-CreateVolumesFromImageTest-228325488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5e6e0450-a0cb-40ac-ac0b-173329aa4285 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d5c9f8dd-6038-4060-85c8-125fa8b11f0d tempest-VolumeDependencyTests-535782399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69.76a316bf-a082-4468-b71e-df2b787a152d" returned: 0 in 0.400s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:16 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-d5c9f8dd-6038-4060-85c8-125fa8b11f0d tempest-VolumeDependencyTests-535782399 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69.76a316bf-a082-4468-b71e-df2b787a152d is being set with open permissions: ugo+rw Nov 06 18:03:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d5c9f8dd-6038-4060-85c8-125fa8b11f0d tempest-VolumeDependencyTests-535782399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69.76a316bf-a082-4468-b71e-df2b787a152d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:16 devstack sudo[104751]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0467407e-311e-4ea2-ae4b-7939b0b48bc2 tempest-CreateVolumesFromImageTest-228325488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.349s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:16 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-0467407e-311e-4ea2-ae4b-7939b0b48bc2 tempest-CreateVolumesFromImageTest-228325488 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:03:16 devstack sudo[104758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69.76a316bf-a082-4468-b71e-df2b787a152d Nov 06 18:03:16 devstack sudo[104758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:16 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-0467407e-311e-4ea2-ae4b-7939b0b48bc2 tempest-CreateVolumesFromImageTest-228325488 None] Deleted volume successfully. Nov 06 18:03:16 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-0467407e-311e-4ea2-ae4b-7939b0b48bc2 tempest-CreateVolumesFromImageTest-228325488 None] Lock "cinder-8f773070-492f-4b99-a52c-60d6cd41ae68-delete_volume" released by "delete_volume" :: held 1.418s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:03:16 devstack sudo[104757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5e6e0450-a0cb-40ac-ac0b-173329aa4285 Nov 06 18:03:16 devstack sudo[104757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:16 devstack sudo[104758]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d5c9f8dd-6038-4060-85c8-125fa8b11f0d tempest-VolumeDependencyTests-535782399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69.76a316bf-a082-4468-b71e-df2b787a152d" returned: 0 in 0.266s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d5c9f8dd-6038-4060-85c8-125fa8b11f0d tempest-VolumeDependencyTests-535782399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:16 devstack sudo[104764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69.info Nov 06 18:03:16 devstack sudo[104764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:16 devstack sudo[104757]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-87a98e9b-83a8-47c4-9208-07b3ad147764 tempest-CreateVolumesFromImageTest-228325488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5e6e0450-a0cb-40ac-ac0b-173329aa4285" returned: 0 in 0.393s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-87a98e9b-83a8-47c4-9208-07b3ad147764 tempest-CreateVolumesFromImageTest-228325488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5e6e0450-a0cb-40ac-ac0b-173329aa4285 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:16 devstack sudo[104767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5e6e0450-a0cb-40ac-ac0b-173329aa4285 Nov 06 18:03:16 devstack sudo[104767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:16 devstack sudo[104764]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d5c9f8dd-6038-4060-85c8-125fa8b11f0d tempest-VolumeDependencyTests-535782399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69.info" returned: 0 in 0.273s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:16 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-d5c9f8dd-6038-4060-85c8-125fa8b11f0d tempest-VolumeDependencyTests-535782399 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69.info is being set with open permissions: ugo+rw Nov 06 18:03:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d5c9f8dd-6038-4060-85c8-125fa8b11f0d tempest-VolumeDependencyTests-535782399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:16 devstack sudo[104770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69.info Nov 06 18:03:16 devstack sudo[104770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:16 devstack sudo[104767]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-87a98e9b-83a8-47c4-9208-07b3ad147764 tempest-CreateVolumesFromImageTest-228325488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-5e6e0450-a0cb-40ac-ac0b-173329aa4285" returned: 0 in 0.264s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:16 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-87a98e9b-83a8-47c4-9208-07b3ad147764 tempest-CreateVolumesFromImageTest-228325488 None] Lock "cinder-quobyte-5e6e0450-a0cb-40ac-ac0b-173329aa4285" released by "delete_volume" :: held 0.712s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:03:16 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-87a98e9b-83a8-47c4-9208-07b3ad147764 tempest-CreateVolumesFromImageTest-228325488 None] Created reservations ['b472b59a-fcf0-4ddd-91a1-291cf84ed8d1', '0e0791da-2614-42e8-ae72-9f545efafb2d', '2305c258-ff0f-4156-aaa5-46ffc99438a7', 'e254a82f-e567-4c15-ad01-3706ce979e4f'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:03:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-87a98e9b-83a8-47c4-9208-07b3ad147764 tempest-CreateVolumesFromImageTest-228325488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-87a98e9b-83a8-47c4-9208-07b3ad147764 tempest-CreateVolumesFromImageTest-228325488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-87a98e9b-83a8-47c4-9208-07b3ad147764 tempest-CreateVolumesFromImageTest-228325488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:03:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-87a98e9b-83a8-47c4-9208-07b3ad147764 tempest-CreateVolumesFromImageTest-228325488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:03:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-87a98e9b-83a8-47c4-9208-07b3ad147764 tempest-CreateVolumesFromImageTest-228325488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-87a98e9b-83a8-47c4-9208-07b3ad147764 tempest-CreateVolumesFromImageTest-228325488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:17 devstack sudo[104774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:03:17 devstack sudo[104774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:17 devstack sudo[104770]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d5c9f8dd-6038-4060-85c8-125fa8b11f0d tempest-VolumeDependencyTests-535782399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69.info" returned: 0 in 0.266s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d5c9f8dd-6038-4060-85c8-125fa8b11f0d tempest-VolumeDependencyTests-535782399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.207s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.705s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:03:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24444b32-392d-454b-9e29-9fee7be696aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1de702676a3a46cca53abd3c64595ef4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:03:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:03:13Z,use_quota=True,user_id='1cec33fb3e074f73a578488512799dd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f4775ae8-60bb-4a07-93be-0aedd763aacb),volume_type_id=f4775ae8-60bb-4a07-93be-0aedd763aacb)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:03:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Creating volume 24444b32-392d-454b-9e29-9fee7be696aa {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:03:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:03:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:03:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:03:17 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:03:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-24444b32-392d-454b-9e29-9fee7be696aa 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:17 devstack sudo[104776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-24444b32-392d-454b-9e29-9fee7be696aa 1073741824 Nov 06 18:03:17 devstack sudo[104776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:17 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-d5c9f8dd-6038-4060-85c8-125fa8b11f0d tempest-VolumeDependencyTests-535782399 None] Create snapshot completed successfully Nov 06 18:03:17 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2e1ededf-5982-4394-b3eb-ed122d8de5dd tempest-CreateVolumesFromImageTest-228325488 None] Acquiring lock "cinder-a2f719e5-f586-4521-b51b-74bd9b58f818-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:03:17 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2e1ededf-5982-4394-b3eb-ed122d8de5dd tempest-CreateVolumesFromImageTest-228325488 None] Lock "cinder-a2f719e5-f586-4521-b51b-74bd9b58f818-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:03:17 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2e1ededf-5982-4394-b3eb-ed122d8de5dd tempest-CreateVolumesFromImageTest-228325488 None] Acquiring lock "cinder-quobyte-a2f719e5-f586-4521-b51b-74bd9b58f818" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:03:17 devstack sudo[104774]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-87a98e9b-83a8-47c4-9208-07b3ad147764 tempest-CreateVolumesFromImageTest-228325488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.293s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:17 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-87a98e9b-83a8-47c4-9208-07b3ad147764 tempest-CreateVolumesFromImageTest-228325488 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:03:17 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-87a98e9b-83a8-47c4-9208-07b3ad147764 tempest-CreateVolumesFromImageTest-228325488 None] Deleted volume successfully. Nov 06 18:03:17 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2e1ededf-5982-4394-b3eb-ed122d8de5dd tempest-CreateVolumesFromImageTest-228325488 None] Lock "cinder-quobyte-a2f719e5-f586-4521-b51b-74bd9b58f818" acquired by "delete_volume" :: waited 0.023s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:03:17 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-87a98e9b-83a8-47c4-9208-07b3ad147764 tempest-CreateVolumesFromImageTest-228325488 None] Lock "cinder-5e6e0450-a0cb-40ac-ac0b-173329aa4285-delete_volume" released by "delete_volume" :: held 1.256s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:03:17 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ad705d-3f64-4dba-bbfe-ab5209725b1f]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:03:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2e1ededf-5982-4394-b3eb-ed122d8de5dd tempest-CreateVolumesFromImageTest-228325488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a2f719e5-f586-4521-b51b-74bd9b58f818 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:17 devstack sudo[104783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a2f719e5-f586-4521-b51b-74bd9b58f818 Nov 06 18:03:17 devstack sudo[104783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:17 devstack sudo[104776]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-24444b32-392d-454b-9e29-9fee7be696aa 1073741824" returned: 0 in 0.501s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-24444b32-392d-454b-9e29-9fee7be696aa {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:17 devstack sudo[104785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-24444b32-392d-454b-9e29-9fee7be696aa Nov 06 18:03:17 devstack sudo[104785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:17 devstack sudo[104783]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2e1ededf-5982-4394-b3eb-ed122d8de5dd tempest-CreateVolumesFromImageTest-228325488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a2f719e5-f586-4521-b51b-74bd9b58f818" returned: 0 in 0.416s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2e1ededf-5982-4394-b3eb-ed122d8de5dd tempest-CreateVolumesFromImageTest-228325488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a2f719e5-f586-4521-b51b-74bd9b58f818 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:17 devstack sudo[104790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a2f719e5-f586-4521-b51b-74bd9b58f818 Nov 06 18:03:17 devstack sudo[104790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:17 devstack sudo[104785]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-24444b32-392d-454b-9e29-9fee7be696aa" returned: 0 in 0.275s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:03:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-042643d6-18eb-4a25-85b5-42af3e57dbf1 tempest-ProjectMemberTests-819176810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.797s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-042643d6-18eb-4a25-85b5-42af3e57dbf1 tempest-ProjectMemberTests-819176810 None] Creating offline snapshot b30ab300-13aa-4a65-b5c4-eeb10be2e090 of volume 92a1b7d6-0bcc-4e4f-bb47-cb8a92301504 {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:03:17 devstack cinder-volume[87068]: DEBUG cinder.volume.volume_utils [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Attempting download of 25422115-5981-48d3-a7b2-1de0cd99b66c ((None, [{'url': 'file:///opt/stack/data/glance/images/25422115-5981-48d3-a7b2-1de0cd99b66c', 'metadata': {}}])) to volume 24444b32-392d-454b-9e29-9fee7be696aa. {{(pid=87068) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 18:03:17 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[078bf7b4-3406-482d-984e-302022a19b02]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:03:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-042643d6-18eb-4a25-85b5-42af3e57dbf1 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:18 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d33fc9-a346-4dc0-a83a-1c3bcae20094]: (4, 'raw') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:03:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25422115-5981-48d3-a7b2-1de0cd99b66c_xx97rto3 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:18 devstack sudo[104790]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2e1ededf-5982-4394-b3eb-ed122d8de5dd tempest-CreateVolumesFromImageTest-228325488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a2f719e5-f586-4521-b51b-74bd9b58f818" returned: 0 in 0.303s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:18 devstack sudo[104793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504 Nov 06 18:03:18 devstack sudo[104793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:18 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2e1ededf-5982-4394-b3eb-ed122d8de5dd tempest-CreateVolumesFromImageTest-228325488 None] Lock "cinder-quobyte-a2f719e5-f586-4521-b51b-74bd9b58f818" released by "delete_volume" :: held 0.783s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:03:18 devstack sudo[104795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25422115-5981-48d3-a7b2-1de0cd99b66c_xx97rto3 Nov 06 18:03:18 devstack sudo[104795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:18 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-2e1ededf-5982-4394-b3eb-ed122d8de5dd tempest-CreateVolumesFromImageTest-228325488 None] Created reservations ['91381e91-b4f5-463e-9424-687159943f8b', '31df34ca-1065-4a7e-92d3-b39cf6d85cb5', 'a1c0e8ad-78de-4454-aac9-3ec6bf3d5e2a', '2105ba8b-4e30-4f98-bbfa-e48c749a0527'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:03:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2e1ededf-5982-4394-b3eb-ed122d8de5dd tempest-CreateVolumesFromImageTest-228325488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2e1ededf-5982-4394-b3eb-ed122d8de5dd tempest-CreateVolumesFromImageTest-228325488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:18 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2e1ededf-5982-4394-b3eb-ed122d8de5dd tempest-CreateVolumesFromImageTest-228325488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:03:18 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2e1ededf-5982-4394-b3eb-ed122d8de5dd tempest-CreateVolumesFromImageTest-228325488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:03:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2e1ededf-5982-4394-b3eb-ed122d8de5dd tempest-CreateVolumesFromImageTest-228325488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2e1ededf-5982-4394-b3eb-ed122d8de5dd tempest-CreateVolumesFromImageTest-228325488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:18 devstack sudo[104798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:03:18 devstack sudo[104798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:18 devstack sudo[104793]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-042643d6-18eb-4a25-85b5-42af3e57dbf1 tempest-ProjectMemberTests-819176810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504" returned: 0 in 0.481s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-042643d6-18eb-4a25-85b5-42af3e57dbf1 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504.b30ab300-13aa-4a65-b5c4-eeb10be2e090 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:18 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b51007d9-fbf5-466e-a709-d60c769eb012 tempest-CreateVolumesFromImageTest-228325488 None] Acquiring lock "cinder-ab78cbf7-2a14-4bf0-b563-7964fa4d2a79-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:03:18 devstack sudo[104805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504.b30ab300-13aa-4a65-b5c4-eeb10be2e090 1G Nov 06 18:03:18 devstack sudo[104805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:18 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b51007d9-fbf5-466e-a709-d60c769eb012 tempest-CreateVolumesFromImageTest-228325488 None] Lock "cinder-ab78cbf7-2a14-4bf0-b563-7964fa4d2a79-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:03:18 devstack sudo[104795]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25422115-5981-48d3-a7b2-1de0cd99b66c_xx97rto3" returned: 0 in 0.515s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25422115-5981-48d3-a7b2-1de0cd99b66c_xx97rto3 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:18 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b51007d9-fbf5-466e-a709-d60c769eb012 tempest-CreateVolumesFromImageTest-228325488 None] Acquiring lock "cinder-quobyte-ab78cbf7-2a14-4bf0-b563-7964fa4d2a79" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:03:18 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-cae5cadc-dfc4-45de-90cc-12e7b5fa889a tempest-VolumeDependencyTests-535782399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:03:18 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b51007d9-fbf5-466e-a709-d60c769eb012 tempest-CreateVolumesFromImageTest-228325488 None] Lock "cinder-quobyte-ab78cbf7-2a14-4bf0-b563-7964fa4d2a79" acquired by "delete_volume" :: waited 0.037s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:03:18 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2ce329-19df-47a4-9e44-1630a7d43de7]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:03:18 devstack sudo[104807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25422115-5981-48d3-a7b2-1de0cd99b66c_xx97rto3 Nov 06 18:03:18 devstack sudo[104807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:18 devstack sudo[104798]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cae5cadc-dfc4-45de-90cc-12e7b5fa889a tempest-VolumeDependencyTests-535782399 None] Flow 'volume_create_manager' (510ce793-6c93-4ad5-b5d3-3ad9641b7fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:03:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cae5cadc-dfc4-45de-90cc-12e7b5fa889a tempest-VolumeDependencyTests-535782399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bbd628b-eddf-41ff-a3c8-16af42122fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b51007d9-fbf5-466e-a709-d60c769eb012 tempest-CreateVolumesFromImageTest-228325488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ab78cbf7-2a14-4bf0-b563-7964fa4d2a79 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2e1ededf-5982-4394-b3eb-ed122d8de5dd tempest-CreateVolumesFromImageTest-228325488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.486s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:18 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-2e1ededf-5982-4394-b3eb-ed122d8de5dd tempest-CreateVolumesFromImageTest-228325488 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:03:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cae5cadc-dfc4-45de-90cc-12e7b5fa889a tempest-VolumeDependencyTests-535782399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bbd628b-eddf-41ff-a3c8-16af42122fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-459431253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35f68221-25eb-4945-a2ad-78a30a00ffb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5254ce269ffd4bb5ba45f32c2b4c562d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:03:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=76a316bf-a082-4468-b71e-df2b787a152d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:03:19Z,use_quota=True,user_id='e82da70cb0594cb983990b3797db6e0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cae5cadc-dfc4-45de-90cc-12e7b5fa889a tempest-VolumeDependencyTests-535782399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (034ee7fb-8c20-4619-a42b-d8c18bf40c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cae5cadc-dfc4-45de-90cc-12e7b5fa889a tempest-VolumeDependencyTests-535782399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (034ee7fb-8c20-4619-a42b-d8c18bf40c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cae5cadc-dfc4-45de-90cc-12e7b5fa889a tempest-VolumeDependencyTests-535782399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7c9b7b9-d1ea-43c4-b036-b33c73bdf02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cae5cadc-dfc4-45de-90cc-12e7b5fa889a tempest-VolumeDependencyTests-535782399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7c9b7b9-d1ea-43c4-b036-b33c73bdf02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '35f68221-25eb-4945-a2ad-78a30a00ffb0', 'volume_name': 'volume-35f68221-25eb-4945-a2ad-78a30a00ffb0', 'volume_size': 1, 'snapshot_id': '76a316bf-a082-4468-b71e-df2b787a152d'}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cae5cadc-dfc4-45de-90cc-12e7b5fa889a tempest-VolumeDependencyTests-535782399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04d2bd4c-2451-4615-97e9-c90f9aecedc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cae5cadc-dfc4-45de-90cc-12e7b5fa889a tempest-VolumeDependencyTests-535782399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04d2bd4c-2451-4615-97e9-c90f9aecedc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cae5cadc-dfc4-45de-90cc-12e7b5fa889a tempest-VolumeDependencyTests-535782399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0190171c-148a-49f0-808d-95ae8e4db3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:18 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-cae5cadc-dfc4-45de-90cc-12e7b5fa889a tempest-VolumeDependencyTests-535782399 None] Volume 35f68221-25eb-4945-a2ad-78a30a00ffb0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-35f68221-25eb-4945-a2ad-78a30a00ffb0', 'volume_size': 1, 'snapshot_id': '76a316bf-a082-4468-b71e-df2b787a152d'} Nov 06 18:03:18 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-2e1ededf-5982-4394-b3eb-ed122d8de5dd tempest-CreateVolumesFromImageTest-228325488 None] Deleted volume successfully. Nov 06 18:03:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cae5cadc-dfc4-45de-90cc-12e7b5fa889a tempest-VolumeDependencyTests-535782399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:18 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2e1ededf-5982-4394-b3eb-ed122d8de5dd tempest-CreateVolumesFromImageTest-228325488 None] Lock "cinder-a2f719e5-f586-4521-b51b-74bd9b58f818-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:03:18 devstack sudo[104810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ab78cbf7-2a14-4bf0-b563-7964fa4d2a79 Nov 06 18:03:18 devstack sudo[104810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:18 devstack sudo[104807]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25422115-5981-48d3-a7b2-1de0cd99b66c_xx97rto3" returned: 1 in 0.410s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25422115-5981-48d3-a7b2-1de0cd99b66c_xx97rto3' failed. Not Retrying. {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 18:03:18 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95d2cc1-63d4-44d4-b97d-db6aa6cfc3aa]: (4, 'raw') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:03:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_25422115-5981-48d3-a7b2-1de0cd99b66c_n5t3wo03devstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:19 devstack sudo[104805]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-042643d6-18eb-4a25-85b5-42af3e57dbf1 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504.b30ab300-13aa-4a65-b5c4-eeb10be2e090 1G" returned: 0 in 0.590s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-042643d6-18eb-4a25-85b5-42af3e57dbf1 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504.b30ab300-13aa-4a65-b5c4-eeb10be2e090 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:19 devstack sudo[104819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504.b30ab300-13aa-4a65-b5c4-eeb10be2e090 Nov 06 18:03:19 devstack sudo[104819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:19 devstack sudo[104817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_25422115-5981-48d3-a7b2-1de0cd99b66c_n5t3wo03devstack@QuobyteHD Nov 06 18:03:19 devstack sudo[104817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:19 devstack sudo[104810]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b51007d9-fbf5-466e-a709-d60c769eb012 tempest-CreateVolumesFromImageTest-228325488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ab78cbf7-2a14-4bf0-b563-7964fa4d2a79" returned: 0 in 0.441s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b51007d9-fbf5-466e-a709-d60c769eb012 tempest-CreateVolumesFromImageTest-228325488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ab78cbf7-2a14-4bf0-b563-7964fa4d2a79 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:19 devstack sudo[104825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ab78cbf7-2a14-4bf0-b563-7964fa4d2a79 Nov 06 18:03:19 devstack sudo[104825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:19 devstack sudo[104817]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_25422115-5981-48d3-a7b2-1de0cd99b66c_n5t3wo03devstack@QuobyteHD" returned: 0 in 0.350s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25422115-5981-48d3-a7b2-1de0cd99b66c_n5t3wo03devstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:19 devstack sudo[104819]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-042643d6-18eb-4a25-85b5-42af3e57dbf1 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504.b30ab300-13aa-4a65-b5c4-eeb10be2e090" returned: 0 in 0.351s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:19 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-042643d6-18eb-4a25-85b5-42af3e57dbf1 tempest-ProjectMemberTests-819176810 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504.b30ab300-13aa-4a65-b5c4-eeb10be2e090 is being set with open permissions: ugo+rw Nov 06 18:03:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-042643d6-18eb-4a25-85b5-42af3e57dbf1 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504.b30ab300-13aa-4a65-b5c4-eeb10be2e090 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:19 devstack sudo[104834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504.b30ab300-13aa-4a65-b5c4-eeb10be2e090 Nov 06 18:03:19 devstack sudo[104834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:19 devstack sudo[104831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25422115-5981-48d3-a7b2-1de0cd99b66c_n5t3wo03devstack@QuobyteHD Nov 06 18:03:19 devstack sudo[104831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:19 devstack sudo[104825]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b51007d9-fbf5-466e-a709-d60c769eb012 tempest-CreateVolumesFromImageTest-228325488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ab78cbf7-2a14-4bf0-b563-7964fa4d2a79" returned: 0 in 0.289s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:19 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b51007d9-fbf5-466e-a709-d60c769eb012 tempest-CreateVolumesFromImageTest-228325488 None] Lock "cinder-quobyte-ab78cbf7-2a14-4bf0-b563-7964fa4d2a79" released by "delete_volume" :: held 0.836s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:03:19 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-b51007d9-fbf5-466e-a709-d60c769eb012 tempest-CreateVolumesFromImageTest-228325488 None] Created reservations ['5f2bae07-3112-4e65-9d97-bb690b3feaf1', '6f41e643-7390-4eed-829e-c3be25304aa6', '9addafd2-3dd1-45fc-b09a-678fc1b2c733', '3b7e66bb-1bf9-4483-a0ee-d05b03c9f39b'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:03:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b51007d9-fbf5-466e-a709-d60c769eb012 tempest-CreateVolumesFromImageTest-228325488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b51007d9-fbf5-466e-a709-d60c769eb012 tempest-CreateVolumesFromImageTest-228325488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:19 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b51007d9-fbf5-466e-a709-d60c769eb012 tempest-CreateVolumesFromImageTest-228325488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:03:19 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b51007d9-fbf5-466e-a709-d60c769eb012 tempest-CreateVolumesFromImageTest-228325488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:03:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b51007d9-fbf5-466e-a709-d60c769eb012 tempest-CreateVolumesFromImageTest-228325488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b51007d9-fbf5-466e-a709-d60c769eb012 tempest-CreateVolumesFromImageTest-228325488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:19 devstack sudo[104838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:03:19 devstack sudo[104838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:19 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f8f90229-bc25-4010-8a37-63a22d4a6bd7 tempest-CreateVolumesFromImageTest-228325488 None] Acquiring lock "cinder-e4652306-74be-47b0-8eb6-0b797d30e5d8-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:03:19 devstack sudo[104834]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-042643d6-18eb-4a25-85b5-42af3e57dbf1 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504.b30ab300-13aa-4a65-b5c4-eeb10be2e090" returned: 0 in 0.335s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:19 devstack sudo[104831]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:19 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f8f90229-bc25-4010-8a37-63a22d4a6bd7 tempest-CreateVolumesFromImageTest-228325488 None] Lock "cinder-e4652306-74be-47b0-8eb6-0b797d30e5d8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:03:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25422115-5981-48d3-a7b2-1de0cd99b66c_n5t3wo03devstack@QuobyteHD" returned: 1 in 0.437s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25422115-5981-48d3-a7b2-1de0cd99b66c_n5t3wo03devstack@QuobyteHD' failed. Not Retrying. {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 18:03:19 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] 25422115-5981-48d3-a7b2-1de0cd99b66c was raw, converting to qcow2 {{(pid=87068) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 06 18:03:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_25422115-5981-48d3-a7b2-1de0cd99b66c_n5t3wo03devstack@QuobyteHD /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-24444b32-392d-454b-9e29-9fee7be696aa {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:19 devstack sudo[104843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_25422115-5981-48d3-a7b2-1de0cd99b66c_n5t3wo03devstack@QuobyteHD /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-24444b32-392d-454b-9e29-9fee7be696aa Nov 06 18:03:19 devstack sudo[104843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-042643d6-18eb-4a25-85b5-42af3e57dbf1 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:19 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f8f90229-bc25-4010-8a37-63a22d4a6bd7 tempest-CreateVolumesFromImageTest-228325488 None] Acquiring lock "cinder-quobyte-e4652306-74be-47b0-8eb6-0b797d30e5d8" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:03:19 devstack sudo[104845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504.info Nov 06 18:03:19 devstack sudo[104845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:19 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f8f90229-bc25-4010-8a37-63a22d4a6bd7 tempest-CreateVolumesFromImageTest-228325488 None] Lock "cinder-quobyte-e4652306-74be-47b0-8eb6-0b797d30e5d8" acquired by "delete_volume" :: waited 0.023s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:03:19 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ecb9f72-d8be-4ea6-bb9f-ff2f7a4d7882]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:03:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f8f90229-bc25-4010-8a37-63a22d4a6bd7 tempest-CreateVolumesFromImageTest-228325488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e4652306-74be-47b0-8eb6-0b797d30e5d8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:19 devstack sudo[104838]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b51007d9-fbf5-466e-a709-d60c769eb012 tempest-CreateVolumesFromImageTest-228325488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.300s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:19 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-b51007d9-fbf5-466e-a709-d60c769eb012 tempest-CreateVolumesFromImageTest-228325488 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:03:19 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-b51007d9-fbf5-466e-a709-d60c769eb012 tempest-CreateVolumesFromImageTest-228325488 None] Deleted volume successfully. Nov 06 18:03:19 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b51007d9-fbf5-466e-a709-d60c769eb012 tempest-CreateVolumesFromImageTest-228325488 None] Lock "cinder-ab78cbf7-2a14-4bf0-b563-7964fa4d2a79-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:03:20 devstack sudo[104848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e4652306-74be-47b0-8eb6-0b797d30e5d8 Nov 06 18:03:20 devstack sudo[104848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:20 devstack sudo[104845]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-042643d6-18eb-4a25-85b5-42af3e57dbf1 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504.info" returned: 0 in 0.344s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:20 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-042643d6-18eb-4a25-85b5-42af3e57dbf1 tempest-ProjectMemberTests-819176810 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504.info is being set with open permissions: ugo+rw Nov 06 18:03:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-042643d6-18eb-4a25-85b5-42af3e57dbf1 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:20 devstack sudo[104854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504.info Nov 06 18:03:20 devstack sudo[104854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:20 devstack sudo[104843]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_25422115-5981-48d3-a7b2-1de0cd99b66c_n5t3wo03devstack@QuobyteHD /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-24444b32-392d-454b-9e29-9fee7be696aa" returned: 0 in 0.511s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:20 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_25422115-5981-48d3-a7b2-1de0cd99b66c_n5t3wo03devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-24444b32-392d-454b-9e29-9fee7be696aa {{(pid=87068) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 18:03:20 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Converted 0.00 MB image at 0.00 MB/s Nov 06 18:03:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-24444b32-392d-454b-9e29-9fee7be696aa 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:20 devstack sudo[104859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-24444b32-392d-454b-9e29-9fee7be696aa 1G Nov 06 18:03:20 devstack sudo[104859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:20 devstack sudo[104848]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f8f90229-bc25-4010-8a37-63a22d4a6bd7 tempest-CreateVolumesFromImageTest-228325488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e4652306-74be-47b0-8eb6-0b797d30e5d8" returned: 0 in 0.467s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f8f90229-bc25-4010-8a37-63a22d4a6bd7 tempest-CreateVolumesFromImageTest-228325488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e4652306-74be-47b0-8eb6-0b797d30e5d8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:20 devstack sudo[104862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e4652306-74be-47b0-8eb6-0b797d30e5d8 Nov 06 18:03:20 devstack sudo[104862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:20 devstack sudo[104854]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-042643d6-18eb-4a25-85b5-42af3e57dbf1 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504.info" returned: 0 in 0.275s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-042643d6-18eb-4a25-85b5-42af3e57dbf1 tempest-ProjectMemberTests-819176810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.552s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cae5cadc-dfc4-45de-90cc-12e7b5fa889a tempest-VolumeDependencyTests-535782399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.639s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:20 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cae5cadc-dfc4-45de-90cc-12e7b5fa889a tempest-VolumeDependencyTests-535782399 None] Acquiring lock "cinder-quobyte-76a316bf-a082-4468-b71e-df2b787a152d-35f68221-25eb-4945-a2ad-78a30a00ffb0" by "_create_volume_from_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:03:20 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cae5cadc-dfc4-45de-90cc-12e7b5fa889a tempest-VolumeDependencyTests-535782399 None] Lock "cinder-quobyte-76a316bf-a082-4468-b71e-df2b787a152d-35f68221-25eb-4945-a2ad-78a30a00ffb0" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:03:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-cae5cadc-dfc4-45de-90cc-12e7b5fa889a tempest-VolumeDependencyTests-535782399 None] Creating volume 35f68221-25eb-4945-a2ad-78a30a00ffb0 from snapshot 76a316bf-a082-4468-b71e-df2b787a152d {{(pid=87068) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 18:03:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cae5cadc-dfc4-45de-90cc-12e7b5fa889a tempest-VolumeDependencyTests-535782399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cae5cadc-dfc4-45de-90cc-12e7b5fa889a tempest-VolumeDependencyTests-535782399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-cae5cadc-dfc4-45de-90cc-12e7b5fa889a tempest-VolumeDependencyTests-535782399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:03:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-cae5cadc-dfc4-45de-90cc-12e7b5fa889a tempest-VolumeDependencyTests-535782399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:03:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cae5cadc-dfc4-45de-90cc-12e7b5fa889a tempest-VolumeDependencyTests-535782399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-cae5cadc-dfc4-45de-90cc-12e7b5fa889a tempest-VolumeDependencyTests-535782399 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:03:20 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cae5cadc-dfc4-45de-90cc-12e7b5fa889a tempest-VolumeDependencyTests-535782399 None] Acquiring lock "cinder-quobyte-35f68221-25eb-4945-a2ad-78a30a00ffb0" by "_copy_volume_from_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:03:20 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-042643d6-18eb-4a25-85b5-42af3e57dbf1 tempest-ProjectMemberTests-819176810 None] Create snapshot completed successfully Nov 06 18:03:20 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cae5cadc-dfc4-45de-90cc-12e7b5fa889a tempest-VolumeDependencyTests-535782399 None] Lock "cinder-quobyte-35f68221-25eb-4945-a2ad-78a30a00ffb0" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:03:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-cae5cadc-dfc4-45de-90cc-12e7b5fa889a tempest-VolumeDependencyTests-535782399 None] snapshot: 76a316bf-a082-4468-b71e-df2b787a152d, volume: 35f68221-25eb-4945-a2ad-78a30a00ffb0, {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 18:03:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cae5cadc-dfc4-45de-90cc-12e7b5fa889a tempest-VolumeDependencyTests-535782399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cae5cadc-dfc4-45de-90cc-12e7b5fa889a tempest-VolumeDependencyTests-535782399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-cae5cadc-dfc4-45de-90cc-12e7b5fa889a tempest-VolumeDependencyTests-535782399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:03:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-cae5cadc-dfc4-45de-90cc-12e7b5fa889a tempest-VolumeDependencyTests-535782399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:03:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cae5cadc-dfc4-45de-90cc-12e7b5fa889a tempest-VolumeDependencyTests-535782399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:20 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d35f6c17-6dea-4931-82c8-e3dc94982b59]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:03:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cae5cadc-dfc4-45de-90cc-12e7b5fa889a tempest-VolumeDependencyTests-535782399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69.76a316bf-a082-4468-b71e-df2b787a152d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:20 devstack sudo[104862]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f8f90229-bc25-4010-8a37-63a22d4a6bd7 tempest-CreateVolumesFromImageTest-228325488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e4652306-74be-47b0-8eb6-0b797d30e5d8" returned: 0 in 0.288s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:20 devstack sudo[104859]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-24444b32-392d-454b-9e29-9fee7be696aa 1G" returned: 0 in 0.391s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:20 devstack cinder-volume[87068]: DEBUG cinder.volume.volume_utils [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Downloaded image 25422115-5981-48d3-a7b2-1de0cd99b66c ((None, [{'url': 'file:///opt/stack/data/glance/images/25422115-5981-48d3-a7b2-1de0cd99b66c', 'metadata': {}}])) to volume 24444b32-392d-454b-9e29-9fee7be696aa successfully. {{(pid=87068) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 18:03:20 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Temporary image 25422115-5981-48d3-a7b2-1de0cd99b66c for user 1cec33fb3e074f73a578488512799dd5 is deleted. {{(pid=87068) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 06 18:03:20 devstack cinder-volume[87068]: DEBUG cinder.volume.volume_utils [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Marking volume 24444b32-392d-454b-9e29-9fee7be696aa as bootable. {{(pid=87068) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 18:03:20 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f8f90229-bc25-4010-8a37-63a22d4a6bd7 tempest-CreateVolumesFromImageTest-228325488 None] Lock "cinder-quobyte-e4652306-74be-47b0-8eb6-0b797d30e5d8" released by "delete_volume" :: held 0.811s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:03:20 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Copying metadata from image 25422115-5981-48d3-a7b2-1de0cd99b66c to 24444b32-392d-454b-9e29-9fee7be696aa. {{(pid=87068) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 18:03:20 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Creating volume glance metadata for volume 24444b32-392d-454b-9e29-9fee7be696aa backed by image 25422115-5981-48d3-a7b2-1de0cd99b66c with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '25422115-5981-48d3-a7b2-1de0cd99b66c', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '048475ed7e3f73af7a7372fdc6356094', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87068) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 18:03:20 devstack sudo[104870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69.76a316bf-a082-4468-b71e-df2b787a152d Nov 06 18:03:20 devstack sudo[104870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:20 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-f8f90229-bc25-4010-8a37-63a22d4a6bd7 tempest-CreateVolumesFromImageTest-228325488 None] Created reservations ['7e544023-4903-4143-8391-0ffba00122ca', 'ca93e7d3-db69-4ea6-b8bd-153add80dbc0', '98f0ca68-8d21-4a41-aa15-865b79b50c39', '363779a3-77f1-4928-a875-3a7610d8cb73'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:03:20 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (172b88d4-c72d-4e22-9564-21af10078b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24444b32-392d-454b-9e29-9fee7be696aa', 'volume_size': 1, 'image_id': '25422115-5981-48d3-a7b2-1de0cd99b66c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25422115-5981-48d3-a7b2-1de0cd99b66c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '048475ed7e3f73af7a7372fdc6356094', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1de702676a3a46cca53abd3c64595ef4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6c3c52f1fd4cf1793f45d489c02af95787f801ffa1b47ebcd46758d58512b7fc935971a7a14fc84269f66e419d7b6968cfa2adad57f2b18e8ecbda22dc302dae', 'id': '25422115-5981-48d3-a7b2-1de0cd99b66c', 'created_at': datetime.datetime(2026, 11, 6, 17, 3, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 17, 3, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25422115-5981-48d3-a7b2-1de0cd99b66c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:20 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ce2d1b2-be74-47d5-872d-b7a5891166a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:20 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Volume volume-24444b32-392d-454b-9e29-9fee7be696aa (24444b32-392d-454b-9e29-9fee7be696aa): created successfully Nov 06 18:03:20 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ce2d1b2-be74-47d5-872d-b7a5891166a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:20 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Flow 'volume_create_manager' (01f7632d-74a1-4955-9ac8-0b30a4d17869) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:03:20 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-e9abfb89-efe0-4034-a9f6-6d6e359d1049 tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Created volume successfully. Nov 06 18:03:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f8f90229-bc25-4010-8a37-63a22d4a6bd7 tempest-CreateVolumesFromImageTest-228325488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f8f90229-bc25-4010-8a37-63a22d4a6bd7 tempest-CreateVolumesFromImageTest-228325488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f8f90229-bc25-4010-8a37-63a22d4a6bd7 tempest-CreateVolumesFromImageTest-228325488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:03:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f8f90229-bc25-4010-8a37-63a22d4a6bd7 tempest-CreateVolumesFromImageTest-228325488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:03:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f8f90229-bc25-4010-8a37-63a22d4a6bd7 tempest-CreateVolumesFromImageTest-228325488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f8f90229-bc25-4010-8a37-63a22d4a6bd7 tempest-CreateVolumesFromImageTest-228325488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:20 devstack sudo[104872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:03:20 devstack sudo[104872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:21 devstack sudo[104870]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cae5cadc-dfc4-45de-90cc-12e7b5fa889a tempest-VolumeDependencyTests-535782399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69.76a316bf-a082-4468-b71e-df2b787a152d" returned: 0 in 0.421s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:21 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-cae5cadc-dfc4-45de-90cc-12e7b5fa889a tempest-VolumeDependencyTests-535782399 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:03:21 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e41847fd-0324-4e56-ac35-f3ae9371c12a]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:03:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cae5cadc-dfc4-45de-90cc-12e7b5fa889a tempest-VolumeDependencyTests-535782399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:21 devstack sudo[104879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69 Nov 06 18:03:21 devstack sudo[104879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:21 devstack sudo[104872]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f8f90229-bc25-4010-8a37-63a22d4a6bd7 tempest-CreateVolumesFromImageTest-228325488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.302s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:21 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-f8f90229-bc25-4010-8a37-63a22d4a6bd7 tempest-CreateVolumesFromImageTest-228325488 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:03:21 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-f8f90229-bc25-4010-8a37-63a22d4a6bd7 tempest-CreateVolumesFromImageTest-228325488 None] Deleted volume successfully. Nov 06 18:03:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f8f90229-bc25-4010-8a37-63a22d4a6bd7 tempest-CreateVolumesFromImageTest-228325488 None] Lock "cinder-e4652306-74be-47b0-8eb6-0b797d30e5d8-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:03:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-02c1c5ef-072a-4939-8932-fccd8f4495e0 tempest-ProjectMemberTests-819176810 None] Acquiring lock "cinder-b30ab300-13aa-4a65-b5c4-eeb10be2e090-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:03:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-02c1c5ef-072a-4939-8932-fccd8f4495e0 tempest-ProjectMemberTests-819176810 None] Lock "cinder-b30ab300-13aa-4a65-b5c4-eeb10be2e090-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:03:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-02c1c5ef-072a-4939-8932-fccd8f4495e0 tempest-ProjectMemberTests-819176810 None] Acquiring lock "cinder-quobyte-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:03:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-02c1c5ef-072a-4939-8932-fccd8f4495e0 tempest-ProjectMemberTests-819176810 None] Lock "cinder-quobyte-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:03:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-02c1c5ef-072a-4939-8932-fccd8f4495e0 tempest-ProjectMemberTests-819176810 None] Acquiring lock "cinder-quobyte-b30ab300-13aa-4a65-b5c4-eeb10be2e090" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:03:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-02c1c5ef-072a-4939-8932-fccd8f4495e0 tempest-ProjectMemberTests-819176810 None] Lock "cinder-quobyte-b30ab300-13aa-4a65-b5c4-eeb10be2e090" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:03:21 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-02c1c5ef-072a-4939-8932-fccd8f4495e0 tempest-ProjectMemberTests-819176810 None] Deleting offline snapshot b30ab300-13aa-4a65-b5c4-eeb10be2e090 of volume 92a1b7d6-0bcc-4e4f-bb47-cb8a92301504 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:03:21 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-02c1c5ef-072a-4939-8932-fccd8f4495e0 tempest-ProjectMemberTests-819176810 None] snapshot_file for this snap is: volume-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504.b30ab300-13aa-4a65-b5c4-eeb10be2e090 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:03:21 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe3ebe3-4e16-43eb-a3f6-5a114aa097d2]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:03:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-02c1c5ef-072a-4939-8932-fccd8f4495e0 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504.b30ab300-13aa-4a65-b5c4-eeb10be2e090 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:21 devstack sudo[104879]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cae5cadc-dfc4-45de-90cc-12e7b5fa889a tempest-VolumeDependencyTests-535782399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69" returned: 0 in 0.442s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:21 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-cae5cadc-dfc4-45de-90cc-12e7b5fa889a tempest-VolumeDependencyTests-535782399 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69 {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 18:03:21 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-cae5cadc-dfc4-45de-90cc-12e7b5fa889a tempest-VolumeDependencyTests-535782399 None] Creating direct copy from snapshot {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 18:03:21 devstack cinder-volume[87068]: DEBUG cinder.utils [None req-cae5cadc-dfc4-45de-90cc-12e7b5fa889a tempest-VolumeDependencyTests-535782399 None] Path /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-35f68221-25eb-4945-a2ad-78a30a00ffb0 not found in is_blk_device check {{(pid=87068) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 18:03:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cae5cadc-dfc4-45de-90cc-12e7b5fa889a tempest-VolumeDependencyTests-535782399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-35f68221-25eb-4945-a2ad-78a30a00ffb0 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:21 devstack sudo[104886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-35f68221-25eb-4945-a2ad-78a30a00ffb0 Nov 06 18:03:21 devstack sudo[104886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:21 devstack sudo[104884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504.b30ab300-13aa-4a65-b5c4-eeb10be2e090 Nov 06 18:03:21 devstack sudo[104884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:21 devstack sudo[104884]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-02c1c5ef-072a-4939-8932-fccd8f4495e0 tempest-ProjectMemberTests-819176810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504.b30ab300-13aa-4a65-b5c4-eeb10be2e090" returned: 0 in 0.446s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:21 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-02c1c5ef-072a-4939-8932-fccd8f4495e0 tempest-ProjectMemberTests-819176810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:03:21 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[da80e860-acba-486a-8339-98c4def4eb52]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:03:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-02c1c5ef-072a-4939-8932-fccd8f4495e0 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-41658878-ff8d-46d9-a237-991f0e1b60df tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Acquiring lock "cinder-24444b32-392d-454b-9e29-9fee7be696aa-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:03:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-41658878-ff8d-46d9-a237-991f0e1b60df tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Lock "cinder-24444b32-392d-454b-9e29-9fee7be696aa-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:03:22 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-41658878-ff8d-46d9-a237-991f0e1b60df tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Acquiring lock "cinder-quobyte-24444b32-392d-454b-9e29-9fee7be696aa" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:03:22 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-41658878-ff8d-46d9-a237-991f0e1b60df tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Lock "cinder-quobyte-24444b32-392d-454b-9e29-9fee7be696aa" acquired by "delete_volume" :: waited 0.017s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:03:22 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5775214-c6cf-4554-b004-90cb3d740e33]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:03:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-41658878-ff8d-46d9-a237-991f0e1b60df tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-24444b32-392d-454b-9e29-9fee7be696aa {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:22 devstack sudo[104896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504 Nov 06 18:03:22 devstack sudo[104896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:22 devstack sudo[104898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-24444b32-392d-454b-9e29-9fee7be696aa Nov 06 18:03:22 devstack sudo[104898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:22 devstack sudo[104898]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-41658878-ff8d-46d9-a237-991f0e1b60df tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-24444b32-392d-454b-9e29-9fee7be696aa" returned: 0 in 0.549s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-41658878-ff8d-46d9-a237-991f0e1b60df tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-24444b32-392d-454b-9e29-9fee7be696aa {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:22 devstack sudo[104896]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-02c1c5ef-072a-4939-8932-fccd8f4495e0 tempest-ProjectMemberTests-819176810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504" returned: 0 in 0.783s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-02c1c5ef-072a-4939-8932-fccd8f4495e0 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504.b30ab300-13aa-4a65-b5c4-eeb10be2e090 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:22 devstack sudo[104913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-24444b32-392d-454b-9e29-9fee7be696aa Nov 06 18:03:22 devstack sudo[104913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:22 devstack sudo[104915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504.b30ab300-13aa-4a65-b5c4-eeb10be2e090 Nov 06 18:03:22 devstack sudo[104915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:23 devstack sudo[104913]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-41658878-ff8d-46d9-a237-991f0e1b60df tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-24444b32-392d-454b-9e29-9fee7be696aa" returned: 0 in 0.658s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:23 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-41658878-ff8d-46d9-a237-991f0e1b60df tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Lock "cinder-quobyte-24444b32-392d-454b-9e29-9fee7be696aa" released by "delete_volume" :: held 1.278s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:03:23 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-41658878-ff8d-46d9-a237-991f0e1b60df tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Created reservations ['9686ff5b-da2d-491d-9896-7227eeec2d4f', '669e197b-b08a-4995-875d-0300ec875a40', 'af1fb5a4-9739-4879-9c1a-1914ccabf410', '705b292f-56cc-40f4-9fbf-139c6a146881'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:03:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-41658878-ff8d-46d9-a237-991f0e1b60df tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-41658878-ff8d-46d9-a237-991f0e1b60df tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:23 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-41658878-ff8d-46d9-a237-991f0e1b60df tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:03:23 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-41658878-ff8d-46d9-a237-991f0e1b60df tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:03:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-41658878-ff8d-46d9-a237-991f0e1b60df tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-41658878-ff8d-46d9-a237-991f0e1b60df tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:23 devstack sudo[104921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:03:23 devstack sudo[104921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:23 devstack sudo[104915]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-02c1c5ef-072a-4939-8932-fccd8f4495e0 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504.b30ab300-13aa-4a65-b5c4-eeb10be2e090" returned: 0 in 1.074s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-02c1c5ef-072a-4939-8932-fccd8f4495e0 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504.b30ab300-13aa-4a65-b5c4-eeb10be2e090 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:23 devstack sudo[104923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504.b30ab300-13aa-4a65-b5c4-eeb10be2e090 Nov 06 18:03:23 devstack sudo[104923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:24 devstack sudo[104921]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-41658878-ff8d-46d9-a237-991f0e1b60df tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.588s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:24 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-41658878-ff8d-46d9-a237-991f0e1b60df tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:03:24 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-41658878-ff8d-46d9-a237-991f0e1b60df tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Deleted volume successfully. Nov 06 18:03:24 devstack sudo[104923]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-02c1c5ef-072a-4939-8932-fccd8f4495e0 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504.b30ab300-13aa-4a65-b5c4-eeb10be2e090" returned: 0 in 0.481s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:24 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-41658878-ff8d-46d9-a237-991f0e1b60df tempest-VolumeAndVolumeTypeFromImageTest-977930734 None] Lock "cinder-24444b32-392d-454b-9e29-9fee7be696aa-delete_volume" released by "delete_volume" :: held 2.289s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:03:24 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-02c1c5ef-072a-4939-8932-fccd8f4495e0 tempest-ProjectMemberTests-819176810 None] Lock "cinder-quobyte-b30ab300-13aa-4a65-b5c4-eeb10be2e090" released by "_delete_snapshot" :: held 3.023s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:03:24 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-02c1c5ef-072a-4939-8932-fccd8f4495e0 tempest-ProjectMemberTests-819176810 None] Lock "cinder-quobyte-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504" released by "delete_snapshot" :: held 3.082s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:03:24 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-02c1c5ef-072a-4939-8932-fccd8f4495e0 tempest-ProjectMemberTests-819176810 None] Created reservations ['5d4bc0aa-0c83-4676-8acb-5d12891eb20e', 'e66526e6-3d5e-4d0a-9311-c7cc10416fe2', 'f014fcc1-b4b2-4661-9654-f567ed4bcdad', 'cbd7969a-97ff-43a6-8db8-706d75892755'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:03:24 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-02c1c5ef-072a-4939-8932-fccd8f4495e0 tempest-ProjectMemberTests-819176810 None] Delete snapshot completed successfully. Nov 06 18:03:24 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-02c1c5ef-072a-4939-8932-fccd8f4495e0 tempest-ProjectMemberTests-819176810 None] Lock "cinder-b30ab300-13aa-4a65-b5c4-eeb10be2e090-delete_snapshot" released by "delete_snapshot" :: held 3.492s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:03:25 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-805eaed6-ac67-4b87-9275-6c727a24f05a tempest-ProjectMemberTests-819176810 None] Acquiring lock "cinder-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:03:25 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-805eaed6-ac67-4b87-9275-6c727a24f05a tempest-ProjectMemberTests-819176810 None] Lock "cinder-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:03:25 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-805eaed6-ac67-4b87-9275-6c727a24f05a tempest-ProjectMemberTests-819176810 None] Acquiring lock "cinder-quobyte-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:03:25 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-805eaed6-ac67-4b87-9275-6c727a24f05a tempest-ProjectMemberTests-819176810 None] Lock "cinder-quobyte-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504" acquired by "delete_volume" :: waited 0.028s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:03:25 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[336322ff-e710-42b0-b14e-c1be89cd9c65]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:03:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-805eaed6-ac67-4b87-9275-6c727a24f05a tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:26 devstack sudo[104928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504 Nov 06 18:03:26 devstack sudo[104928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:26 devstack sudo[104928]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-805eaed6-ac67-4b87-9275-6c727a24f05a tempest-ProjectMemberTests-819176810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504" returned: 0 in 0.992s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-805eaed6-ac67-4b87-9275-6c727a24f05a tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:27 devstack sudo[104933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504 Nov 06 18:03:27 devstack sudo[104933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:27 devstack sudo[104933]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-805eaed6-ac67-4b87-9275-6c727a24f05a tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504" returned: 0 in 0.673s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:27 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-805eaed6-ac67-4b87-9275-6c727a24f05a tempest-ProjectMemberTests-819176810 None] Lock "cinder-quobyte-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504" released by "delete_volume" :: held 1.838s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:03:27 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-805eaed6-ac67-4b87-9275-6c727a24f05a tempest-ProjectMemberTests-819176810 None] Created reservations ['9b18981d-b964-4332-8d41-4863cfab5005', '6233d67b-7666-4956-a641-6da34574e18e', '6c481632-b8f2-4afe-a9bd-1bdaa1d3cc5f', 'dbf63abc-552a-4569-86c9-f1b27ada6be2'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:03:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-805eaed6-ac67-4b87-9275-6c727a24f05a tempest-ProjectMemberTests-819176810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-805eaed6-ac67-4b87-9275-6c727a24f05a tempest-ProjectMemberTests-819176810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-805eaed6-ac67-4b87-9275-6c727a24f05a tempest-ProjectMemberTests-819176810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:03:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-805eaed6-ac67-4b87-9275-6c727a24f05a tempest-ProjectMemberTests-819176810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:03:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-805eaed6-ac67-4b87-9275-6c727a24f05a tempest-ProjectMemberTests-819176810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-805eaed6-ac67-4b87-9275-6c727a24f05a tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:28 devstack sudo[104936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:03:28 devstack sudo[104936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:28 devstack sudo[104936]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-805eaed6-ac67-4b87-9275-6c727a24f05a tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.709s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:28 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-805eaed6-ac67-4b87-9275-6c727a24f05a tempest-ProjectMemberTests-819176810 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:03:28 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-805eaed6-ac67-4b87-9275-6c727a24f05a tempest-ProjectMemberTests-819176810 None] Deleted volume successfully. Nov 06 18:03:28 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-805eaed6-ac67-4b87-9275-6c727a24f05a tempest-ProjectMemberTests-819176810 None] Lock "cinder-92a1b7d6-0bcc-4e4f-bb47-cb8a92301504-delete_volume" released by "delete_volume" :: held 2.970s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:03:29 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-180c5a92-1860-41a0-80f2-e0bfd83eb6b9 tempest-ProjectMemberTests-819176810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:03:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-180c5a92-1860-41a0-80f2-e0bfd83eb6b9 tempest-ProjectMemberTests-819176810 None] Flow 'volume_create_manager' (100a4577-6218-479e-95f9-5e8d87f2b75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:03:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-180c5a92-1860-41a0-80f2-e0bfd83eb6b9 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2beef98-c216-4b5c-ab77-8f08f37b467c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-180c5a92-1860-41a0-80f2-e0bfd83eb6b9 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2beef98-c216-4b5c-ab77-8f08f37b467c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1597443047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdd017a4-646c-47cd-9b34-ca527c2331d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b97cd7ef94764995a9e8c62cda23171f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:03:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:03:29Z,use_quota=True,user_id='a34e6465a98c4c289547d49a900a6bde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-180c5a92-1860-41a0-80f2-e0bfd83eb6b9 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89ebd602-e787-444f-a101-3bb0ee0052f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-180c5a92-1860-41a0-80f2-e0bfd83eb6b9 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89ebd602-e787-444f-a101-3bb0ee0052f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-180c5a92-1860-41a0-80f2-e0bfd83eb6b9 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7359c0f6-0e98-40d6-b1ff-45b6b0f62ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-180c5a92-1860-41a0-80f2-e0bfd83eb6b9 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7359c0f6-0e98-40d6-b1ff-45b6b0f62ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdd017a4-646c-47cd-9b34-ca527c2331d6', 'volume_name': 'volume-fdd017a4-646c-47cd-9b34-ca527c2331d6', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-180c5a92-1860-41a0-80f2-e0bfd83eb6b9 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f821f0e8-2024-4c0c-9dd1-b593ac27a0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-180c5a92-1860-41a0-80f2-e0bfd83eb6b9 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f821f0e8-2024-4c0c-9dd1-b593ac27a0a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-180c5a92-1860-41a0-80f2-e0bfd83eb6b9 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b19cdcd4-53e8-497f-89de-0bb271cbd515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:29 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-180c5a92-1860-41a0-80f2-e0bfd83eb6b9 tempest-ProjectMemberTests-819176810 None] Volume fdd017a4-646c-47cd-9b34-ca527c2331d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdd017a4-646c-47cd-9b34-ca527c2331d6', 'volume_size': 1} Nov 06 18:03:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-180c5a92-1860-41a0-80f2-e0bfd83eb6b9 tempest-ProjectMemberTests-819176810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:30 devstack sudo[104886]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cae5cadc-dfc4-45de-90cc-12e7b5fa889a tempest-VolumeDependencyTests-535782399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-35f68221-25eb-4945-a2ad-78a30a00ffb0" returned: 0 in 9.279s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:30 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-cae5cadc-dfc4-45de-90cc-12e7b5fa889a tempest-VolumeDependencyTests-535782399 None] Image conversion details: src /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69, size 1024.00 MB, duration 9.28 sec, destination /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-35f68221-25eb-4945-a2ad-78a30a00ffb0 {{(pid=87068) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 18:03:30 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-cae5cadc-dfc4-45de-90cc-12e7b5fa889a tempest-VolumeDependencyTests-535782399 None] Converted 1024.00 MB image at 110.35 MB/s Nov 06 18:03:30 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-cae5cadc-dfc4-45de-90cc-12e7b5fa889a tempest-VolumeDependencyTests-535782399 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-35f68221-25eb-4945-a2ad-78a30a00ffb0 is being set with open permissions: ugo+rw Nov 06 18:03:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cae5cadc-dfc4-45de-90cc-12e7b5fa889a tempest-VolumeDependencyTests-535782399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-35f68221-25eb-4945-a2ad-78a30a00ffb0 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:30 devstack sudo[104939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-35f68221-25eb-4945-a2ad-78a30a00ffb0 Nov 06 18:03:30 devstack sudo[104939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:31 devstack sudo[104939]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cae5cadc-dfc4-45de-90cc-12e7b5fa889a tempest-VolumeDependencyTests-535782399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-35f68221-25eb-4945-a2ad-78a30a00ffb0" returned: 0 in 0.290s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:31 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cae5cadc-dfc4-45de-90cc-12e7b5fa889a tempest-VolumeDependencyTests-535782399 None] Lock "cinder-quobyte-35f68221-25eb-4945-a2ad-78a30a00ffb0" released by "_copy_volume_from_snapshot" :: held 10.546s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:03:31 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cae5cadc-dfc4-45de-90cc-12e7b5fa889a tempest-VolumeDependencyTests-535782399 None] Lock "cinder-quobyte-76a316bf-a082-4468-b71e-df2b787a152d-35f68221-25eb-4945-a2ad-78a30a00ffb0" released by "_create_volume_from_snapshot" :: held 10.631s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:03:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cae5cadc-dfc4-45de-90cc-12e7b5fa889a tempest-VolumeDependencyTests-535782399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.664s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-180c5a92-1860-41a0-80f2-e0bfd83eb6b9 tempest-ProjectMemberTests-819176810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.451s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-180c5a92-1860-41a0-80f2-e0bfd83eb6b9 tempest-ProjectMemberTests-819176810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1597443047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdd017a4-646c-47cd-9b34-ca527c2331d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b97cd7ef94764995a9e8c62cda23171f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:03:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:03:29Z,use_quota=True,user_id='a34e6465a98c4c289547d49a900a6bde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:03:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-180c5a92-1860-41a0-80f2-e0bfd83eb6b9 tempest-ProjectMemberTests-819176810 None] Creating volume fdd017a4-646c-47cd-9b34-ca527c2331d6 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:03:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-180c5a92-1860-41a0-80f2-e0bfd83eb6b9 tempest-ProjectMemberTests-819176810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-180c5a92-1860-41a0-80f2-e0bfd83eb6b9 tempest-ProjectMemberTests-819176810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-180c5a92-1860-41a0-80f2-e0bfd83eb6b9 tempest-ProjectMemberTests-819176810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:03:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-180c5a92-1860-41a0-80f2-e0bfd83eb6b9 tempest-ProjectMemberTests-819176810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:03:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-180c5a92-1860-41a0-80f2-e0bfd83eb6b9 tempest-ProjectMemberTests-819176810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-180c5a92-1860-41a0-80f2-e0bfd83eb6b9 tempest-ProjectMemberTests-819176810 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:03:31 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-180c5a92-1860-41a0-80f2-e0bfd83eb6b9 tempest-ProjectMemberTests-819176810 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:03:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-180c5a92-1860-41a0-80f2-e0bfd83eb6b9 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdd017a4-646c-47cd-9b34-ca527c2331d6 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:31 devstack sudo[104943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdd017a4-646c-47cd-9b34-ca527c2331d6 1073741824 Nov 06 18:03:31 devstack sudo[104943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cae5cadc-dfc4-45de-90cc-12e7b5fa889a tempest-VolumeDependencyTests-535782399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0190171c-148a-49f0-808d-95ae8e4db3b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35f68221-25eb-4945-a2ad-78a30a00ffb0', 'volume_size': 1, 'snapshot_id': '76a316bf-a082-4468-b71e-df2b787a152d'}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cae5cadc-dfc4-45de-90cc-12e7b5fa889a tempest-VolumeDependencyTests-535782399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dcf9cb0-8811-4d2c-b293-f6cdf89f433a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:31 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-cae5cadc-dfc4-45de-90cc-12e7b5fa889a tempest-VolumeDependencyTests-535782399 None] Volume volume-35f68221-25eb-4945-a2ad-78a30a00ffb0 (35f68221-25eb-4945-a2ad-78a30a00ffb0): created successfully Nov 06 18:03:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cae5cadc-dfc4-45de-90cc-12e7b5fa889a tempest-VolumeDependencyTests-535782399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dcf9cb0-8811-4d2c-b293-f6cdf89f433a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cae5cadc-dfc4-45de-90cc-12e7b5fa889a tempest-VolumeDependencyTests-535782399 None] Flow 'volume_create_manager' (510ce793-6c93-4ad5-b5d3-3ad9641b7fe3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:03:31 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-cae5cadc-dfc4-45de-90cc-12e7b5fa889a tempest-VolumeDependencyTests-535782399 None] Created volume successfully. Nov 06 18:03:31 devstack sudo[104943]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-180c5a92-1860-41a0-80f2-e0bfd83eb6b9 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdd017a4-646c-47cd-9b34-ca527c2331d6 1073741824" returned: 0 in 0.578s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-180c5a92-1860-41a0-80f2-e0bfd83eb6b9 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdd017a4-646c-47cd-9b34-ca527c2331d6 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:31 devstack sudo[104948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdd017a4-646c-47cd-9b34-ca527c2331d6 Nov 06 18:03:31 devstack sudo[104948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:31 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:03:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] Flow 'volume_create_manager' (a1789f35-305c-41a9-8a74-67d890450cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:03:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76db2f94-3be9-44a3-9b37-d7ce3a9ac00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76db2f94-3be9-44a3-9b37-d7ce3a9ac00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:03:31Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9945ff40-8db7-43d4-b0d6-e8083322314e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08258bfd343b48a984c64c1d4253e08a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:03:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:03:32Z,use_quota=True,user_id='6d146616c1ec427d919137dd19421ee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faea3d33-fae3-4975-a023-b16ccf02f604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faea3d33-fae3-4975-a023-b16ccf02f604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23ac0fc2-dff6-4753-93fe-6418b467c0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:31 devstack cinder-volume[87068]: DEBUG cinder.image.glance [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] Creating Keystone auth plugin from conf {{(pid=87068) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 18:03:31 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9a8d9f1f-05ee-4cd7-9f1f-2ded8a84d2bb tempest-VolumeDependencyTests-535782399 None] Acquiring lock "cinder-76a316bf-a082-4468-b71e-df2b787a152d-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:03:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9a8d9f1f-05ee-4cd7-9f1f-2ded8a84d2bb tempest-VolumeDependencyTests-535782399 None] Lock "cinder-76a316bf-a082-4468-b71e-df2b787a152d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:03:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9a8d9f1f-05ee-4cd7-9f1f-2ded8a84d2bb tempest-VolumeDependencyTests-535782399 None] Acquiring lock "cinder-quobyte-7aa09fe7-4865-42f0-b514-6a2402eb2d69" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:03:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9a8d9f1f-05ee-4cd7-9f1f-2ded8a84d2bb tempest-VolumeDependencyTests-535782399 None] Lock "cinder-quobyte-7aa09fe7-4865-42f0-b514-6a2402eb2d69" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:03:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9a8d9f1f-05ee-4cd7-9f1f-2ded8a84d2bb tempest-VolumeDependencyTests-535782399 None] Acquiring lock "cinder-quobyte-76a316bf-a082-4468-b71e-df2b787a152d" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:03:32 devstack sudo[104948]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-180c5a92-1860-41a0-80f2-e0bfd83eb6b9 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdd017a4-646c-47cd-9b34-ca527c2331d6" returned: 0 in 0.318s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-180c5a92-1860-41a0-80f2-e0bfd83eb6b9 tempest-ProjectMemberTests-819176810 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:03:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-180c5a92-1860-41a0-80f2-e0bfd83eb6b9 tempest-ProjectMemberTests-819176810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9a8d9f1f-05ee-4cd7-9f1f-2ded8a84d2bb tempest-VolumeDependencyTests-535782399 None] Lock "cinder-quobyte-76a316bf-a082-4468-b71e-df2b787a152d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:03:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-9a8d9f1f-05ee-4cd7-9f1f-2ded8a84d2bb tempest-VolumeDependencyTests-535782399 None] Deleting offline snapshot 76a316bf-a082-4468-b71e-df2b787a152d of volume 7aa09fe7-4865-42f0-b514-6a2402eb2d69 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:03:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-9a8d9f1f-05ee-4cd7-9f1f-2ded8a84d2bb tempest-VolumeDependencyTests-535782399 None] snapshot_file for this snap is: volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69.76a316bf-a082-4468-b71e-df2b787a152d {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:03:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-180c5a92-1860-41a0-80f2-e0bfd83eb6b9 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b19cdcd4-53e8-497f-89de-0bb271cbd515) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdd017a4-646c-47cd-9b34-ca527c2331d6', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-180c5a92-1860-41a0-80f2-e0bfd83eb6b9 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1697b66-14e6-4274-b5d6-1954f8abd59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:32 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6578411a-80ce-4d8d-97b8-39a90f6566ab]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:03:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9a8d9f1f-05ee-4cd7-9f1f-2ded8a84d2bb tempest-VolumeDependencyTests-535782399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69.76a316bf-a082-4468-b71e-df2b787a152d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:32 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-180c5a92-1860-41a0-80f2-e0bfd83eb6b9 tempest-ProjectMemberTests-819176810 None] Volume volume-fdd017a4-646c-47cd-9b34-ca527c2331d6 (fdd017a4-646c-47cd-9b34-ca527c2331d6): created successfully Nov 06 18:03:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-180c5a92-1860-41a0-80f2-e0bfd83eb6b9 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1697b66-14e6-4274-b5d6-1954f8abd59b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-180c5a92-1860-41a0-80f2-e0bfd83eb6b9 tempest-ProjectMemberTests-819176810 None] Flow 'volume_create_manager' (100a4577-6218-479e-95f9-5e8d87f2b75c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:03:32 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-180c5a92-1860-41a0-80f2-e0bfd83eb6b9 tempest-ProjectMemberTests-819176810 None] Created volume successfully. Nov 06 18:03:32 devstack sudo[104951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69.76a316bf-a082-4468-b71e-df2b787a152d Nov 06 18:03:32 devstack sudo[104951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23ac0fc2-dff6-4753-93fe-6418b467c0d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9945ff40-8db7-43d4-b0d6-e8083322314e', 'volume_name': 'volume-9945ff40-8db7-43d4-b0d6-e8083322314e', 'volume_size': 1, 'image_id': 'dffca602-51f0-40d1-8902-a33ae45acdc2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dffca602-51f0-40d1-8902-a33ae45acdc2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b3c48f21cea139e2ef96a8bd5cd73c7b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '08258bfd343b48a984c64c1d4253e08a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '558d893ff35a764ceb8ed09d8a67b83d109127b64d47c0101263c13a6923d5fa1f67a91891d2444fe2254a67a6bc94b7134b2c5f035dac4ea5c3d7dc796fa174', 'id': 'dffca602-51f0-40d1-8902-a33ae45acdc2', 'created_at': datetime.datetime(2026, 11, 6, 17, 3, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 17, 3, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dffca602-51f0-40d1-8902-a33ae45acdc2/file', 'properties': {}}, 'image_service': }' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93e1a67e-fb2c-4a6e-806a-e3d2c4b778d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93e1a67e-fb2c-4a6e-806a-e3d2c4b778d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36b765cd-4cd6-4c4e-97da-810ad8962ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:32 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] Volume 9945ff40-8db7-43d4-b0d6-e8083322314e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9945ff40-8db7-43d4-b0d6-e8083322314e', 'volume_size': 1, 'image_id': 'dffca602-51f0-40d1-8902-a33ae45acdc2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dffca602-51f0-40d1-8902-a33ae45acdc2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b3c48f21cea139e2ef96a8bd5cd73c7b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '08258bfd343b48a984c64c1d4253e08a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '558d893ff35a764ceb8ed09d8a67b83d109127b64d47c0101263c13a6923d5fa1f67a91891d2444fe2254a67a6bc94b7134b2c5f035dac4ea5c3d7dc796fa174', 'id': 'dffca602-51f0-40d1-8902-a33ae45acdc2', 'created_at': datetime.datetime(2026, 11, 6, 17, 3, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 17, 3, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dffca602-51f0-40d1-8902-a33ae45acdc2/file', 'properties': {}}, 'image_service': } Nov 06 18:03:32 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] Trying to clone 9945ff40-8db7-43d4-b0d6-e8083322314e from image dffca602-51f0-40d1-8902-a33ae45acdc2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/dffca602-51f0-40d1-8902-a33ae45acdc2', 'metadata': {}}]). {{(pid=87068) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 18:03:32 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_dffca602-51f0-40d1-8902-a33ae45acdc2_xlbr_xyndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87068) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 06 18:03:32 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] Image download 0.00 MB at 0.00 MB/s Nov 06 18:03:32 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d9955c-7abc-4ab9-b92d-6f0d3ce01e97]: (4, 'raw') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:03:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dffca602-51f0-40d1-8902-a33ae45acdc2_xlbr_xyndevstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:32 devstack sudo[104951]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9a8d9f1f-05ee-4cd7-9f1f-2ded8a84d2bb tempest-VolumeDependencyTests-535782399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69.76a316bf-a082-4468-b71e-df2b787a152d" returned: 0 in 0.477s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-9a8d9f1f-05ee-4cd7-9f1f-2ded8a84d2bb tempest-VolumeDependencyTests-535782399 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:03:32 devstack sudo[104956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dffca602-51f0-40d1-8902-a33ae45acdc2_xlbr_xyndevstack@QuobyteHD Nov 06 18:03:32 devstack sudo[104956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:32 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bfbeb39-0b05-4e45-9a3f-791ec5d5a28c]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:03:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9a8d9f1f-05ee-4cd7-9f1f-2ded8a84d2bb tempest-VolumeDependencyTests-535782399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:32 devstack sudo[104958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69 Nov 06 18:03:32 devstack sudo[104958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:32 devstack sudo[104956]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dffca602-51f0-40d1-8902-a33ae45acdc2_xlbr_xyndevstack@QuobyteHD" returned: 0 in 0.371s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dffca602-51f0-40d1-8902-a33ae45acdc2_xlbr_xyndevstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-300101b2-ba2e-4cc5-921f-f3e24f22bd12 tempest-ProjectMemberTests-819176810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-300101b2-ba2e-4cc5-921f-f3e24f22bd12 tempest-ProjectMemberTests-819176810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:33 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-300101b2-ba2e-4cc5-921f-f3e24f22bd12 tempest-ProjectMemberTests-819176810 None] Creating offline snapshot 7f10af3c-0c0e-4238-8260-2e53cec0457d of volume fdd017a4-646c-47cd-9b34-ca527c2331d6 {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:03:33 devstack sudo[104962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dffca602-51f0-40d1-8902-a33ae45acdc2_xlbr_xyndevstack@QuobyteHD Nov 06 18:03:33 devstack sudo[104962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:33 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c54718a-112d-4afd-b033-67e9410d1534 tempest-CreateVolumesFromSnapshotTest-192351063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:03:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6c54718a-112d-4afd-b033-67e9410d1534 tempest-CreateVolumesFromSnapshotTest-192351063 None] Flow 'volume_create_manager' (0af93bef-d509-4d43-80fc-6393ca9a197d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:03:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6c54718a-112d-4afd-b033-67e9410d1534 tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63c8d608-d8de-4431-8e00-e132358bd092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:33 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d74a74e-ab37-412a-b124-b29327df499c]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:03:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-300101b2-ba2e-4cc5-921f-f3e24f22bd12 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdd017a4-646c-47cd-9b34-ca527c2331d6 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6c54718a-112d-4afd-b033-67e9410d1534 tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63c8d608-d8de-4431-8e00-e132358bd092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:03:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-472267037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f16a30d-32fc-4a8f-a868-f8368fa74425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a7e599b329e494894499817e4d2aa68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:03:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:03:33Z,use_quota=True,user_id='9e93136380c74f18b836af165584c6ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6c54718a-112d-4afd-b033-67e9410d1534 tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9699ad32-7f79-4bf8-9574-046c2e5507cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6c54718a-112d-4afd-b033-67e9410d1534 tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9699ad32-7f79-4bf8-9574-046c2e5507cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6c54718a-112d-4afd-b033-67e9410d1534 tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (866f727a-aea2-4523-aedd-0ff0e0ca7ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6c54718a-112d-4afd-b033-67e9410d1534 tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (866f727a-aea2-4523-aedd-0ff0e0ca7ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f16a30d-32fc-4a8f-a868-f8368fa74425', 'volume_name': 'volume-6f16a30d-32fc-4a8f-a868-f8368fa74425', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6c54718a-112d-4afd-b033-67e9410d1534 tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aee726a5-34bd-4b24-8be9-9fd317c32350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6c54718a-112d-4afd-b033-67e9410d1534 tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aee726a5-34bd-4b24-8be9-9fd317c32350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6c54718a-112d-4afd-b033-67e9410d1534 tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d9cc9cf-df4a-4e7f-9e3d-39fb7d3101ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:33 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-6c54718a-112d-4afd-b033-67e9410d1534 tempest-CreateVolumesFromSnapshotTest-192351063 None] Volume 6f16a30d-32fc-4a8f-a868-f8368fa74425: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f16a30d-32fc-4a8f-a868-f8368fa74425', 'volume_size': 1} Nov 06 18:03:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6c54718a-112d-4afd-b033-67e9410d1534 tempest-CreateVolumesFromSnapshotTest-192351063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:33 devstack sudo[104966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdd017a4-646c-47cd-9b34-ca527c2331d6 Nov 06 18:03:33 devstack sudo[104966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:33 devstack sudo[104958]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9a8d9f1f-05ee-4cd7-9f1f-2ded8a84d2bb tempest-VolumeDependencyTests-535782399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69" returned: 0 in 0.603s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9a8d9f1f-05ee-4cd7-9f1f-2ded8a84d2bb tempest-VolumeDependencyTests-535782399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69.76a316bf-a082-4468-b71e-df2b787a152d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:33 devstack sudo[104962]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dffca602-51f0-40d1-8902-a33ae45acdc2_xlbr_xyndevstack@QuobyteHD" returned: 1 in 0.402s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dffca602-51f0-40d1-8902-a33ae45acdc2_xlbr_xyndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 18:03:33 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] Temporary image dffca602-51f0-40d1-8902-a33ae45acdc2 is fetched for user 6d146616c1ec427d919137dd19421ee8. {{(pid=87068) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 06 18:03:33 devstack sudo[104972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69.76a316bf-a082-4468-b71e-df2b787a152d Nov 06 18:03:33 devstack sudo[104972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:33 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3cdf8d-e749-413a-babb-61f17148c698]: (4, 'raw') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:03:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dffca602-51f0-40d1-8902-a33ae45acdc2_xlbr_xyndevstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:33 devstack sudo[104974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dffca602-51f0-40d1-8902-a33ae45acdc2_xlbr_xyndevstack@QuobyteHD Nov 06 18:03:33 devstack sudo[104974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:33 devstack sudo[104966]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-300101b2-ba2e-4cc5-921f-f3e24f22bd12 tempest-ProjectMemberTests-819176810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdd017a4-646c-47cd-9b34-ca527c2331d6" returned: 0 in 0.418s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-300101b2-ba2e-4cc5-921f-f3e24f22bd12 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdd017a4-646c-47cd-9b34-ca527c2331d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdd017a4-646c-47cd-9b34-ca527c2331d6.7f10af3c-0c0e-4238-8260-2e53cec0457d 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:33 devstack sudo[104981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdd017a4-646c-47cd-9b34-ca527c2331d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdd017a4-646c-47cd-9b34-ca527c2331d6.7f10af3c-0c0e-4238-8260-2e53cec0457d 1G Nov 06 18:03:33 devstack sudo[104981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:33 devstack sudo[104972]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9a8d9f1f-05ee-4cd7-9f1f-2ded8a84d2bb tempest-VolumeDependencyTests-535782399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69.76a316bf-a082-4468-b71e-df2b787a152d" returned: 0 in 0.382s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9a8d9f1f-05ee-4cd7-9f1f-2ded8a84d2bb tempest-VolumeDependencyTests-535782399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69.76a316bf-a082-4468-b71e-df2b787a152d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:33 devstack sudo[104984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69.76a316bf-a082-4468-b71e-df2b787a152d Nov 06 18:03:33 devstack sudo[104984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:33 devstack sudo[104974]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dffca602-51f0-40d1-8902-a33ae45acdc2_xlbr_xyndevstack@QuobyteHD" returned: 0 in 0.379s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dffca602-51f0-40d1-8902-a33ae45acdc2_xlbr_xyndevstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:33 devstack sudo[104988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dffca602-51f0-40d1-8902-a33ae45acdc2_xlbr_xyndevstack@QuobyteHD Nov 06 18:03:33 devstack sudo[104988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:33 devstack sudo[104984]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9a8d9f1f-05ee-4cd7-9f1f-2ded8a84d2bb tempest-VolumeDependencyTests-535782399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69.76a316bf-a082-4468-b71e-df2b787a152d" returned: 0 in 0.310s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9a8d9f1f-05ee-4cd7-9f1f-2ded8a84d2bb tempest-VolumeDependencyTests-535782399 None] Lock "cinder-quobyte-76a316bf-a082-4468-b71e-df2b787a152d" released by "_delete_snapshot" :: held 1.945s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:03:34 devstack sudo[104981]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-300101b2-ba2e-4cc5-921f-f3e24f22bd12 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdd017a4-646c-47cd-9b34-ca527c2331d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdd017a4-646c-47cd-9b34-ca527c2331d6.7f10af3c-0c0e-4238-8260-2e53cec0457d 1G" returned: 0 in 0.516s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-300101b2-ba2e-4cc5-921f-f3e24f22bd12 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdd017a4-646c-47cd-9b34-ca527c2331d6 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdd017a4-646c-47cd-9b34-ca527c2331d6.7f10af3c-0c0e-4238-8260-2e53cec0457d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9a8d9f1f-05ee-4cd7-9f1f-2ded8a84d2bb tempest-VolumeDependencyTests-535782399 None] Lock "cinder-quobyte-7aa09fe7-4865-42f0-b514-6a2402eb2d69" released by "delete_snapshot" :: held 1.985s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:03:34 devstack sudo[104995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdd017a4-646c-47cd-9b34-ca527c2331d6 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdd017a4-646c-47cd-9b34-ca527c2331d6.7f10af3c-0c0e-4238-8260-2e53cec0457d Nov 06 18:03:34 devstack sudo[104995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:34 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-9a8d9f1f-05ee-4cd7-9f1f-2ded8a84d2bb tempest-VolumeDependencyTests-535782399 None] Created reservations ['eca1e4bc-1fd1-4d53-b0c1-54d209dc8f88', 'dedeb3d6-67bd-495a-9571-682c33da30d6', '615ab765-ae13-4a58-a0ab-7ce405e6f5f7', '8a656983-bb6f-4bb9-a7da-87f680daaeaa'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:03:34 devstack sudo[104988]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dffca602-51f0-40d1-8902-a33ae45acdc2_xlbr_xyndevstack@QuobyteHD" returned: 1 in 0.382s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dffca602-51f0-40d1-8902-a33ae45acdc2_xlbr_xyndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 18:03:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:34 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-9a8d9f1f-05ee-4cd7-9f1f-2ded8a84d2bb tempest-VolumeDependencyTests-535782399 None] Delete snapshot completed successfully. Nov 06 18:03:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9a8d9f1f-05ee-4cd7-9f1f-2ded8a84d2bb tempest-VolumeDependencyTests-535782399 None] Lock "cinder-76a316bf-a082-4468-b71e-df2b787a152d-delete_snapshot" released by "delete_snapshot" :: held 2.149s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:03:34 devstack sudo[104995]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-300101b2-ba2e-4cc5-921f-f3e24f22bd12 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdd017a4-646c-47cd-9b34-ca527c2331d6 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdd017a4-646c-47cd-9b34-ca527c2331d6.7f10af3c-0c0e-4238-8260-2e53cec0457d" returned: 0 in 0.309s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:34 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-300101b2-ba2e-4cc5-921f-f3e24f22bd12 tempest-ProjectMemberTests-819176810 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdd017a4-646c-47cd-9b34-ca527c2331d6.7f10af3c-0c0e-4238-8260-2e53cec0457d is being set with open permissions: ugo+rw Nov 06 18:03:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-300101b2-ba2e-4cc5-921f-f3e24f22bd12 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdd017a4-646c-47cd-9b34-ca527c2331d6.7f10af3c-0c0e-4238-8260-2e53cec0457d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:34 devstack sudo[105003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdd017a4-646c-47cd-9b34-ca527c2331d6.7f10af3c-0c0e-4238-8260-2e53cec0457d Nov 06 18:03:34 devstack sudo[105003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:34 devstack sudo[105003]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-300101b2-ba2e-4cc5-921f-f3e24f22bd12 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdd017a4-646c-47cd-9b34-ca527c2331d6.7f10af3c-0c0e-4238-8260-2e53cec0457d" returned: 0 in 0.250s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-300101b2-ba2e-4cc5-921f-f3e24f22bd12 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdd017a4-646c-47cd-9b34-ca527c2331d6.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:34 devstack sudo[105006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdd017a4-646c-47cd-9b34-ca527c2331d6.info Nov 06 18:03:34 devstack sudo[105006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:34 devstack sudo[105006]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-300101b2-ba2e-4cc5-921f-f3e24f22bd12 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdd017a4-646c-47cd-9b34-ca527c2331d6.info" returned: 0 in 0.276s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:34 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-300101b2-ba2e-4cc5-921f-f3e24f22bd12 tempest-ProjectMemberTests-819176810 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdd017a4-646c-47cd-9b34-ca527c2331d6.info is being set with open permissions: ugo+rw Nov 06 18:03:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-300101b2-ba2e-4cc5-921f-f3e24f22bd12 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdd017a4-646c-47cd-9b34-ca527c2331d6.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:34 devstack sudo[105009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdd017a4-646c-47cd-9b34-ca527c2331d6.info Nov 06 18:03:34 devstack sudo[105009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:35 devstack sudo[105009]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-300101b2-ba2e-4cc5-921f-f3e24f22bd12 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdd017a4-646c-47cd-9b34-ca527c2331d6.info" returned: 0 in 0.249s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-300101b2-ba2e-4cc5-921f-f3e24f22bd12 tempest-ProjectMemberTests-819176810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.166s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6c54718a-112d-4afd-b033-67e9410d1534 tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:35 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-6c54718a-112d-4afd-b033-67e9410d1534 tempest-CreateVolumesFromSnapshotTest-192351063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:03:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-472267037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f16a30d-32fc-4a8f-a868-f8368fa74425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a7e599b329e494894499817e4d2aa68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:03:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:03:33Z,use_quota=True,user_id='9e93136380c74f18b836af165584c6ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:03:35 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-6c54718a-112d-4afd-b033-67e9410d1534 tempest-CreateVolumesFromSnapshotTest-192351063 None] Creating volume 6f16a30d-32fc-4a8f-a868-f8368fa74425 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:03:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6c54718a-112d-4afd-b033-67e9410d1534 tempest-CreateVolumesFromSnapshotTest-192351063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6c54718a-112d-4afd-b033-67e9410d1534 tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:35 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-6c54718a-112d-4afd-b033-67e9410d1534 tempest-CreateVolumesFromSnapshotTest-192351063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:03:35 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-6c54718a-112d-4afd-b033-67e9410d1534 tempest-CreateVolumesFromSnapshotTest-192351063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:03:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6c54718a-112d-4afd-b033-67e9410d1534 tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:35 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-6c54718a-112d-4afd-b033-67e9410d1534 tempest-CreateVolumesFromSnapshotTest-192351063 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:03:35 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-6c54718a-112d-4afd-b033-67e9410d1534 tempest-CreateVolumesFromSnapshotTest-192351063 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:03:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6c54718a-112d-4afd-b033-67e9410d1534 tempest-CreateVolumesFromSnapshotTest-192351063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f16a30d-32fc-4a8f-a868-f8368fa74425 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:35 devstack sudo[105012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f16a30d-32fc-4a8f-a868-f8368fa74425 1073741824 Nov 06 18:03:35 devstack sudo[105012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:35 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-300101b2-ba2e-4cc5-921f-f3e24f22bd12 tempest-ProjectMemberTests-819176810 None] Create snapshot completed successfully Nov 06 18:03:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-00ef431f-b1bd-4cda-90bc-c528999ce561 tempest-VolumeDependencyTests-535782399 None] Acquiring lock "cinder-7aa09fe7-4865-42f0-b514-6a2402eb2d69-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:03:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-00ef431f-b1bd-4cda-90bc-c528999ce561 tempest-VolumeDependencyTests-535782399 None] Lock "cinder-7aa09fe7-4865-42f0-b514-6a2402eb2d69-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:03:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-00ef431f-b1bd-4cda-90bc-c528999ce561 tempest-VolumeDependencyTests-535782399 None] Acquiring lock "cinder-quobyte-7aa09fe7-4865-42f0-b514-6a2402eb2d69" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:03:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-00ef431f-b1bd-4cda-90bc-c528999ce561 tempest-VolumeDependencyTests-535782399 None] Lock "cinder-quobyte-7aa09fe7-4865-42f0-b514-6a2402eb2d69" acquired by "delete_volume" :: waited 0.015s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:03:35 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[714353fa-f73c-4101-b4f6-ca6a5dee0cce]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:03:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-00ef431f-b1bd-4cda-90bc-c528999ce561 tempest-VolumeDependencyTests-535782399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:35 devstack sudo[105014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69 Nov 06 18:03:35 devstack sudo[105014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:35 devstack sudo[105012]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6c54718a-112d-4afd-b033-67e9410d1534 tempest-CreateVolumesFromSnapshotTest-192351063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f16a30d-32fc-4a8f-a868-f8368fa74425 1073741824" returned: 0 in 0.440s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6c54718a-112d-4afd-b033-67e9410d1534 tempest-CreateVolumesFromSnapshotTest-192351063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f16a30d-32fc-4a8f-a868-f8368fa74425 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:35 devstack sudo[105019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f16a30d-32fc-4a8f-a868-f8368fa74425 Nov 06 18:03:35 devstack sudo[105019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:35 devstack sudo[105014]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-00ef431f-b1bd-4cda-90bc-c528999ce561 tempest-VolumeDependencyTests-535782399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69" returned: 0 in 0.384s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-00ef431f-b1bd-4cda-90bc-c528999ce561 tempest-VolumeDependencyTests-535782399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:35 devstack sudo[105024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69 Nov 06 18:03:35 devstack sudo[105024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5e105702-77c6-4169-8733-42cdabfd616a tempest-ProjectMemberTests-819176810 None] Acquiring lock "cinder-7f10af3c-0c0e-4238-8260-2e53cec0457d-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:03:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5e105702-77c6-4169-8733-42cdabfd616a tempest-ProjectMemberTests-819176810 None] Lock "cinder-7f10af3c-0c0e-4238-8260-2e53cec0457d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:03:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5e105702-77c6-4169-8733-42cdabfd616a tempest-ProjectMemberTests-819176810 None] Acquiring lock "cinder-quobyte-fdd017a4-646c-47cd-9b34-ca527c2331d6" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:03:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5e105702-77c6-4169-8733-42cdabfd616a tempest-ProjectMemberTests-819176810 None] Lock "cinder-quobyte-fdd017a4-646c-47cd-9b34-ca527c2331d6" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:03:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5e105702-77c6-4169-8733-42cdabfd616a tempest-ProjectMemberTests-819176810 None] Acquiring lock "cinder-quobyte-7f10af3c-0c0e-4238-8260-2e53cec0457d" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:03:35 devstack sudo[105019]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5e105702-77c6-4169-8733-42cdabfd616a tempest-ProjectMemberTests-819176810 None] Lock "cinder-quobyte-7f10af3c-0c0e-4238-8260-2e53cec0457d" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:03:35 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-5e105702-77c6-4169-8733-42cdabfd616a tempest-ProjectMemberTests-819176810 None] Deleting offline snapshot 7f10af3c-0c0e-4238-8260-2e53cec0457d of volume fdd017a4-646c-47cd-9b34-ca527c2331d6 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:03:35 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-5e105702-77c6-4169-8733-42cdabfd616a tempest-ProjectMemberTests-819176810 None] snapshot_file for this snap is: volume-fdd017a4-646c-47cd-9b34-ca527c2331d6.7f10af3c-0c0e-4238-8260-2e53cec0457d {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:03:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6c54718a-112d-4afd-b033-67e9410d1534 tempest-CreateVolumesFromSnapshotTest-192351063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f16a30d-32fc-4a8f-a868-f8368fa74425" returned: 0 in 0.340s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:35 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-6c54718a-112d-4afd-b033-67e9410d1534 tempest-CreateVolumesFromSnapshotTest-192351063 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:03:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6c54718a-112d-4afd-b033-67e9410d1534 tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.857s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:35 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:03:31Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9945ff40-8db7-43d4-b0d6-e8083322314e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08258bfd343b48a984c64c1d4253e08a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:03:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:03:32Z,use_quota=True,user_id='6d146616c1ec427d919137dd19421ee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:03:35 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] Creating volume 9945ff40-8db7-43d4-b0d6-e8083322314e {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:03:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:35 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:03:35 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:03:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:35 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:03:35 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:03:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9945ff40-8db7-43d4-b0d6-e8083322314e 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:36 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[845f4a1d-fdd2-4b22-add4-158d9e0fa407]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:03:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5e105702-77c6-4169-8733-42cdabfd616a tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdd017a4-646c-47cd-9b34-ca527c2331d6.7f10af3c-0c0e-4238-8260-2e53cec0457d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:36 devstack sudo[105028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9945ff40-8db7-43d4-b0d6-e8083322314e 1073741824 Nov 06 18:03:36 devstack sudo[105028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:36 devstack sudo[105024]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6c54718a-112d-4afd-b033-67e9410d1534 tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d9cc9cf-df4a-4e7f-9e3d-39fb7d3101ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f16a30d-32fc-4a8f-a868-f8368fa74425', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6c54718a-112d-4afd-b033-67e9410d1534 tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (852620c7-b259-4d21-876b-b2ec4f121060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-00ef431f-b1bd-4cda-90bc-c528999ce561 tempest-VolumeDependencyTests-535782399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-7aa09fe7-4865-42f0-b514-6a2402eb2d69" returned: 0 in 0.306s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-00ef431f-b1bd-4cda-90bc-c528999ce561 tempest-VolumeDependencyTests-535782399 None] Lock "cinder-quobyte-7aa09fe7-4865-42f0-b514-6a2402eb2d69" released by "delete_volume" :: held 0.775s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:03:36 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-6c54718a-112d-4afd-b033-67e9410d1534 tempest-CreateVolumesFromSnapshotTest-192351063 None] Volume volume-6f16a30d-32fc-4a8f-a868-f8368fa74425 (6f16a30d-32fc-4a8f-a868-f8368fa74425): created successfully Nov 06 18:03:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6c54718a-112d-4afd-b033-67e9410d1534 tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (852620c7-b259-4d21-876b-b2ec4f121060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6c54718a-112d-4afd-b033-67e9410d1534 tempest-CreateVolumesFromSnapshotTest-192351063 None] Flow 'volume_create_manager' (0af93bef-d509-4d43-80fc-6393ca9a197d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:03:36 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-6c54718a-112d-4afd-b033-67e9410d1534 tempest-CreateVolumesFromSnapshotTest-192351063 None] Created volume successfully. Nov 06 18:03:36 devstack sudo[105029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdd017a4-646c-47cd-9b34-ca527c2331d6.7f10af3c-0c0e-4238-8260-2e53cec0457d Nov 06 18:03:36 devstack sudo[105029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:36 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-00ef431f-b1bd-4cda-90bc-c528999ce561 tempest-VolumeDependencyTests-535782399 None] Created reservations ['efad778d-7586-4a73-b1da-69ebd0de1cc3', '0c63eb89-66ee-498c-a1f5-a7408c1a56de', '920205b6-ee2e-4e40-978c-adc9fb1974df', 'f55f1c42-42f2-4e23-8211-94fb68efd99c'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:03:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-00ef431f-b1bd-4cda-90bc-c528999ce561 tempest-VolumeDependencyTests-535782399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-00ef431f-b1bd-4cda-90bc-c528999ce561 tempest-VolumeDependencyTests-535782399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:36 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-00ef431f-b1bd-4cda-90bc-c528999ce561 tempest-VolumeDependencyTests-535782399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:03:36 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-00ef431f-b1bd-4cda-90bc-c528999ce561 tempest-VolumeDependencyTests-535782399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:03:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-00ef431f-b1bd-4cda-90bc-c528999ce561 tempest-VolumeDependencyTests-535782399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-00ef431f-b1bd-4cda-90bc-c528999ce561 tempest-VolumeDependencyTests-535782399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:36 devstack sudo[105037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:03:36 devstack sudo[105037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ba12d6c6-f422-4cec-9048-dac1f41a463d tempest-VolumeDependencyTests-535782399 None] Acquiring lock "cinder-35f68221-25eb-4945-a2ad-78a30a00ffb0-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:03:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ba12d6c6-f422-4cec-9048-dac1f41a463d tempest-VolumeDependencyTests-535782399 None] Lock "cinder-35f68221-25eb-4945-a2ad-78a30a00ffb0-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:03:36 devstack sudo[105029]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5e105702-77c6-4169-8733-42cdabfd616a tempest-ProjectMemberTests-819176810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdd017a4-646c-47cd-9b34-ca527c2331d6.7f10af3c-0c0e-4238-8260-2e53cec0457d" returned: 0 in 0.542s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:36 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-5e105702-77c6-4169-8733-42cdabfd616a tempest-ProjectMemberTests-819176810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fdd017a4-646c-47cd-9b34-ca527c2331d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:03:36 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b3ae21-0823-4633-811d-db64d27e93f0]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:03:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5e105702-77c6-4169-8733-42cdabfd616a tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdd017a4-646c-47cd-9b34-ca527c2331d6 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:36 devstack sudo[105028]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ba12d6c6-f422-4cec-9048-dac1f41a463d tempest-VolumeDependencyTests-535782399 None] Acquiring lock "cinder-quobyte-35f68221-25eb-4945-a2ad-78a30a00ffb0" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:03:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9945ff40-8db7-43d4-b0d6-e8083322314e 1073741824" returned: 0 in 0.648s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ba12d6c6-f422-4cec-9048-dac1f41a463d tempest-VolumeDependencyTests-535782399 None] Lock "cinder-quobyte-35f68221-25eb-4945-a2ad-78a30a00ffb0" acquired by "delete_volume" :: waited 0.027s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:03:36 devstack sudo[105037]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-00ef431f-b1bd-4cda-90bc-c528999ce561 tempest-VolumeDependencyTests-535782399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.390s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:36 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-00ef431f-b1bd-4cda-90bc-c528999ce561 tempest-VolumeDependencyTests-535782399 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:03:36 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-00ef431f-b1bd-4cda-90bc-c528999ce561 tempest-VolumeDependencyTests-535782399 None] Deleted volume successfully. Nov 06 18:03:36 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[417293c6-9b0b-48c3-802e-f7a0f0d1b4b8]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:03:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ba12d6c6-f422-4cec-9048-dac1f41a463d tempest-VolumeDependencyTests-535782399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-35f68221-25eb-4945-a2ad-78a30a00ffb0 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-00ef431f-b1bd-4cda-90bc-c528999ce561 tempest-VolumeDependencyTests-535782399 None] Lock "cinder-7aa09fe7-4865-42f0-b514-6a2402eb2d69-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:03:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9945ff40-8db7-43d4-b0d6-e8083322314e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:36 devstack sudo[105044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdd017a4-646c-47cd-9b34-ca527c2331d6 Nov 06 18:03:36 devstack sudo[105044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:36 devstack sudo[105046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9945ff40-8db7-43d4-b0d6-e8083322314e Nov 06 18:03:36 devstack sudo[105046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:36 devstack sudo[105045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-35f68221-25eb-4945-a2ad-78a30a00ffb0 Nov 06 18:03:36 devstack sudo[105045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:36 devstack sudo[105046]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9945ff40-8db7-43d4-b0d6-e8083322314e" returned: 0 in 0.274s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:37 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:03:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:37 devstack cinder-volume[87068]: DEBUG cinder.volume.volume_utils [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] Attempting download of dffca602-51f0-40d1-8902-a33ae45acdc2 ((None, [{'url': 'file:///opt/stack/data/glance/images/dffca602-51f0-40d1-8902-a33ae45acdc2', 'metadata': {}}])) to volume 9945ff40-8db7-43d4-b0d6-e8083322314e. {{(pid=87068) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 18:03:37 devstack sudo[105044]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5e105702-77c6-4169-8733-42cdabfd616a tempest-ProjectMemberTests-819176810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdd017a4-646c-47cd-9b34-ca527c2331d6" returned: 0 in 0.463s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5e105702-77c6-4169-8733-42cdabfd616a tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdd017a4-646c-47cd-9b34-ca527c2331d6.7f10af3c-0c0e-4238-8260-2e53cec0457d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:37 devstack sudo[105056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdd017a4-646c-47cd-9b34-ca527c2331d6.7f10af3c-0c0e-4238-8260-2e53cec0457d Nov 06 18:03:37 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b56cef-c3f9-4dad-a356-ac862336a874]: (4, 'raw') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:03:37 devstack sudo[105056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dffca602-51f0-40d1-8902-a33ae45acdc2_rkmw4qli {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:37 devstack sudo[105045]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ba12d6c6-f422-4cec-9048-dac1f41a463d tempest-VolumeDependencyTests-535782399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-35f68221-25eb-4945-a2ad-78a30a00ffb0" returned: 0 in 0.454s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ba12d6c6-f422-4cec-9048-dac1f41a463d tempest-VolumeDependencyTests-535782399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-35f68221-25eb-4945-a2ad-78a30a00ffb0 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:37 devstack sudo[105061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-35f68221-25eb-4945-a2ad-78a30a00ffb0 Nov 06 18:03:37 devstack sudo[105061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:37 devstack sudo[105060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dffca602-51f0-40d1-8902-a33ae45acdc2_rkmw4qli Nov 06 18:03:37 devstack sudo[105060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f5b142a0-8ea0-49f5-9cba-0812bb5edf96 tempest-CreateVolumesFromSnapshotTest-192351063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f5b142a0-8ea0-49f5-9cba-0812bb5edf96 tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:37 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-f5b142a0-8ea0-49f5-9cba-0812bb5edf96 tempest-CreateVolumesFromSnapshotTest-192351063 None] Creating offline snapshot 43390945-db4d-4826-8495-1c743aae7feb of volume 6f16a30d-32fc-4a8f-a868-f8368fa74425 {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:03:37 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc14cdca-2091-42df-a9c6-6bc503b5e839]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:03:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f5b142a0-8ea0-49f5-9cba-0812bb5edf96 tempest-CreateVolumesFromSnapshotTest-192351063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f16a30d-32fc-4a8f-a868-f8368fa74425 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:37 devstack sudo[105061]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ba12d6c6-f422-4cec-9048-dac1f41a463d tempest-VolumeDependencyTests-535782399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-35f68221-25eb-4945-a2ad-78a30a00ffb0" returned: 0 in 0.315s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ba12d6c6-f422-4cec-9048-dac1f41a463d tempest-VolumeDependencyTests-535782399 None] Lock "cinder-quobyte-35f68221-25eb-4945-a2ad-78a30a00ffb0" released by "delete_volume" :: held 0.831s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:03:37 devstack sudo[105056]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5e105702-77c6-4169-8733-42cdabfd616a tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdd017a4-646c-47cd-9b34-ca527c2331d6.7f10af3c-0c0e-4238-8260-2e53cec0457d" returned: 0 in 0.418s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5e105702-77c6-4169-8733-42cdabfd616a tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdd017a4-646c-47cd-9b34-ca527c2331d6.7f10af3c-0c0e-4238-8260-2e53cec0457d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:37 devstack sudo[105060]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dffca602-51f0-40d1-8902-a33ae45acdc2_rkmw4qli" returned: 0 in 0.399s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dffca602-51f0-40d1-8902-a33ae45acdc2_rkmw4qli {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:37 devstack sudo[105072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdd017a4-646c-47cd-9b34-ca527c2331d6.7f10af3c-0c0e-4238-8260-2e53cec0457d Nov 06 18:03:37 devstack sudo[105072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:37 devstack sudo[105069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f16a30d-32fc-4a8f-a868-f8368fa74425 Nov 06 18:03:37 devstack sudo[105069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:37 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-ba12d6c6-f422-4cec-9048-dac1f41a463d tempest-VolumeDependencyTests-535782399 None] Created reservations ['aff0ae93-733d-419d-a0d7-bde45feec11a', '0c235095-6495-4d0c-9bce-b19441ad5cd8', 'd634656b-2e5f-45d8-b6bd-3fa834a6390e', '10c93d33-619a-4487-83e9-55af07b855ce'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:03:37 devstack sudo[105073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dffca602-51f0-40d1-8902-a33ae45acdc2_rkmw4qli Nov 06 18:03:37 devstack sudo[105073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ba12d6c6-f422-4cec-9048-dac1f41a463d tempest-VolumeDependencyTests-535782399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ba12d6c6-f422-4cec-9048-dac1f41a463d tempest-VolumeDependencyTests-535782399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:37 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ba12d6c6-f422-4cec-9048-dac1f41a463d tempest-VolumeDependencyTests-535782399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:03:37 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ba12d6c6-f422-4cec-9048-dac1f41a463d tempest-VolumeDependencyTests-535782399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:03:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ba12d6c6-f422-4cec-9048-dac1f41a463d tempest-VolumeDependencyTests-535782399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ba12d6c6-f422-4cec-9048-dac1f41a463d tempest-VolumeDependencyTests-535782399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:37 devstack sudo[105077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:03:37 devstack sudo[105077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:37 devstack sudo[105072]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5e105702-77c6-4169-8733-42cdabfd616a tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdd017a4-646c-47cd-9b34-ca527c2331d6.7f10af3c-0c0e-4238-8260-2e53cec0457d" returned: 0 in 0.309s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5e105702-77c6-4169-8733-42cdabfd616a tempest-ProjectMemberTests-819176810 None] Lock "cinder-quobyte-7f10af3c-0c0e-4238-8260-2e53cec0457d" released by "_delete_snapshot" :: held 1.933s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:03:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5e105702-77c6-4169-8733-42cdabfd616a tempest-ProjectMemberTests-819176810 None] Lock "cinder-quobyte-fdd017a4-646c-47cd-9b34-ca527c2331d6" released by "delete_snapshot" :: held 1.967s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:03:37 devstack sudo[105073]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dffca602-51f0-40d1-8902-a33ae45acdc2_rkmw4qli" returned: 1 in 0.375s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dffca602-51f0-40d1-8902-a33ae45acdc2_rkmw4qli' failed. Not Retrying. {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 18:03:37 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a288f6d7-a920-4e85-8b83-b238e70ef083]: (4, 'raw') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:03:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dffca602-51f0-40d1-8902-a33ae45acdc2_xlbr_xyndevstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:37 devstack sudo[105069]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:37 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-5e105702-77c6-4169-8733-42cdabfd616a tempest-ProjectMemberTests-819176810 None] Created reservations ['dde7f274-d000-4610-8a8d-79ae2326ff19', 'a23775ce-304c-4892-99ec-ae25fe241b16', '48b2cdc6-655f-432e-9107-2e65fe895e07', '0b16688d-abd2-4bc9-b059-9fece1643a35'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:03:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f5b142a0-8ea0-49f5-9cba-0812bb5edf96 tempest-CreateVolumesFromSnapshotTest-192351063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f16a30d-32fc-4a8f-a868-f8368fa74425" returned: 0 in 0.537s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f5b142a0-8ea0-49f5-9cba-0812bb5edf96 tempest-CreateVolumesFromSnapshotTest-192351063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f16a30d-32fc-4a8f-a868-f8368fa74425,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f16a30d-32fc-4a8f-a868-f8368fa74425.43390945-db4d-4826-8495-1c743aae7feb 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:37 devstack sudo[105077]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ba12d6c6-f422-4cec-9048-dac1f41a463d tempest-VolumeDependencyTests-535782399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.303s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:38 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-ba12d6c6-f422-4cec-9048-dac1f41a463d tempest-VolumeDependencyTests-535782399 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:03:38 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-ba12d6c6-f422-4cec-9048-dac1f41a463d tempest-VolumeDependencyTests-535782399 None] Deleted volume successfully. Nov 06 18:03:38 devstack sudo[105087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f16a30d-32fc-4a8f-a868-f8368fa74425,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f16a30d-32fc-4a8f-a868-f8368fa74425.43390945-db4d-4826-8495-1c743aae7feb 1G Nov 06 18:03:38 devstack sudo[105087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:38 devstack sudo[105085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dffca602-51f0-40d1-8902-a33ae45acdc2_xlbr_xyndevstack@QuobyteHD Nov 06 18:03:38 devstack sudo[105085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:38 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ba12d6c6-f422-4cec-9048-dac1f41a463d tempest-VolumeDependencyTests-535782399 None] Lock "cinder-35f68221-25eb-4945-a2ad-78a30a00ffb0-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:03:38 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-5e105702-77c6-4169-8733-42cdabfd616a tempest-ProjectMemberTests-819176810 None] Delete snapshot completed successfully. Nov 06 18:03:38 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5e105702-77c6-4169-8733-42cdabfd616a tempest-ProjectMemberTests-819176810 None] Lock "cinder-7f10af3c-0c0e-4238-8260-2e53cec0457d-delete_snapshot" released by "delete_snapshot" :: held 2.202s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:03:38 devstack sudo[105085]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dffca602-51f0-40d1-8902-a33ae45acdc2_xlbr_xyndevstack@QuobyteHD" returned: 0 in 0.371s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dffca602-51f0-40d1-8902-a33ae45acdc2_xlbr_xyndevstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:38 devstack sudo[105095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dffca602-51f0-40d1-8902-a33ae45acdc2_xlbr_xyndevstack@QuobyteHD Nov 06 18:03:38 devstack sudo[105095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:38 devstack sudo[105087]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f5b142a0-8ea0-49f5-9cba-0812bb5edf96 tempest-CreateVolumesFromSnapshotTest-192351063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f16a30d-32fc-4a8f-a868-f8368fa74425,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f16a30d-32fc-4a8f-a868-f8368fa74425.43390945-db4d-4826-8495-1c743aae7feb 1G" returned: 0 in 0.462s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f5b142a0-8ea0-49f5-9cba-0812bb5edf96 tempest-CreateVolumesFromSnapshotTest-192351063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f16a30d-32fc-4a8f-a868-f8368fa74425 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f16a30d-32fc-4a8f-a868-f8368fa74425.43390945-db4d-4826-8495-1c743aae7feb {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:38 devstack sudo[105098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f16a30d-32fc-4a8f-a868-f8368fa74425 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f16a30d-32fc-4a8f-a868-f8368fa74425.43390945-db4d-4826-8495-1c743aae7feb Nov 06 18:03:38 devstack sudo[105098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:38 devstack sudo[105095]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dffca602-51f0-40d1-8902-a33ae45acdc2_xlbr_xyndevstack@QuobyteHD" returned: 1 in 0.345s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dffca602-51f0-40d1-8902-a33ae45acdc2_xlbr_xyndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 18:03:38 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] dffca602-51f0-40d1-8902-a33ae45acdc2 was raw, converting to qcow2 {{(pid=87068) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 06 18:03:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_dffca602-51f0-40d1-8902-a33ae45acdc2_xlbr_xyndevstack@QuobyteHD /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9945ff40-8db7-43d4-b0d6-e8083322314e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:38 devstack sudo[105103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_dffca602-51f0-40d1-8902-a33ae45acdc2_xlbr_xyndevstack@QuobyteHD /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9945ff40-8db7-43d4-b0d6-e8083322314e Nov 06 18:03:38 devstack sudo[105103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:38 devstack sudo[105098]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f5b142a0-8ea0-49f5-9cba-0812bb5edf96 tempest-CreateVolumesFromSnapshotTest-192351063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f16a30d-32fc-4a8f-a868-f8368fa74425 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f16a30d-32fc-4a8f-a868-f8368fa74425.43390945-db4d-4826-8495-1c743aae7feb" returned: 0 in 0.341s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:38 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-f5b142a0-8ea0-49f5-9cba-0812bb5edf96 tempest-CreateVolumesFromSnapshotTest-192351063 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f16a30d-32fc-4a8f-a868-f8368fa74425.43390945-db4d-4826-8495-1c743aae7feb is being set with open permissions: ugo+rw Nov 06 18:03:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f5b142a0-8ea0-49f5-9cba-0812bb5edf96 tempest-CreateVolumesFromSnapshotTest-192351063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f16a30d-32fc-4a8f-a868-f8368fa74425.43390945-db4d-4826-8495-1c743aae7feb {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:38 devstack sudo[105108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f16a30d-32fc-4a8f-a868-f8368fa74425.43390945-db4d-4826-8495-1c743aae7feb Nov 06 18:03:38 devstack sudo[105108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:39 devstack sudo[105108]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f5b142a0-8ea0-49f5-9cba-0812bb5edf96 tempest-CreateVolumesFromSnapshotTest-192351063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f16a30d-32fc-4a8f-a868-f8368fa74425.43390945-db4d-4826-8495-1c743aae7feb" returned: 0 in 0.266s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f5b142a0-8ea0-49f5-9cba-0812bb5edf96 tempest-CreateVolumesFromSnapshotTest-192351063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f16a30d-32fc-4a8f-a868-f8368fa74425.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:39 devstack sudo[105114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f16a30d-32fc-4a8f-a868-f8368fa74425.info Nov 06 18:03:39 devstack sudo[105114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:39 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-952d81d1-8a4a-486a-b96a-f0b4322f7a92 tempest-ProjectMemberTests-819176810 None] Acquiring lock "cinder-fdd017a4-646c-47cd-9b34-ca527c2331d6-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:03:39 devstack sudo[105103]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_dffca602-51f0-40d1-8902-a33ae45acdc2_xlbr_xyndevstack@QuobyteHD /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9945ff40-8db7-43d4-b0d6-e8083322314e" returned: 0 in 0.607s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:39 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_dffca602-51f0-40d1-8902-a33ae45acdc2_xlbr_xyndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9945ff40-8db7-43d4-b0d6-e8083322314e {{(pid=87068) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 18:03:39 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] Converted 0.00 MB image at 0.00 MB/s Nov 06 18:03:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9945ff40-8db7-43d4-b0d6-e8083322314e 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:39 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-952d81d1-8a4a-486a-b96a-f0b4322f7a92 tempest-ProjectMemberTests-819176810 None] Lock "cinder-fdd017a4-646c-47cd-9b34-ca527c2331d6-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:03:39 devstack sudo[105117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9945ff40-8db7-43d4-b0d6-e8083322314e 1G Nov 06 18:03:39 devstack sudo[105117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:39 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-952d81d1-8a4a-486a-b96a-f0b4322f7a92 tempest-ProjectMemberTests-819176810 None] Acquiring lock "cinder-quobyte-fdd017a4-646c-47cd-9b34-ca527c2331d6" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:03:39 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-952d81d1-8a4a-486a-b96a-f0b4322f7a92 tempest-ProjectMemberTests-819176810 None] Lock "cinder-quobyte-fdd017a4-646c-47cd-9b34-ca527c2331d6" acquired by "delete_volume" :: waited 0.018s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:03:39 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef25ab4-e12f-4744-b6ed-2e1a2aa49513]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:03:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-952d81d1-8a4a-486a-b96a-f0b4322f7a92 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdd017a4-646c-47cd-9b34-ca527c2331d6 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:39 devstack sudo[105114]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f5b142a0-8ea0-49f5-9cba-0812bb5edf96 tempest-CreateVolumesFromSnapshotTest-192351063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f16a30d-32fc-4a8f-a868-f8368fa74425.info" returned: 0 in 0.357s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:39 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-f5b142a0-8ea0-49f5-9cba-0812bb5edf96 tempest-CreateVolumesFromSnapshotTest-192351063 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f16a30d-32fc-4a8f-a868-f8368fa74425.info is being set with open permissions: ugo+rw Nov 06 18:03:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f5b142a0-8ea0-49f5-9cba-0812bb5edf96 tempest-CreateVolumesFromSnapshotTest-192351063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f16a30d-32fc-4a8f-a868-f8368fa74425.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:39 devstack sudo[105121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f16a30d-32fc-4a8f-a868-f8368fa74425.info Nov 06 18:03:39 devstack sudo[105121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:39 devstack sudo[105120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdd017a4-646c-47cd-9b34-ca527c2331d6 Nov 06 18:03:39 devstack sudo[105120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:39 devstack sudo[105117]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9945ff40-8db7-43d4-b0d6-e8083322314e 1G" returned: 0 in 0.434s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:39 devstack cinder-volume[87068]: DEBUG cinder.volume.volume_utils [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] Downloaded image dffca602-51f0-40d1-8902-a33ae45acdc2 ((None, [{'url': 'file:///opt/stack/data/glance/images/dffca602-51f0-40d1-8902-a33ae45acdc2', 'metadata': {}}])) to volume 9945ff40-8db7-43d4-b0d6-e8083322314e successfully. {{(pid=87068) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 18:03:39 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] Temporary image dffca602-51f0-40d1-8902-a33ae45acdc2 for user 6d146616c1ec427d919137dd19421ee8 is deleted. {{(pid=87068) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 06 18:03:39 devstack cinder-volume[87068]: DEBUG cinder.volume.volume_utils [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] Marking volume 9945ff40-8db7-43d4-b0d6-e8083322314e as bootable. {{(pid=87068) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 18:03:39 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] Copying metadata from image dffca602-51f0-40d1-8902-a33ae45acdc2 to 9945ff40-8db7-43d4-b0d6-e8083322314e. {{(pid=87068) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 18:03:39 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] Creating volume glance metadata for volume 9945ff40-8db7-43d4-b0d6-e8083322314e backed by image dffca602-51f0-40d1-8902-a33ae45acdc2 with: {'image_id': 'dffca602-51f0-40d1-8902-a33ae45acdc2', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'b3c48f21cea139e2ef96a8bd5cd73c7b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87068) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 18:03:39 devstack sudo[105121]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f5b142a0-8ea0-49f5-9cba-0812bb5edf96 tempest-CreateVolumesFromSnapshotTest-192351063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f16a30d-32fc-4a8f-a868-f8368fa74425.info" returned: 0 in 0.305s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f5b142a0-8ea0-49f5-9cba-0812bb5edf96 tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.391s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:39 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36b765cd-4cd6-4c4e-97da-810ad8962ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9945ff40-8db7-43d4-b0d6-e8083322314e', 'volume_size': 1, 'image_id': 'dffca602-51f0-40d1-8902-a33ae45acdc2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dffca602-51f0-40d1-8902-a33ae45acdc2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b3c48f21cea139e2ef96a8bd5cd73c7b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '08258bfd343b48a984c64c1d4253e08a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '558d893ff35a764ceb8ed09d8a67b83d109127b64d47c0101263c13a6923d5fa1f67a91891d2444fe2254a67a6bc94b7134b2c5f035dac4ea5c3d7dc796fa174', 'id': 'dffca602-51f0-40d1-8902-a33ae45acdc2', 'created_at': datetime.datetime(2026, 11, 6, 17, 3, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 17, 3, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dffca602-51f0-40d1-8902-a33ae45acdc2/file', 'properties': {}}, 'image_service': }' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:39 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ed549de-50f0-43ec-bb38-aa460ed39c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:39 devstack sudo[105120]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-952d81d1-8a4a-486a-b96a-f0b4322f7a92 tempest-ProjectMemberTests-819176810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdd017a4-646c-47cd-9b34-ca527c2331d6" returned: 0 in 0.460s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-952d81d1-8a4a-486a-b96a-f0b4322f7a92 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdd017a4-646c-47cd-9b34-ca527c2331d6 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:39 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] Volume volume-9945ff40-8db7-43d4-b0d6-e8083322314e (9945ff40-8db7-43d4-b0d6-e8083322314e): created successfully Nov 06 18:03:39 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ed549de-50f0-43ec-bb38-aa460ed39c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:39 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] Flow 'volume_create_manager' (a1789f35-305c-41a9-8a74-67d890450cf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:03:39 devstack sudo[105133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdd017a4-646c-47cd-9b34-ca527c2331d6 Nov 06 18:03:39 devstack sudo[105133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:39 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-f5b142a0-8ea0-49f5-9cba-0812bb5edf96 tempest-CreateVolumesFromSnapshotTest-192351063 None] Create snapshot completed successfully Nov 06 18:03:39 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-651b9147-ad36-4d7d-acae-25b380bc8164 tempest-VolumeImageDependencyTests-2044778419 None] Created volume successfully. Nov 06 18:03:40 devstack sudo[105133]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-952d81d1-8a4a-486a-b96a-f0b4322f7a92 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdd017a4-646c-47cd-9b34-ca527c2331d6" returned: 0 in 0.274s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-952d81d1-8a4a-486a-b96a-f0b4322f7a92 tempest-ProjectMemberTests-819176810 None] Lock "cinder-quobyte-fdd017a4-646c-47cd-9b34-ca527c2331d6" released by "delete_volume" :: held 0.819s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:03:40 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-952d81d1-8a4a-486a-b96a-f0b4322f7a92 tempest-ProjectMemberTests-819176810 None] Created reservations ['de110bee-10e2-49e1-89c3-2812669f1044', '7c6d5f3a-5df7-4305-b000-8f366866a4a1', '88ff177e-4bb7-4483-9119-94e40e0d8882', '0974db0a-55bc-4914-aa17-8b89245428fa'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:03:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-952d81d1-8a4a-486a-b96a-f0b4322f7a92 tempest-ProjectMemberTests-819176810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-952d81d1-8a4a-486a-b96a-f0b4322f7a92 tempest-ProjectMemberTests-819176810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:40 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-952d81d1-8a4a-486a-b96a-f0b4322f7a92 tempest-ProjectMemberTests-819176810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:03:40 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-952d81d1-8a4a-486a-b96a-f0b4322f7a92 tempest-ProjectMemberTests-819176810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:03:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-952d81d1-8a4a-486a-b96a-f0b4322f7a92 tempest-ProjectMemberTests-819176810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-952d81d1-8a4a-486a-b96a-f0b4322f7a92 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:40 devstack sudo[105136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:03:40 devstack sudo[105136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-89ba4f18-c1bd-4081-adf4-60df12ac1c0e tempest-VolumeImageDependencyTests-2044778419 None] Acquiring lock "cinder-9945ff40-8db7-43d4-b0d6-e8083322314e-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:03:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-89ba4f18-c1bd-4081-adf4-60df12ac1c0e tempest-VolumeImageDependencyTests-2044778419 None] Lock "cinder-9945ff40-8db7-43d4-b0d6-e8083322314e-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:03:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-89ba4f18-c1bd-4081-adf4-60df12ac1c0e tempest-VolumeImageDependencyTests-2044778419 None] Acquiring lock "cinder-quobyte-9945ff40-8db7-43d4-b0d6-e8083322314e" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:03:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-89ba4f18-c1bd-4081-adf4-60df12ac1c0e tempest-VolumeImageDependencyTests-2044778419 None] Lock "cinder-quobyte-9945ff40-8db7-43d4-b0d6-e8083322314e" acquired by "delete_volume" :: waited 0.024s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:03:40 devstack sudo[105136]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-952d81d1-8a4a-486a-b96a-f0b4322f7a92 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.402s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:40 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-952d81d1-8a4a-486a-b96a-f0b4322f7a92 tempest-ProjectMemberTests-819176810 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:03:40 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-952d81d1-8a4a-486a-b96a-f0b4322f7a92 tempest-ProjectMemberTests-819176810 None] Deleted volume successfully. Nov 06 18:03:40 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[433ad51e-d4c7-4972-a863-8d23c2dc9431]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:03:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-89ba4f18-c1bd-4081-adf4-60df12ac1c0e tempest-VolumeImageDependencyTests-2044778419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9945ff40-8db7-43d4-b0d6-e8083322314e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-952d81d1-8a4a-486a-b96a-f0b4322f7a92 tempest-ProjectMemberTests-819176810 None] Lock "cinder-fdd017a4-646c-47cd-9b34-ca527c2331d6-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:03:40 devstack sudo[105139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9945ff40-8db7-43d4-b0d6-e8083322314e Nov 06 18:03:40 devstack sudo[105139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:41 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-834632f9-043c-4176-9e2a-51f4fc0dc41e tempest-ProjectMemberTests-819176810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:03:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-834632f9-043c-4176-9e2a-51f4fc0dc41e tempest-ProjectMemberTests-819176810 None] Flow 'volume_create_manager' (a3948ed3-7349-49ea-a92f-82ea84d857f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:03:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-834632f9-043c-4176-9e2a-51f4fc0dc41e tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48281bca-bc91-4132-baf9-3ba99e10ad3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:41 devstack sudo[105139]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-89ba4f18-c1bd-4081-adf4-60df12ac1c0e tempest-VolumeImageDependencyTests-2044778419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9945ff40-8db7-43d4-b0d6-e8083322314e" returned: 0 in 0.525s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-89ba4f18-c1bd-4081-adf4-60df12ac1c0e tempest-VolumeImageDependencyTests-2044778419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9945ff40-8db7-43d4-b0d6-e8083322314e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-834632f9-043c-4176-9e2a-51f4fc0dc41e tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48281bca-bc91-4132-baf9-3ba99e10ad3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-220328878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffedd131-87bf-4fcb-8422-e47ace8a4da0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b97cd7ef94764995a9e8c62cda23171f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:03:41Z,use_quota=True,user_id='a34e6465a98c4c289547d49a900a6bde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:41 devstack sudo[105145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9945ff40-8db7-43d4-b0d6-e8083322314e Nov 06 18:03:41 devstack sudo[105145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-834632f9-043c-4176-9e2a-51f4fc0dc41e tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a91713d-d516-4736-a77f-8380cda28692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-834632f9-043c-4176-9e2a-51f4fc0dc41e tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a91713d-d516-4736-a77f-8380cda28692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-834632f9-043c-4176-9e2a-51f4fc0dc41e tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a126627-d9fb-4e3f-9065-93e6284f4e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-834632f9-043c-4176-9e2a-51f4fc0dc41e tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a126627-d9fb-4e3f-9065-93e6284f4e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffedd131-87bf-4fcb-8422-e47ace8a4da0', 'volume_name': 'volume-ffedd131-87bf-4fcb-8422-e47ace8a4da0', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-834632f9-043c-4176-9e2a-51f4fc0dc41e tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (601c6718-e854-4e6d-b228-70bdd46b90fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-834632f9-043c-4176-9e2a-51f4fc0dc41e tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (601c6718-e854-4e6d-b228-70bdd46b90fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-834632f9-043c-4176-9e2a-51f4fc0dc41e tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16a2a768-008f-4dd6-9372-5119eaf29038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:41 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-834632f9-043c-4176-9e2a-51f4fc0dc41e tempest-ProjectMemberTests-819176810 None] Volume ffedd131-87bf-4fcb-8422-e47ace8a4da0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffedd131-87bf-4fcb-8422-e47ace8a4da0', 'volume_size': 1} Nov 06 18:03:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-834632f9-043c-4176-9e2a-51f4fc0dc41e tempest-ProjectMemberTests-819176810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-834632f9-043c-4176-9e2a-51f4fc0dc41e tempest-ProjectMemberTests-819176810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:41 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-834632f9-043c-4176-9e2a-51f4fc0dc41e tempest-ProjectMemberTests-819176810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-220328878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffedd131-87bf-4fcb-8422-e47ace8a4da0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b97cd7ef94764995a9e8c62cda23171f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:03:41Z,use_quota=True,user_id='a34e6465a98c4c289547d49a900a6bde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:03:41 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-834632f9-043c-4176-9e2a-51f4fc0dc41e tempest-ProjectMemberTests-819176810 None] Creating volume ffedd131-87bf-4fcb-8422-e47ace8a4da0 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:03:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-834632f9-043c-4176-9e2a-51f4fc0dc41e tempest-ProjectMemberTests-819176810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-834632f9-043c-4176-9e2a-51f4fc0dc41e tempest-ProjectMemberTests-819176810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:41 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-834632f9-043c-4176-9e2a-51f4fc0dc41e tempest-ProjectMemberTests-819176810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:03:41 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-834632f9-043c-4176-9e2a-51f4fc0dc41e tempest-ProjectMemberTests-819176810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:03:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-834632f9-043c-4176-9e2a-51f4fc0dc41e tempest-ProjectMemberTests-819176810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:41 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-834632f9-043c-4176-9e2a-51f4fc0dc41e tempest-ProjectMemberTests-819176810 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:03:41 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-834632f9-043c-4176-9e2a-51f4fc0dc41e tempest-ProjectMemberTests-819176810 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:03:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-834632f9-043c-4176-9e2a-51f4fc0dc41e tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ffedd131-87bf-4fcb-8422-e47ace8a4da0 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:41 devstack sudo[105147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ffedd131-87bf-4fcb-8422-e47ace8a4da0 1073741824 Nov 06 18:03:41 devstack sudo[105147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:41 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e507619-6dbd-4a8c-8c31-81261cefbd7d tempest-CreateVolumesFromSnapshotTest-192351063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:03:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5e507619-6dbd-4a8c-8c31-81261cefbd7d tempest-CreateVolumesFromSnapshotTest-192351063 None] Flow 'volume_create_manager' (369a7e75-3429-4732-900d-328d7d345148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:03:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5e507619-6dbd-4a8c-8c31-81261cefbd7d tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a81afe54-2169-4218-a77f-62b14c9c4bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:41 devstack sudo[105145]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5e507619-6dbd-4a8c-8c31-81261cefbd7d tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a81afe54-2169-4218-a77f-62b14c9c4bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-575694036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb296304-5fea-430c-9feb-ca10b5e5844e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a7e599b329e494894499817e4d2aa68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:03:41Z,use_quota=True,user_id='9e93136380c74f18b836af165584c6ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5e507619-6dbd-4a8c-8c31-81261cefbd7d tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (407e89b2-b046-4cbe-9d8d-afd78fde9913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5e507619-6dbd-4a8c-8c31-81261cefbd7d tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (407e89b2-b046-4cbe-9d8d-afd78fde9913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5e507619-6dbd-4a8c-8c31-81261cefbd7d tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e201228e-8e79-4af1-b331-53aef8f16751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5e507619-6dbd-4a8c-8c31-81261cefbd7d tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e201228e-8e79-4af1-b331-53aef8f16751) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb296304-5fea-430c-9feb-ca10b5e5844e', 'volume_name': 'volume-cb296304-5fea-430c-9feb-ca10b5e5844e', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5e507619-6dbd-4a8c-8c31-81261cefbd7d tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d2d7827-7be9-4615-8be9-47241cc093f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5e507619-6dbd-4a8c-8c31-81261cefbd7d tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d2d7827-7be9-4615-8be9-47241cc093f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5e507619-6dbd-4a8c-8c31-81261cefbd7d tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed13efa6-3613-4b46-ab7b-06db055fe96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:41 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-5e507619-6dbd-4a8c-8c31-81261cefbd7d tempest-CreateVolumesFromSnapshotTest-192351063 None] Volume cb296304-5fea-430c-9feb-ca10b5e5844e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb296304-5fea-430c-9feb-ca10b5e5844e', 'volume_size': 1} Nov 06 18:03:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5e507619-6dbd-4a8c-8c31-81261cefbd7d tempest-CreateVolumesFromSnapshotTest-192351063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-89ba4f18-c1bd-4081-adf4-60df12ac1c0e tempest-VolumeImageDependencyTests-2044778419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-9945ff40-8db7-43d4-b0d6-e8083322314e" returned: 0 in 0.352s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:41 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-89ba4f18-c1bd-4081-adf4-60df12ac1c0e tempest-VolumeImageDependencyTests-2044778419 None] Lock "cinder-quobyte-9945ff40-8db7-43d4-b0d6-e8083322314e" released by "delete_volume" :: held 0.964s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:03:41 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-89ba4f18-c1bd-4081-adf4-60df12ac1c0e tempest-VolumeImageDependencyTests-2044778419 None] Created reservations ['35c952fa-8638-4470-a2eb-0264ce765a39', '59aab417-a3d1-42cd-9d2e-bf9f31bc7386', '1bfd3628-8991-4f4b-aaf0-794e3c07f379', '9ac3f93e-3e56-4e06-9c39-3599eb512ef7'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:03:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-89ba4f18-c1bd-4081-adf4-60df12ac1c0e tempest-VolumeImageDependencyTests-2044778419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-89ba4f18-c1bd-4081-adf4-60df12ac1c0e tempest-VolumeImageDependencyTests-2044778419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:41 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-89ba4f18-c1bd-4081-adf4-60df12ac1c0e tempest-VolumeImageDependencyTests-2044778419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:03:41 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-89ba4f18-c1bd-4081-adf4-60df12ac1c0e tempest-VolumeImageDependencyTests-2044778419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:03:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-89ba4f18-c1bd-4081-adf4-60df12ac1c0e tempest-VolumeImageDependencyTests-2044778419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-89ba4f18-c1bd-4081-adf4-60df12ac1c0e tempest-VolumeImageDependencyTests-2044778419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:41 devstack sudo[105153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:03:41 devstack sudo[105153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:42 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffa55187-846c-4730-a03d-142914ca53b1 tempest-CreateVolumesFromSnapshotTest-192351063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:03:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ffa55187-846c-4730-a03d-142914ca53b1 tempest-CreateVolumesFromSnapshotTest-192351063 None] Flow 'volume_create_manager' (60fb32d9-bb9d-4a7e-8f7c-63b9d04878ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:03:42 devstack sudo[105147]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ffa55187-846c-4730-a03d-142914ca53b1 tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f97e1686-65df-4bf0-a154-2f4a454063f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-834632f9-043c-4176-9e2a-51f4fc0dc41e tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ffedd131-87bf-4fcb-8422-e47ace8a4da0 1073741824" returned: 0 in 0.822s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ffa55187-846c-4730-a03d-142914ca53b1 tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f97e1686-65df-4bf0-a154-2f4a454063f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:03:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-892425289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a03b789c-80be-4d49-86aa-03448a5d8824,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a7e599b329e494894499817e4d2aa68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:03:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:03:42Z,use_quota=True,user_id='9e93136380c74f18b836af165584c6ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ffa55187-846c-4730-a03d-142914ca53b1 tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1ac9bb5-0a9a-4311-96ee-614acc411ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ffa55187-846c-4730-a03d-142914ca53b1 tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1ac9bb5-0a9a-4311-96ee-614acc411ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ffa55187-846c-4730-a03d-142914ca53b1 tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7f8f399-462a-471e-9a7e-147b86403121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ffa55187-846c-4730-a03d-142914ca53b1 tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7f8f399-462a-471e-9a7e-147b86403121) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a03b789c-80be-4d49-86aa-03448a5d8824', 'volume_name': 'volume-a03b789c-80be-4d49-86aa-03448a5d8824', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ffa55187-846c-4730-a03d-142914ca53b1 tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f22cf8ac-56a6-4271-abd4-a3398ede7543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ffa55187-846c-4730-a03d-142914ca53b1 tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f22cf8ac-56a6-4271-abd4-a3398ede7543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ffa55187-846c-4730-a03d-142914ca53b1 tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4431796f-42f8-4158-9855-7c0427e3daa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:42 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-ffa55187-846c-4730-a03d-142914ca53b1 tempest-CreateVolumesFromSnapshotTest-192351063 None] Volume a03b789c-80be-4d49-86aa-03448a5d8824: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a03b789c-80be-4d49-86aa-03448a5d8824', 'volume_size': 1} Nov 06 18:03:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ffa55187-846c-4730-a03d-142914ca53b1 tempest-CreateVolumesFromSnapshotTest-192351063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:42 devstack sudo[105153]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-89ba4f18-c1bd-4081-adf4-60df12ac1c0e tempest-VolumeImageDependencyTests-2044778419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.440s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:42 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-89ba4f18-c1bd-4081-adf4-60df12ac1c0e tempest-VolumeImageDependencyTests-2044778419 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:03:42 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-89ba4f18-c1bd-4081-adf4-60df12ac1c0e tempest-VolumeImageDependencyTests-2044778419 None] Deleted volume successfully. Nov 06 18:03:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-834632f9-043c-4176-9e2a-51f4fc0dc41e tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ffedd131-87bf-4fcb-8422-e47ace8a4da0 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:42 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-89ba4f18-c1bd-4081-adf4-60df12ac1c0e tempest-VolumeImageDependencyTests-2044778419 None] Lock "cinder-9945ff40-8db7-43d4-b0d6-e8083322314e-delete_volume" released by "delete_volume" :: held 1.766s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:03:42 devstack sudo[105157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ffedd131-87bf-4fcb-8422-e47ace8a4da0 Nov 06 18:03:42 devstack sudo[105157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:42 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a18b530-ce02-4839-bf92-7d5bda3b2f24 tempest-CreateVolumesFromSnapshotTest-192351063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:03:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8a18b530-ce02-4839-bf92-7d5bda3b2f24 tempest-CreateVolumesFromSnapshotTest-192351063 None] Flow 'volume_create_manager' (12cfd89d-6768-4f9a-8352-d99336ff7616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:03:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8a18b530-ce02-4839-bf92-7d5bda3b2f24 tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ab1b78c-894f-426a-a52f-3db76c9c6985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8a18b530-ce02-4839-bf92-7d5bda3b2f24 tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ab1b78c-894f-426a-a52f-3db76c9c6985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:03:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-47043062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=420b433b-87af-49ea-9a2d-3d631273e541,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a7e599b329e494894499817e4d2aa68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:03:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:03:42Z,use_quota=True,user_id='9e93136380c74f18b836af165584c6ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8a18b530-ce02-4839-bf92-7d5bda3b2f24 tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee5fa11d-d71b-4d85-ac72-62e4dcc69986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8a18b530-ce02-4839-bf92-7d5bda3b2f24 tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee5fa11d-d71b-4d85-ac72-62e4dcc69986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8a18b530-ce02-4839-bf92-7d5bda3b2f24 tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (290dcf8a-07fa-4eea-91c6-e6d044e335ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8a18b530-ce02-4839-bf92-7d5bda3b2f24 tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (290dcf8a-07fa-4eea-91c6-e6d044e335ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '420b433b-87af-49ea-9a2d-3d631273e541', 'volume_name': 'volume-420b433b-87af-49ea-9a2d-3d631273e541', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8a18b530-ce02-4839-bf92-7d5bda3b2f24 tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f988a7cb-6873-4f7c-abbd-32981a7d35f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8a18b530-ce02-4839-bf92-7d5bda3b2f24 tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f988a7cb-6873-4f7c-abbd-32981a7d35f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8a18b530-ce02-4839-bf92-7d5bda3b2f24 tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b7a759d-55b1-4237-ae35-40053272bab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:42 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-8a18b530-ce02-4839-bf92-7d5bda3b2f24 tempest-CreateVolumesFromSnapshotTest-192351063 None] Volume 420b433b-87af-49ea-9a2d-3d631273e541: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-420b433b-87af-49ea-9a2d-3d631273e541', 'volume_size': 1} Nov 06 18:03:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8a18b530-ce02-4839-bf92-7d5bda3b2f24 tempest-CreateVolumesFromSnapshotTest-192351063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:42 devstack sudo[105157]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-834632f9-043c-4176-9e2a-51f4fc0dc41e tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ffedd131-87bf-4fcb-8422-e47ace8a4da0" returned: 0 in 0.358s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:42 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-834632f9-043c-4176-9e2a-51f4fc0dc41e tempest-ProjectMemberTests-819176810 None] <== create_volume: return (1314ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:03:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-834632f9-043c-4176-9e2a-51f4fc0dc41e tempest-ProjectMemberTests-819176810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.321s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5e507619-6dbd-4a8c-8c31-81261cefbd7d tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.084s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:42 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5e507619-6dbd-4a8c-8c31-81261cefbd7d tempest-CreateVolumesFromSnapshotTest-192351063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-575694036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb296304-5fea-430c-9feb-ca10b5e5844e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a7e599b329e494894499817e4d2aa68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:03:41Z,use_quota=True,user_id='9e93136380c74f18b836af165584c6ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:03:42 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-5e507619-6dbd-4a8c-8c31-81261cefbd7d tempest-CreateVolumesFromSnapshotTest-192351063 None] Creating volume cb296304-5fea-430c-9feb-ca10b5e5844e {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:03:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5e507619-6dbd-4a8c-8c31-81261cefbd7d tempest-CreateVolumesFromSnapshotTest-192351063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5e507619-6dbd-4a8c-8c31-81261cefbd7d tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:42 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5e507619-6dbd-4a8c-8c31-81261cefbd7d tempest-CreateVolumesFromSnapshotTest-192351063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:03:42 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5e507619-6dbd-4a8c-8c31-81261cefbd7d tempest-CreateVolumesFromSnapshotTest-192351063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:03:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5e507619-6dbd-4a8c-8c31-81261cefbd7d tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:42 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5e507619-6dbd-4a8c-8c31-81261cefbd7d tempest-CreateVolumesFromSnapshotTest-192351063 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:03:42 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-5e507619-6dbd-4a8c-8c31-81261cefbd7d tempest-CreateVolumesFromSnapshotTest-192351063 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:03:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5e507619-6dbd-4a8c-8c31-81261cefbd7d tempest-CreateVolumesFromSnapshotTest-192351063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-cb296304-5fea-430c-9feb-ca10b5e5844e 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-834632f9-043c-4176-9e2a-51f4fc0dc41e tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16a2a768-008f-4dd6-9372-5119eaf29038) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffedd131-87bf-4fcb-8422-e47ace8a4da0', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:42 devstack sudo[105160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-cb296304-5fea-430c-9feb-ca10b5e5844e 1073741824 Nov 06 18:03:42 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-834632f9-043c-4176-9e2a-51f4fc0dc41e tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b0238ba-a42a-40fa-a213-1558d0d0952d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:42 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-834632f9-043c-4176-9e2a-51f4fc0dc41e tempest-ProjectMemberTests-819176810 None] Volume volume-ffedd131-87bf-4fcb-8422-e47ace8a4da0 (ffedd131-87bf-4fcb-8422-e47ace8a4da0): created successfully Nov 06 18:03:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-834632f9-043c-4176-9e2a-51f4fc0dc41e tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b0238ba-a42a-40fa-a213-1558d0d0952d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-834632f9-043c-4176-9e2a-51f4fc0dc41e tempest-ProjectMemberTests-819176810 None] Flow 'volume_create_manager' (a3948ed3-7349-49ea-a92f-82ea84d857f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:03:42 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-834632f9-043c-4176-9e2a-51f4fc0dc41e tempest-ProjectMemberTests-819176810 None] Created volume successfully. Nov 06 18:03:43 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f6d84a0-feb8-446e-a721-e9025626ce99 tempest-CreateVolumesFromSnapshotTest-192351063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:03:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8f6d84a0-feb8-446e-a721-e9025626ce99 tempest-CreateVolumesFromSnapshotTest-192351063 None] Flow 'volume_create_manager' (4de685e0-1289-434d-bf71-23c7344060a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:03:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8f6d84a0-feb8-446e-a721-e9025626ce99 tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4af0fa7-5173-4ac1-9e12-d7c4e00c59d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8f6d84a0-feb8-446e-a721-e9025626ce99 tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4af0fa7-5173-4ac1-9e12-d7c4e00c59d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:03:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1126176315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=488ee8bc-5907-4230-8061-0d75aeec6c95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a7e599b329e494894499817e4d2aa68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:03:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:03:43Z,use_quota=True,user_id='9e93136380c74f18b836af165584c6ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8f6d84a0-feb8-446e-a721-e9025626ce99 tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d01063f1-ce21-46bc-a106-4eba875a55bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8f6d84a0-feb8-446e-a721-e9025626ce99 tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d01063f1-ce21-46bc-a106-4eba875a55bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8f6d84a0-feb8-446e-a721-e9025626ce99 tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f11e17c3-5292-4941-bd38-2ef9a4bf4ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8f6d84a0-feb8-446e-a721-e9025626ce99 tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f11e17c3-5292-4941-bd38-2ef9a4bf4ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '488ee8bc-5907-4230-8061-0d75aeec6c95', 'volume_name': 'volume-488ee8bc-5907-4230-8061-0d75aeec6c95', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8f6d84a0-feb8-446e-a721-e9025626ce99 tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52bd4524-7b9e-4e64-81a7-e43cd0e9736a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8f6d84a0-feb8-446e-a721-e9025626ce99 tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52bd4524-7b9e-4e64-81a7-e43cd0e9736a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8f6d84a0-feb8-446e-a721-e9025626ce99 tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc9cd432-0325-43d4-b34f-889e4259985d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:43 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-8f6d84a0-feb8-446e-a721-e9025626ce99 tempest-CreateVolumesFromSnapshotTest-192351063 None] Volume 488ee8bc-5907-4230-8061-0d75aeec6c95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-488ee8bc-5907-4230-8061-0d75aeec6c95', 'volume_size': 1} Nov 06 18:03:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8f6d84a0-feb8-446e-a721-e9025626ce99 tempest-CreateVolumesFromSnapshotTest-192351063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:43 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:43 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fc0974f-f51e-4761-89e3-34ac3b71e2aa tempest-CreateVolumesFromSnapshotTest-192351063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:03:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7fc0974f-f51e-4761-89e3-34ac3b71e2aa tempest-CreateVolumesFromSnapshotTest-192351063 None] Flow 'volume_create_manager' (fe1077a4-4a0e-4ba0-a549-63eeda7a456f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:03:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7fc0974f-f51e-4761-89e3-34ac3b71e2aa tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e796917e-94b2-4c61-8e98-2f3898dda5eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5e507619-6dbd-4a8c-8c31-81261cefbd7d tempest-CreateVolumesFromSnapshotTest-192351063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-cb296304-5fea-430c-9feb-ca10b5e5844e 1073741824" returned: 0 in 0.852s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7fc0974f-f51e-4761-89e3-34ac3b71e2aa tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e796917e-94b2-4c61-8e98-2f3898dda5eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:03:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1486343550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e21da2e5-fca7-4393-bb3c-a7a8c815b185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a7e599b329e494894499817e4d2aa68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:03:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:03:43Z,use_quota=True,user_id='9e93136380c74f18b836af165584c6ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7fc0974f-f51e-4761-89e3-34ac3b71e2aa tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eae5cb4-9fda-4f25-80da-6460c4085eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7fc0974f-f51e-4761-89e3-34ac3b71e2aa tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eae5cb4-9fda-4f25-80da-6460c4085eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7fc0974f-f51e-4761-89e3-34ac3b71e2aa tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c3438b6-9e05-453a-a10c-28df3f2041cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7fc0974f-f51e-4761-89e3-34ac3b71e2aa tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c3438b6-9e05-453a-a10c-28df3f2041cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e21da2e5-fca7-4393-bb3c-a7a8c815b185', 'volume_name': 'volume-e21da2e5-fca7-4393-bb3c-a7a8c815b185', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7fc0974f-f51e-4761-89e3-34ac3b71e2aa tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77462356-2466-4b69-8840-96a97165e23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7fc0974f-f51e-4761-89e3-34ac3b71e2aa tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77462356-2466-4b69-8840-96a97165e23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7fc0974f-f51e-4761-89e3-34ac3b71e2aa tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9031c71b-310f-45f9-913f-bda7ca0887a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:43 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-7fc0974f-f51e-4761-89e3-34ac3b71e2aa tempest-CreateVolumesFromSnapshotTest-192351063 None] Volume e21da2e5-fca7-4393-bb3c-a7a8c815b185: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e21da2e5-fca7-4393-bb3c-a7a8c815b185', 'volume_size': 1} Nov 06 18:03:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7fc0974f-f51e-4761-89e3-34ac3b71e2aa tempest-CreateVolumesFromSnapshotTest-192351063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-97eb54be-35f5-4ff4-8f5c-0da6c8b70b32 tempest-ProjectMemberTests-819176810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5e507619-6dbd-4a8c-8c31-81261cefbd7d tempest-CreateVolumesFromSnapshotTest-192351063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-cb296304-5fea-430c-9feb-ca10b5e5844e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:43 devstack sudo[105165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-cb296304-5fea-430c-9feb-ca10b5e5844e Nov 06 18:03:43 devstack sudo[105165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:43 devstack sudo[105165]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5e507619-6dbd-4a8c-8c31-81261cefbd7d tempest-CreateVolumesFromSnapshotTest-192351063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-cb296304-5fea-430c-9feb-ca10b5e5844e" returned: 0 in 0.271s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5e507619-6dbd-4a8c-8c31-81261cefbd7d tempest-CreateVolumesFromSnapshotTest-192351063 None] <== create_volume: return (1248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:03:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5e507619-6dbd-4a8c-8c31-81261cefbd7d tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.251s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ffa55187-846c-4730-a03d-142914ca53b1 tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.655s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ffa55187-846c-4730-a03d-142914ca53b1 tempest-CreateVolumesFromSnapshotTest-192351063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:03:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-892425289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a03b789c-80be-4d49-86aa-03448a5d8824,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a7e599b329e494894499817e4d2aa68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:03:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:03:42Z,use_quota=True,user_id='9e93136380c74f18b836af165584c6ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:03:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-ffa55187-846c-4730-a03d-142914ca53b1 tempest-CreateVolumesFromSnapshotTest-192351063 None] Creating volume a03b789c-80be-4d49-86aa-03448a5d8824 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:03:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ffa55187-846c-4730-a03d-142914ca53b1 tempest-CreateVolumesFromSnapshotTest-192351063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ffa55187-846c-4730-a03d-142914ca53b1 tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ffa55187-846c-4730-a03d-142914ca53b1 tempest-CreateVolumesFromSnapshotTest-192351063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:03:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ffa55187-846c-4730-a03d-142914ca53b1 tempest-CreateVolumesFromSnapshotTest-192351063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:03:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ffa55187-846c-4730-a03d-142914ca53b1 tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ffa55187-846c-4730-a03d-142914ca53b1 tempest-CreateVolumesFromSnapshotTest-192351063 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:03:43 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-ffa55187-846c-4730-a03d-142914ca53b1 tempest-CreateVolumesFromSnapshotTest-192351063 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:03:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ffa55187-846c-4730-a03d-142914ca53b1 tempest-CreateVolumesFromSnapshotTest-192351063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a03b789c-80be-4d49-86aa-03448a5d8824 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:43 devstack sudo[105168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a03b789c-80be-4d49-86aa-03448a5d8824 1073741824 Nov 06 18:03:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5e507619-6dbd-4a8c-8c31-81261cefbd7d tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed13efa6-3613-4b46-ab7b-06db055fe96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb296304-5fea-430c-9feb-ca10b5e5844e', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:43 devstack sudo[105168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5e507619-6dbd-4a8c-8c31-81261cefbd7d tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccc31ea4-e408-4be6-828e-007db8af7ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:43 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-5e507619-6dbd-4a8c-8c31-81261cefbd7d tempest-CreateVolumesFromSnapshotTest-192351063 None] Volume volume-cb296304-5fea-430c-9feb-ca10b5e5844e (cb296304-5fea-430c-9feb-ca10b5e5844e): created successfully Nov 06 18:03:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5e507619-6dbd-4a8c-8c31-81261cefbd7d tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccc31ea4-e408-4be6-828e-007db8af7ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5e507619-6dbd-4a8c-8c31-81261cefbd7d tempest-CreateVolumesFromSnapshotTest-192351063 None] Flow 'volume_create_manager' (369a7e75-3429-4732-900d-328d7d345148) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:03:44 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-5e507619-6dbd-4a8c-8c31-81261cefbd7d tempest-CreateVolumesFromSnapshotTest-192351063 None] Created volume successfully. Nov 06 18:03:44 devstack sudo[105168]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ffa55187-846c-4730-a03d-142914ca53b1 tempest-CreateVolumesFromSnapshotTest-192351063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a03b789c-80be-4d49-86aa-03448a5d8824 1073741824" returned: 0 in 0.583s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ffa55187-846c-4730-a03d-142914ca53b1 tempest-CreateVolumesFromSnapshotTest-192351063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a03b789c-80be-4d49-86aa-03448a5d8824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:44 devstack sudo[105174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a03b789c-80be-4d49-86aa-03448a5d8824 Nov 06 18:03:44 devstack sudo[105174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:44 devstack sudo[105174]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ffa55187-846c-4730-a03d-142914ca53b1 tempest-CreateVolumesFromSnapshotTest-192351063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a03b789c-80be-4d49-86aa-03448a5d8824" returned: 0 in 0.263s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:44 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ffa55187-846c-4730-a03d-142914ca53b1 tempest-CreateVolumesFromSnapshotTest-192351063 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:03:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ffa55187-846c-4730-a03d-142914ca53b1 tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8a18b530-ce02-4839-bf92-7d5bda3b2f24 tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.192s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:44 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8a18b530-ce02-4839-bf92-7d5bda3b2f24 tempest-CreateVolumesFromSnapshotTest-192351063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:03:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-47043062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=420b433b-87af-49ea-9a2d-3d631273e541,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a7e599b329e494894499817e4d2aa68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:03:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:03:42Z,use_quota=True,user_id='9e93136380c74f18b836af165584c6ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:03:44 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-8a18b530-ce02-4839-bf92-7d5bda3b2f24 tempest-CreateVolumesFromSnapshotTest-192351063 None] Creating volume 420b433b-87af-49ea-9a2d-3d631273e541 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:03:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8a18b530-ce02-4839-bf92-7d5bda3b2f24 tempest-CreateVolumesFromSnapshotTest-192351063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8a18b530-ce02-4839-bf92-7d5bda3b2f24 tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:44 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8a18b530-ce02-4839-bf92-7d5bda3b2f24 tempest-CreateVolumesFromSnapshotTest-192351063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:03:44 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8a18b530-ce02-4839-bf92-7d5bda3b2f24 tempest-CreateVolumesFromSnapshotTest-192351063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:03:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8a18b530-ce02-4839-bf92-7d5bda3b2f24 tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:44 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8a18b530-ce02-4839-bf92-7d5bda3b2f24 tempest-CreateVolumesFromSnapshotTest-192351063 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:03:44 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-8a18b530-ce02-4839-bf92-7d5bda3b2f24 tempest-CreateVolumesFromSnapshotTest-192351063 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:03:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8a18b530-ce02-4839-bf92-7d5bda3b2f24 tempest-CreateVolumesFromSnapshotTest-192351063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-420b433b-87af-49ea-9a2d-3d631273e541 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ffa55187-846c-4730-a03d-142914ca53b1 tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4431796f-42f8-4158-9855-7c0427e3daa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a03b789c-80be-4d49-86aa-03448a5d8824', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ffa55187-846c-4730-a03d-142914ca53b1 tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4a71b5e-e7fc-46c8-a04f-02ed7f20fd47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:44 devstack sudo[105177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-420b433b-87af-49ea-9a2d-3d631273e541 1073741824 Nov 06 18:03:44 devstack sudo[105177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:44 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-ffa55187-846c-4730-a03d-142914ca53b1 tempest-CreateVolumesFromSnapshotTest-192351063 None] Volume volume-a03b789c-80be-4d49-86aa-03448a5d8824 (a03b789c-80be-4d49-86aa-03448a5d8824): created successfully Nov 06 18:03:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ffa55187-846c-4730-a03d-142914ca53b1 tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4a71b5e-e7fc-46c8-a04f-02ed7f20fd47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ffa55187-846c-4730-a03d-142914ca53b1 tempest-CreateVolumesFromSnapshotTest-192351063 None] Flow 'volume_create_manager' (60fb32d9-bb9d-4a7e-8f7c-63b9d04878ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:03:44 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-ffa55187-846c-4730-a03d-142914ca53b1 tempest-CreateVolumesFromSnapshotTest-192351063 None] Created volume successfully. Nov 06 18:03:45 devstack sudo[105177]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8a18b530-ce02-4839-bf92-7d5bda3b2f24 tempest-CreateVolumesFromSnapshotTest-192351063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-420b433b-87af-49ea-9a2d-3d631273e541 1073741824" returned: 0 in 0.565s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8a18b530-ce02-4839-bf92-7d5bda3b2f24 tempest-CreateVolumesFromSnapshotTest-192351063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-420b433b-87af-49ea-9a2d-3d631273e541 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:45 devstack sudo[105183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-420b433b-87af-49ea-9a2d-3d631273e541 Nov 06 18:03:45 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:45 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8a18b530-ce02-4839-bf92-7d5bda3b2f24 tempest-CreateVolumesFromSnapshotTest-192351063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-420b433b-87af-49ea-9a2d-3d631273e541" returned: 0 in 0.318s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:45 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8a18b530-ce02-4839-bf92-7d5bda3b2f24 tempest-CreateVolumesFromSnapshotTest-192351063 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:03:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8a18b530-ce02-4839-bf92-7d5bda3b2f24 tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8f6d84a0-feb8-446e-a721-e9025626ce99 tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.481s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:45 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8f6d84a0-feb8-446e-a721-e9025626ce99 tempest-CreateVolumesFromSnapshotTest-192351063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:03:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1126176315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=488ee8bc-5907-4230-8061-0d75aeec6c95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a7e599b329e494894499817e4d2aa68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:03:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:03:43Z,use_quota=True,user_id='9e93136380c74f18b836af165584c6ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:03:45 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-8f6d84a0-feb8-446e-a721-e9025626ce99 tempest-CreateVolumesFromSnapshotTest-192351063 None] Creating volume 488ee8bc-5907-4230-8061-0d75aeec6c95 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:03:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8f6d84a0-feb8-446e-a721-e9025626ce99 tempest-CreateVolumesFromSnapshotTest-192351063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8f6d84a0-feb8-446e-a721-e9025626ce99 tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:45 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8f6d84a0-feb8-446e-a721-e9025626ce99 tempest-CreateVolumesFromSnapshotTest-192351063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:03:45 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8f6d84a0-feb8-446e-a721-e9025626ce99 tempest-CreateVolumesFromSnapshotTest-192351063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:03:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8f6d84a0-feb8-446e-a721-e9025626ce99 tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:45 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8f6d84a0-feb8-446e-a721-e9025626ce99 tempest-CreateVolumesFromSnapshotTest-192351063 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:03:45 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-8f6d84a0-feb8-446e-a721-e9025626ce99 tempest-CreateVolumesFromSnapshotTest-192351063 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:03:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8f6d84a0-feb8-446e-a721-e9025626ce99 tempest-CreateVolumesFromSnapshotTest-192351063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-488ee8bc-5907-4230-8061-0d75aeec6c95 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:45 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8a18b530-ce02-4839-bf92-7d5bda3b2f24 tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b7a759d-55b1-4237-ae35-40053272bab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-420b433b-87af-49ea-9a2d-3d631273e541', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:45 devstack sudo[105186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-488ee8bc-5907-4230-8061-0d75aeec6c95 1073741824 Nov 06 18:03:45 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8a18b530-ce02-4839-bf92-7d5bda3b2f24 tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0602ca9b-9e3e-4317-accf-dd97f56f60b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:45 devstack sudo[105186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:45 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-8a18b530-ce02-4839-bf92-7d5bda3b2f24 tempest-CreateVolumesFromSnapshotTest-192351063 None] Volume volume-420b433b-87af-49ea-9a2d-3d631273e541 (420b433b-87af-49ea-9a2d-3d631273e541): created successfully Nov 06 18:03:45 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8a18b530-ce02-4839-bf92-7d5bda3b2f24 tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0602ca9b-9e3e-4317-accf-dd97f56f60b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:45 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8a18b530-ce02-4839-bf92-7d5bda3b2f24 tempest-CreateVolumesFromSnapshotTest-192351063 None] Flow 'volume_create_manager' (12cfd89d-6768-4f9a-8352-d99336ff7616) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:03:45 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-8a18b530-ce02-4839-bf92-7d5bda3b2f24 tempest-CreateVolumesFromSnapshotTest-192351063 None] Created volume successfully. Nov 06 18:03:46 devstack sudo[105186]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8f6d84a0-feb8-446e-a721-e9025626ce99 tempest-CreateVolumesFromSnapshotTest-192351063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-488ee8bc-5907-4230-8061-0d75aeec6c95 1073741824" returned: 0 in 0.644s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8f6d84a0-feb8-446e-a721-e9025626ce99 tempest-CreateVolumesFromSnapshotTest-192351063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-488ee8bc-5907-4230-8061-0d75aeec6c95 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:46 devstack sudo[105192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-488ee8bc-5907-4230-8061-0d75aeec6c95 Nov 06 18:03:46 devstack sudo[105192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:46 devstack sudo[105192]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8f6d84a0-feb8-446e-a721-e9025626ce99 tempest-CreateVolumesFromSnapshotTest-192351063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-488ee8bc-5907-4230-8061-0d75aeec6c95" returned: 0 in 0.318s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:46 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8f6d84a0-feb8-446e-a721-e9025626ce99 tempest-CreateVolumesFromSnapshotTest-192351063 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:03:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8f6d84a0-feb8-446e-a721-e9025626ce99 tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7fc0974f-f51e-4761-89e3-34ac3b71e2aa tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.180s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:46 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7fc0974f-f51e-4761-89e3-34ac3b71e2aa tempest-CreateVolumesFromSnapshotTest-192351063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:03:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1486343550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e21da2e5-fca7-4393-bb3c-a7a8c815b185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a7e599b329e494894499817e4d2aa68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:03:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:03:43Z,use_quota=True,user_id='9e93136380c74f18b836af165584c6ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:03:46 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-7fc0974f-f51e-4761-89e3-34ac3b71e2aa tempest-CreateVolumesFromSnapshotTest-192351063 None] Creating volume e21da2e5-fca7-4393-bb3c-a7a8c815b185 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:03:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7fc0974f-f51e-4761-89e3-34ac3b71e2aa tempest-CreateVolumesFromSnapshotTest-192351063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7fc0974f-f51e-4761-89e3-34ac3b71e2aa tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:46 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7fc0974f-f51e-4761-89e3-34ac3b71e2aa tempest-CreateVolumesFromSnapshotTest-192351063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:03:46 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7fc0974f-f51e-4761-89e3-34ac3b71e2aa tempest-CreateVolumesFromSnapshotTest-192351063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:03:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7fc0974f-f51e-4761-89e3-34ac3b71e2aa tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:46 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7fc0974f-f51e-4761-89e3-34ac3b71e2aa tempest-CreateVolumesFromSnapshotTest-192351063 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:03:46 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-7fc0974f-f51e-4761-89e3-34ac3b71e2aa tempest-CreateVolumesFromSnapshotTest-192351063 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:03:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7fc0974f-f51e-4761-89e3-34ac3b71e2aa tempest-CreateVolumesFromSnapshotTest-192351063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e21da2e5-fca7-4393-bb3c-a7a8c815b185 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8f6d84a0-feb8-446e-a721-e9025626ce99 tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc9cd432-0325-43d4-b34f-889e4259985d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-488ee8bc-5907-4230-8061-0d75aeec6c95', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:46 devstack sudo[105195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e21da2e5-fca7-4393-bb3c-a7a8c815b185 1073741824 Nov 06 18:03:46 devstack sudo[105195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8f6d84a0-feb8-446e-a721-e9025626ce99 tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef245b7f-ab2e-43b8-ae7a-1421d5bd256d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:46 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-8f6d84a0-feb8-446e-a721-e9025626ce99 tempest-CreateVolumesFromSnapshotTest-192351063 None] Volume volume-488ee8bc-5907-4230-8061-0d75aeec6c95 (488ee8bc-5907-4230-8061-0d75aeec6c95): created successfully Nov 06 18:03:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8f6d84a0-feb8-446e-a721-e9025626ce99 tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef245b7f-ab2e-43b8-ae7a-1421d5bd256d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8f6d84a0-feb8-446e-a721-e9025626ce99 tempest-CreateVolumesFromSnapshotTest-192351063 None] Flow 'volume_create_manager' (4de685e0-1289-434d-bf71-23c7344060a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:03:46 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-8f6d84a0-feb8-446e-a721-e9025626ce99 tempest-CreateVolumesFromSnapshotTest-192351063 None] Created volume successfully. Nov 06 18:03:47 devstack sudo[105195]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7fc0974f-f51e-4761-89e3-34ac3b71e2aa tempest-CreateVolumesFromSnapshotTest-192351063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e21da2e5-fca7-4393-bb3c-a7a8c815b185 1073741824" returned: 0 in 0.497s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7fc0974f-f51e-4761-89e3-34ac3b71e2aa tempest-CreateVolumesFromSnapshotTest-192351063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e21da2e5-fca7-4393-bb3c-a7a8c815b185 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:47 devstack sudo[105201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e21da2e5-fca7-4393-bb3c-a7a8c815b185 Nov 06 18:03:47 devstack sudo[105201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:47 devstack sudo[105201]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7fc0974f-f51e-4761-89e3-34ac3b71e2aa tempest-CreateVolumesFromSnapshotTest-192351063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e21da2e5-fca7-4393-bb3c-a7a8c815b185" returned: 0 in 0.263s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7fc0974f-f51e-4761-89e3-34ac3b71e2aa tempest-CreateVolumesFromSnapshotTest-192351063 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:03:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7fc0974f-f51e-4761-89e3-34ac3b71e2aa tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-97eb54be-35f5-4ff4-8f5c-0da6c8b70b32 tempest-ProjectMemberTests-819176810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.973s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7fc0974f-f51e-4761-89e3-34ac3b71e2aa tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9031c71b-310f-45f9-913f-bda7ca0887a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e21da2e5-fca7-4393-bb3c-a7a8c815b185', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7fc0974f-f51e-4761-89e3-34ac3b71e2aa tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4860b55-444d-4d9f-981e-2381ddfa7e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-97eb54be-35f5-4ff4-8f5c-0da6c8b70b32 tempest-ProjectMemberTests-819176810 None] Creating offline snapshot 92712e60-646c-49ea-b765-3aaae5129259 of volume ffedd131-87bf-4fcb-8422-e47ace8a4da0 {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:03:47 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-7fc0974f-f51e-4761-89e3-34ac3b71e2aa tempest-CreateVolumesFromSnapshotTest-192351063 None] Volume volume-e21da2e5-fca7-4393-bb3c-a7a8c815b185 (e21da2e5-fca7-4393-bb3c-a7a8c815b185): created successfully Nov 06 18:03:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7fc0974f-f51e-4761-89e3-34ac3b71e2aa tempest-CreateVolumesFromSnapshotTest-192351063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4860b55-444d-4d9f-981e-2381ddfa7e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7fc0974f-f51e-4761-89e3-34ac3b71e2aa tempest-CreateVolumesFromSnapshotTest-192351063 None] Flow 'volume_create_manager' (fe1077a4-4a0e-4ba0-a549-63eeda7a456f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:03:47 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf56cc6-b6dc-48cc-b034-ec07090f6a3a]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:03:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97eb54be-35f5-4ff4-8f5c-0da6c8b70b32 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ffedd131-87bf-4fcb-8422-e47ace8a4da0 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:47 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-7fc0974f-f51e-4761-89e3-34ac3b71e2aa tempest-CreateVolumesFromSnapshotTest-192351063 None] Created volume successfully. Nov 06 18:03:47 devstack sudo[105204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ffedd131-87bf-4fcb-8422-e47ace8a4da0 Nov 06 18:03:47 devstack sudo[105204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:48 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5e438800-12b3-478e-9fd6-998adb98ff38 tempest-CreateVolumesFromSnapshotTest-192351063 None] Acquiring lock "cinder-e21da2e5-fca7-4393-bb3c-a7a8c815b185-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:03:48 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5e438800-12b3-478e-9fd6-998adb98ff38 tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "cinder-e21da2e5-fca7-4393-bb3c-a7a8c815b185-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:03:48 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5e438800-12b3-478e-9fd6-998adb98ff38 tempest-CreateVolumesFromSnapshotTest-192351063 None] Acquiring lock "cinder-quobyte-e21da2e5-fca7-4393-bb3c-a7a8c815b185" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:03:48 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5e438800-12b3-478e-9fd6-998adb98ff38 tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "cinder-quobyte-e21da2e5-fca7-4393-bb3c-a7a8c815b185" acquired by "delete_volume" :: waited 0.029s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:03:48 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5b63f2-7913-422f-8c58-0ca41a49d404]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:03:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5e438800-12b3-478e-9fd6-998adb98ff38 tempest-CreateVolumesFromSnapshotTest-192351063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e21da2e5-fca7-4393-bb3c-a7a8c815b185 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:48 devstack sudo[105204]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97eb54be-35f5-4ff4-8f5c-0da6c8b70b32 tempest-ProjectMemberTests-819176810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ffedd131-87bf-4fcb-8422-e47ace8a4da0" returned: 0 in 0.522s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97eb54be-35f5-4ff4-8f5c-0da6c8b70b32 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ffedd131-87bf-4fcb-8422-e47ace8a4da0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ffedd131-87bf-4fcb-8422-e47ace8a4da0.92712e60-646c-49ea-b765-3aaae5129259 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:48 devstack sudo[105212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ffedd131-87bf-4fcb-8422-e47ace8a4da0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ffedd131-87bf-4fcb-8422-e47ace8a4da0.92712e60-646c-49ea-b765-3aaae5129259 1G Nov 06 18:03:48 devstack sudo[105212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:48 devstack sudo[105211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e21da2e5-fca7-4393-bb3c-a7a8c815b185 Nov 06 18:03:48 devstack sudo[105211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:48 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a68e8c1-f410-40be-9f57-6013e4fac84b tempest-ProjectReaderTests-1299385716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:03:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3a68e8c1-f410-40be-9f57-6013e4fac84b tempest-ProjectReaderTests-1299385716 None] Flow 'volume_create_manager' (2fa13c48-ba12-41b8-92dd-7cb232817a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:03:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3a68e8c1-f410-40be-9f57-6013e4fac84b tempest-ProjectReaderTests-1299385716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (896c67e1-dc0d-4ada-b355-9b666abd3e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3a68e8c1-f410-40be-9f57-6013e4fac84b tempest-ProjectReaderTests-1299385716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (896c67e1-dc0d-4ada-b355-9b666abd3e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:03:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-370114570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3806a4d4-d8ab-43c9-91fc-e471698b2af9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c5284ac37ff4d179815435f871ca0fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:03:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:03:48Z,use_quota=True,user_id='caa4f376bb65466cba7edd807cf24033',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3a68e8c1-f410-40be-9f57-6013e4fac84b tempest-ProjectReaderTests-1299385716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (222a0179-2fe8-4a83-afe6-eb144ad958aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3a68e8c1-f410-40be-9f57-6013e4fac84b tempest-ProjectReaderTests-1299385716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (222a0179-2fe8-4a83-afe6-eb144ad958aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3a68e8c1-f410-40be-9f57-6013e4fac84b tempest-ProjectReaderTests-1299385716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce161b3d-005e-4c37-b1a9-58d930cd2ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3a68e8c1-f410-40be-9f57-6013e4fac84b tempest-ProjectReaderTests-1299385716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce161b3d-005e-4c37-b1a9-58d930cd2ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3806a4d4-d8ab-43c9-91fc-e471698b2af9', 'volume_name': 'volume-3806a4d4-d8ab-43c9-91fc-e471698b2af9', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3a68e8c1-f410-40be-9f57-6013e4fac84b tempest-ProjectReaderTests-1299385716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5427514e-ec05-41d1-add7-4c1af9c4ecda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3a68e8c1-f410-40be-9f57-6013e4fac84b tempest-ProjectReaderTests-1299385716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5427514e-ec05-41d1-add7-4c1af9c4ecda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3a68e8c1-f410-40be-9f57-6013e4fac84b tempest-ProjectReaderTests-1299385716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ed61b4d-9f7e-41ca-b00f-161e306724e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:48 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-3a68e8c1-f410-40be-9f57-6013e4fac84b tempest-ProjectReaderTests-1299385716 None] Volume 3806a4d4-d8ab-43c9-91fc-e471698b2af9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3806a4d4-d8ab-43c9-91fc-e471698b2af9', 'volume_size': 1} Nov 06 18:03:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3a68e8c1-f410-40be-9f57-6013e4fac84b tempest-ProjectReaderTests-1299385716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:48 devstack sudo[105211]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5e438800-12b3-478e-9fd6-998adb98ff38 tempest-CreateVolumesFromSnapshotTest-192351063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e21da2e5-fca7-4393-bb3c-a7a8c815b185" returned: 0 in 0.419s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5e438800-12b3-478e-9fd6-998adb98ff38 tempest-CreateVolumesFromSnapshotTest-192351063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e21da2e5-fca7-4393-bb3c-a7a8c815b185 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:48 devstack sudo[105223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e21da2e5-fca7-4393-bb3c-a7a8c815b185 Nov 06 18:03:48 devstack sudo[105223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:48 devstack sudo[105212]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97eb54be-35f5-4ff4-8f5c-0da6c8b70b32 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ffedd131-87bf-4fcb-8422-e47ace8a4da0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ffedd131-87bf-4fcb-8422-e47ace8a4da0.92712e60-646c-49ea-b765-3aaae5129259 1G" returned: 0 in 0.517s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97eb54be-35f5-4ff4-8f5c-0da6c8b70b32 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffedd131-87bf-4fcb-8422-e47ace8a4da0 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ffedd131-87bf-4fcb-8422-e47ace8a4da0.92712e60-646c-49ea-b765-3aaae5129259 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:48 devstack sudo[105225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffedd131-87bf-4fcb-8422-e47ace8a4da0 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ffedd131-87bf-4fcb-8422-e47ace8a4da0.92712e60-646c-49ea-b765-3aaae5129259 Nov 06 18:03:48 devstack sudo[105225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:48 devstack sudo[105223]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5e438800-12b3-478e-9fd6-998adb98ff38 tempest-CreateVolumesFromSnapshotTest-192351063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-e21da2e5-fca7-4393-bb3c-a7a8c815b185" returned: 0 in 0.308s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:48 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5e438800-12b3-478e-9fd6-998adb98ff38 tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "cinder-quobyte-e21da2e5-fca7-4393-bb3c-a7a8c815b185" released by "delete_volume" :: held 0.789s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:03:48 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-5e438800-12b3-478e-9fd6-998adb98ff38 tempest-CreateVolumesFromSnapshotTest-192351063 None] Created reservations ['2fded130-5922-42e0-8d7b-fe3531557938', 'ef193b48-ab9c-4a18-9730-d611ceccd44e', '595c5a8e-7000-47d2-a459-cbf047a14b75', '54c7d91d-4ae0-41b1-9135-5ab156a0c4d7'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:03:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5e438800-12b3-478e-9fd6-998adb98ff38 tempest-CreateVolumesFromSnapshotTest-192351063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5e438800-12b3-478e-9fd6-998adb98ff38 tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5e438800-12b3-478e-9fd6-998adb98ff38 tempest-CreateVolumesFromSnapshotTest-192351063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:03:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5e438800-12b3-478e-9fd6-998adb98ff38 tempest-CreateVolumesFromSnapshotTest-192351063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:03:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5e438800-12b3-478e-9fd6-998adb98ff38 tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5e438800-12b3-478e-9fd6-998adb98ff38 tempest-CreateVolumesFromSnapshotTest-192351063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:49 devstack sudo[105225]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97eb54be-35f5-4ff4-8f5c-0da6c8b70b32 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffedd131-87bf-4fcb-8422-e47ace8a4da0 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ffedd131-87bf-4fcb-8422-e47ace8a4da0.92712e60-646c-49ea-b765-3aaae5129259" returned: 0 in 0.371s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:49 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-97eb54be-35f5-4ff4-8f5c-0da6c8b70b32 tempest-ProjectMemberTests-819176810 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ffedd131-87bf-4fcb-8422-e47ace8a4da0.92712e60-646c-49ea-b765-3aaae5129259 is being set with open permissions: ugo+rw Nov 06 18:03:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97eb54be-35f5-4ff4-8f5c-0da6c8b70b32 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ffedd131-87bf-4fcb-8422-e47ace8a4da0.92712e60-646c-49ea-b765-3aaae5129259 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:49 devstack sudo[105231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:03:49 devstack sudo[105231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:49 devstack sudo[105232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ffedd131-87bf-4fcb-8422-e47ace8a4da0.92712e60-646c-49ea-b765-3aaae5129259 Nov 06 18:03:49 devstack sudo[105232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:49 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-76b7e016-2a08-400f-863f-662f17a393f8 tempest-CreateVolumesFromSnapshotTest-192351063 None] Acquiring lock "cinder-488ee8bc-5907-4230-8061-0d75aeec6c95-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:03:49 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-76b7e016-2a08-400f-863f-662f17a393f8 tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "cinder-488ee8bc-5907-4230-8061-0d75aeec6c95-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:03:49 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-76b7e016-2a08-400f-863f-662f17a393f8 tempest-CreateVolumesFromSnapshotTest-192351063 None] Acquiring lock "cinder-quobyte-488ee8bc-5907-4230-8061-0d75aeec6c95" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:03:49 devstack sudo[105231]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5e438800-12b3-478e-9fd6-998adb98ff38 tempest-CreateVolumesFromSnapshotTest-192351063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.305s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:49 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-5e438800-12b3-478e-9fd6-998adb98ff38 tempest-CreateVolumesFromSnapshotTest-192351063 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:03:49 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-5e438800-12b3-478e-9fd6-998adb98ff38 tempest-CreateVolumesFromSnapshotTest-192351063 None] Deleted volume successfully. Nov 06 18:03:49 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-76b7e016-2a08-400f-863f-662f17a393f8 tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "cinder-quobyte-488ee8bc-5907-4230-8061-0d75aeec6c95" acquired by "delete_volume" :: waited 0.043s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:03:49 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d6a3f3-31d1-4992-9b28-21438519ef3c]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:03:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-76b7e016-2a08-400f-863f-662f17a393f8 tempest-CreateVolumesFromSnapshotTest-192351063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-488ee8bc-5907-4230-8061-0d75aeec6c95 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:49 devstack sudo[105232]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:49 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5e438800-12b3-478e-9fd6-998adb98ff38 tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "cinder-e21da2e5-fca7-4393-bb3c-a7a8c815b185-delete_volume" released by "delete_volume" :: held 1.412s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:03:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97eb54be-35f5-4ff4-8f5c-0da6c8b70b32 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ffedd131-87bf-4fcb-8422-e47ace8a4da0.92712e60-646c-49ea-b765-3aaae5129259" returned: 0 in 0.386s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97eb54be-35f5-4ff4-8f5c-0da6c8b70b32 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ffedd131-87bf-4fcb-8422-e47ace8a4da0.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:49 devstack sudo[105238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ffedd131-87bf-4fcb-8422-e47ace8a4da0.info Nov 06 18:03:49 devstack sudo[105238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:49 devstack sudo[105237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-488ee8bc-5907-4230-8061-0d75aeec6c95 Nov 06 18:03:49 devstack sudo[105237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:49 devstack sudo[105238]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97eb54be-35f5-4ff4-8f5c-0da6c8b70b32 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ffedd131-87bf-4fcb-8422-e47ace8a4da0.info" returned: 0 in 0.299s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:49 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-97eb54be-35f5-4ff4-8f5c-0da6c8b70b32 tempest-ProjectMemberTests-819176810 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ffedd131-87bf-4fcb-8422-e47ace8a4da0.info is being set with open permissions: ugo+rw Nov 06 18:03:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97eb54be-35f5-4ff4-8f5c-0da6c8b70b32 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ffedd131-87bf-4fcb-8422-e47ace8a4da0.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:49 devstack sudo[105244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ffedd131-87bf-4fcb-8422-e47ace8a4da0.info Nov 06 18:03:49 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:49 devstack sudo[105237]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-76b7e016-2a08-400f-863f-662f17a393f8 tempest-CreateVolumesFromSnapshotTest-192351063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-488ee8bc-5907-4230-8061-0d75aeec6c95" returned: 0 in 0.430s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-76b7e016-2a08-400f-863f-662f17a393f8 tempest-CreateVolumesFromSnapshotTest-192351063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-488ee8bc-5907-4230-8061-0d75aeec6c95 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:49 devstack sudo[105247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-488ee8bc-5907-4230-8061-0d75aeec6c95 Nov 06 18:03:49 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:50 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97eb54be-35f5-4ff4-8f5c-0da6c8b70b32 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ffedd131-87bf-4fcb-8422-e47ace8a4da0.info" returned: 0 in 0.268s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-97eb54be-35f5-4ff4-8f5c-0da6c8b70b32 tempest-ProjectMemberTests-819176810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.504s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3a68e8c1-f410-40be-9f57-6013e4fac84b tempest-ProjectReaderTests-1299385716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.539s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:50 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3a68e8c1-f410-40be-9f57-6013e4fac84b tempest-ProjectReaderTests-1299385716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:03:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-370114570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3806a4d4-d8ab-43c9-91fc-e471698b2af9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c5284ac37ff4d179815435f871ca0fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:03:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:03:48Z,use_quota=True,user_id='caa4f376bb65466cba7edd807cf24033',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:03:50 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-3a68e8c1-f410-40be-9f57-6013e4fac84b tempest-ProjectReaderTests-1299385716 None] Creating volume 3806a4d4-d8ab-43c9-91fc-e471698b2af9 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:03:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3a68e8c1-f410-40be-9f57-6013e4fac84b tempest-ProjectReaderTests-1299385716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3a68e8c1-f410-40be-9f57-6013e4fac84b tempest-ProjectReaderTests-1299385716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:50 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3a68e8c1-f410-40be-9f57-6013e4fac84b tempest-ProjectReaderTests-1299385716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:03:50 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3a68e8c1-f410-40be-9f57-6013e4fac84b tempest-ProjectReaderTests-1299385716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:03:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3a68e8c1-f410-40be-9f57-6013e4fac84b tempest-ProjectReaderTests-1299385716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:50 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3a68e8c1-f410-40be-9f57-6013e4fac84b tempest-ProjectReaderTests-1299385716 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:03:50 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-3a68e8c1-f410-40be-9f57-6013e4fac84b tempest-ProjectReaderTests-1299385716 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:03:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3a68e8c1-f410-40be-9f57-6013e4fac84b tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3806a4d4-d8ab-43c9-91fc-e471698b2af9 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:50 devstack sudo[105251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3806a4d4-d8ab-43c9-91fc-e471698b2af9 1073741824 Nov 06 18:03:50 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:50 devstack sudo[105251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-76b7e016-2a08-400f-863f-662f17a393f8 tempest-CreateVolumesFromSnapshotTest-192351063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-488ee8bc-5907-4230-8061-0d75aeec6c95" returned: 0 in 0.260s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:50 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-97eb54be-35f5-4ff4-8f5c-0da6c8b70b32 tempest-ProjectMemberTests-819176810 None] Create snapshot completed successfully Nov 06 18:03:50 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-76b7e016-2a08-400f-863f-662f17a393f8 tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "cinder-quobyte-488ee8bc-5907-4230-8061-0d75aeec6c95" released by "delete_volume" :: held 0.774s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:03:50 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-76b7e016-2a08-400f-863f-662f17a393f8 tempest-CreateVolumesFromSnapshotTest-192351063 None] Created reservations ['2a853939-3b34-4f93-997b-3d90d688a4a9', 'a897ed7d-2172-4905-bde9-57a4b7d0f213', 'b2d3329d-bb7c-43a0-9f56-246818982e8d', 'f7926c82-ac05-4e72-9aad-186d1c4a342b'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:03:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-76b7e016-2a08-400f-863f-662f17a393f8 tempest-CreateVolumesFromSnapshotTest-192351063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-76b7e016-2a08-400f-863f-662f17a393f8 tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:50 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-76b7e016-2a08-400f-863f-662f17a393f8 tempest-CreateVolumesFromSnapshotTest-192351063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:03:50 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-76b7e016-2a08-400f-863f-662f17a393f8 tempest-CreateVolumesFromSnapshotTest-192351063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:03:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-76b7e016-2a08-400f-863f-662f17a393f8 tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-76b7e016-2a08-400f-863f-662f17a393f8 tempest-CreateVolumesFromSnapshotTest-192351063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:50 devstack sudo[105253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:03:50 devstack sudo[105253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:50 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-79fa0c65-6779-43fe-ad06-d0549680510f tempest-CreateVolumesFromSnapshotTest-192351063 None] Acquiring lock "cinder-420b433b-87af-49ea-9a2d-3d631273e541-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:03:50 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-79fa0c65-6779-43fe-ad06-d0549680510f tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "cinder-420b433b-87af-49ea-9a2d-3d631273e541-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:03:50 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-79fa0c65-6779-43fe-ad06-d0549680510f tempest-CreateVolumesFromSnapshotTest-192351063 None] Acquiring lock "cinder-quobyte-420b433b-87af-49ea-9a2d-3d631273e541" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:03:50 devstack sudo[105253]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-76b7e016-2a08-400f-863f-662f17a393f8 tempest-CreateVolumesFromSnapshotTest-192351063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.295s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:50 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-76b7e016-2a08-400f-863f-662f17a393f8 tempest-CreateVolumesFromSnapshotTest-192351063 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:03:50 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-79fa0c65-6779-43fe-ad06-d0549680510f tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "cinder-quobyte-420b433b-87af-49ea-9a2d-3d631273e541" acquired by "delete_volume" :: waited 0.018s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:03:50 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-76b7e016-2a08-400f-863f-662f17a393f8 tempest-CreateVolumesFromSnapshotTest-192351063 None] Deleted volume successfully. Nov 06 18:03:50 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b43f74c-c097-4773-a110-64fcea7535f0]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:03:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-79fa0c65-6779-43fe-ad06-d0549680510f tempest-CreateVolumesFromSnapshotTest-192351063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-420b433b-87af-49ea-9a2d-3d631273e541 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:50 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-76b7e016-2a08-400f-863f-662f17a393f8 tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "cinder-488ee8bc-5907-4230-8061-0d75aeec6c95-delete_volume" released by "delete_volume" :: held 1.384s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:03:50 devstack sudo[105251]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3a68e8c1-f410-40be-9f57-6013e4fac84b tempest-ProjectReaderTests-1299385716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3806a4d4-d8ab-43c9-91fc-e471698b2af9 1073741824" returned: 0 in 0.591s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3a68e8c1-f410-40be-9f57-6013e4fac84b tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3806a4d4-d8ab-43c9-91fc-e471698b2af9 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:50 devstack sudo[105261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3806a4d4-d8ab-43c9-91fc-e471698b2af9 Nov 06 18:03:50 devstack sudo[105261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:50 devstack sudo[105260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-420b433b-87af-49ea-9a2d-3d631273e541 Nov 06 18:03:50 devstack sudo[105260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:50 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f35279fc-434e-4439-8c99-e636f8b8af7e tempest-ProjectMemberTests-819176810 None] Acquiring lock "cinder-92712e60-646c-49ea-b765-3aaae5129259-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:03:50 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f35279fc-434e-4439-8c99-e636f8b8af7e tempest-ProjectMemberTests-819176810 None] Lock "cinder-92712e60-646c-49ea-b765-3aaae5129259-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:03:50 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f35279fc-434e-4439-8c99-e636f8b8af7e tempest-ProjectMemberTests-819176810 None] Acquiring lock "cinder-quobyte-ffedd131-87bf-4fcb-8422-e47ace8a4da0" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:03:50 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f35279fc-434e-4439-8c99-e636f8b8af7e tempest-ProjectMemberTests-819176810 None] Lock "cinder-quobyte-ffedd131-87bf-4fcb-8422-e47ace8a4da0" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:03:50 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f35279fc-434e-4439-8c99-e636f8b8af7e tempest-ProjectMemberTests-819176810 None] Acquiring lock "cinder-quobyte-92712e60-646c-49ea-b765-3aaae5129259" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:03:51 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f35279fc-434e-4439-8c99-e636f8b8af7e tempest-ProjectMemberTests-819176810 None] Lock "cinder-quobyte-92712e60-646c-49ea-b765-3aaae5129259" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:03:51 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-f35279fc-434e-4439-8c99-e636f8b8af7e tempest-ProjectMemberTests-819176810 None] Deleting offline snapshot 92712e60-646c-49ea-b765-3aaae5129259 of volume ffedd131-87bf-4fcb-8422-e47ace8a4da0 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:03:51 devstack sudo[105261]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:51 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-f35279fc-434e-4439-8c99-e636f8b8af7e tempest-ProjectMemberTests-819176810 None] snapshot_file for this snap is: volume-ffedd131-87bf-4fcb-8422-e47ace8a4da0.92712e60-646c-49ea-b765-3aaae5129259 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:03:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3a68e8c1-f410-40be-9f57-6013e4fac84b tempest-ProjectReaderTests-1299385716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3806a4d4-d8ab-43c9-91fc-e471698b2af9" returned: 0 in 0.336s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:51 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3a68e8c1-f410-40be-9f57-6013e4fac84b tempest-ProjectReaderTests-1299385716 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:03:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3a68e8c1-f410-40be-9f57-6013e4fac84b tempest-ProjectReaderTests-1299385716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:51 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3a68e8c1-f410-40be-9f57-6013e4fac84b tempest-ProjectReaderTests-1299385716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ed61b4d-9f7e-41ca-b00f-161e306724e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3806a4d4-d8ab-43c9-91fc-e471698b2af9', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:51 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3a68e8c1-f410-40be-9f57-6013e4fac84b tempest-ProjectReaderTests-1299385716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd2070c2-bfaa-4020-84a4-6a4db99b246d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:51 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[418e44fb-1742-498c-8fd8-1876758c5910]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:03:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f35279fc-434e-4439-8c99-e636f8b8af7e tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ffedd131-87bf-4fcb-8422-e47ace8a4da0.92712e60-646c-49ea-b765-3aaae5129259 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:51 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-3a68e8c1-f410-40be-9f57-6013e4fac84b tempest-ProjectReaderTests-1299385716 None] Volume volume-3806a4d4-d8ab-43c9-91fc-e471698b2af9 (3806a4d4-d8ab-43c9-91fc-e471698b2af9): created successfully Nov 06 18:03:51 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3a68e8c1-f410-40be-9f57-6013e4fac84b tempest-ProjectReaderTests-1299385716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd2070c2-bfaa-4020-84a4-6a4db99b246d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:51 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3a68e8c1-f410-40be-9f57-6013e4fac84b tempest-ProjectReaderTests-1299385716 None] Flow 'volume_create_manager' (2fa13c48-ba12-41b8-92dd-7cb232817a84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:03:51 devstack sudo[105260]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-79fa0c65-6779-43fe-ad06-d0549680510f tempest-CreateVolumesFromSnapshotTest-192351063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-420b433b-87af-49ea-9a2d-3d631273e541" returned: 0 in 0.557s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-79fa0c65-6779-43fe-ad06-d0549680510f tempest-CreateVolumesFromSnapshotTest-192351063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-420b433b-87af-49ea-9a2d-3d631273e541 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:51 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-3a68e8c1-f410-40be-9f57-6013e4fac84b tempest-ProjectReaderTests-1299385716 None] Created volume successfully. Nov 06 18:03:51 devstack sudo[105272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-420b433b-87af-49ea-9a2d-3d631273e541 Nov 06 18:03:51 devstack sudo[105272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:51 devstack sudo[105271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ffedd131-87bf-4fcb-8422-e47ace8a4da0.92712e60-646c-49ea-b765-3aaae5129259 Nov 06 18:03:51 devstack sudo[105271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:51 devstack sudo[105272]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-79fa0c65-6779-43fe-ad06-d0549680510f tempest-CreateVolumesFromSnapshotTest-192351063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-420b433b-87af-49ea-9a2d-3d631273e541" returned: 0 in 0.295s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:51 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-79fa0c65-6779-43fe-ad06-d0549680510f tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "cinder-quobyte-420b433b-87af-49ea-9a2d-3d631273e541" released by "delete_volume" :: held 0.909s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:03:51 devstack sudo[105271]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f35279fc-434e-4439-8c99-e636f8b8af7e tempest-ProjectMemberTests-819176810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ffedd131-87bf-4fcb-8422-e47ace8a4da0.92712e60-646c-49ea-b765-3aaae5129259" returned: 0 in 0.408s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:51 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-f35279fc-434e-4439-8c99-e636f8b8af7e tempest-ProjectMemberTests-819176810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ffedd131-87bf-4fcb-8422-e47ace8a4da0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:03:51 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e3001c-6263-4755-9f6f-7528c1533342]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:03:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f35279fc-434e-4439-8c99-e636f8b8af7e tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ffedd131-87bf-4fcb-8422-e47ace8a4da0 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:51 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-79fa0c65-6779-43fe-ad06-d0549680510f tempest-CreateVolumesFromSnapshotTest-192351063 None] Created reservations ['4684e2ae-5d10-42c6-9939-29e4ba8094a5', '49df1ff5-a258-441d-9d1a-43cd41be8db3', 'a1d8b212-2ef9-41f1-ae4b-d851931b32c2', '95b3b994-f2c1-4805-a1a2-7f023bc5e2e8'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:03:51 devstack sudo[105281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ffedd131-87bf-4fcb-8422-e47ace8a4da0 Nov 06 18:03:51 devstack sudo[105281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-79fa0c65-6779-43fe-ad06-d0549680510f tempest-CreateVolumesFromSnapshotTest-192351063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-79fa0c65-6779-43fe-ad06-d0549680510f tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:51 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-79fa0c65-6779-43fe-ad06-d0549680510f tempest-CreateVolumesFromSnapshotTest-192351063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:03:51 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-79fa0c65-6779-43fe-ad06-d0549680510f tempest-CreateVolumesFromSnapshotTest-192351063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:03:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-79fa0c65-6779-43fe-ad06-d0549680510f tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-79fa0c65-6779-43fe-ad06-d0549680510f tempest-CreateVolumesFromSnapshotTest-192351063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:51 devstack sudo[105283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:03:51 devstack sudo[105283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:52 devstack sudo[105283]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-79fa0c65-6779-43fe-ad06-d0549680510f tempest-CreateVolumesFromSnapshotTest-192351063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.281s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:52 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-79fa0c65-6779-43fe-ad06-d0549680510f tempest-CreateVolumesFromSnapshotTest-192351063 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:03:52 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-79fa0c65-6779-43fe-ad06-d0549680510f tempest-CreateVolumesFromSnapshotTest-192351063 None] Deleted volume successfully. Nov 06 18:03:52 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-79fa0c65-6779-43fe-ad06-d0549680510f tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "cinder-420b433b-87af-49ea-9a2d-3d631273e541-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:03:52 devstack sudo[105281]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f35279fc-434e-4439-8c99-e636f8b8af7e tempest-ProjectMemberTests-819176810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ffedd131-87bf-4fcb-8422-e47ace8a4da0" returned: 0 in 0.537s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f35279fc-434e-4439-8c99-e636f8b8af7e tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ffedd131-87bf-4fcb-8422-e47ace8a4da0.92712e60-646c-49ea-b765-3aaae5129259 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:52 devstack sudo[105289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ffedd131-87bf-4fcb-8422-e47ace8a4da0.92712e60-646c-49ea-b765-3aaae5129259 Nov 06 18:03:52 devstack sudo[105289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e86a3d2e-fe3f-48bf-9076-b498fbb90bf4 tempest-ProjectReaderTests-1299385716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e86a3d2e-fe3f-48bf-9076-b498fbb90bf4 tempest-ProjectReaderTests-1299385716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:52 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-e86a3d2e-fe3f-48bf-9076-b498fbb90bf4 tempest-ProjectReaderTests-1299385716 None] Creating offline snapshot 0c794833-a536-4804-a544-089fbf14470f of volume 3806a4d4-d8ab-43c9-91fc-e471698b2af9 {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:03:52 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0392bf9-06fd-46d4-9405-d26e63a45fe2]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:03:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e86a3d2e-fe3f-48bf-9076-b498fbb90bf4 tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3806a4d4-d8ab-43c9-91fc-e471698b2af9 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:52 devstack sudo[105291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3806a4d4-d8ab-43c9-91fc-e471698b2af9 Nov 06 18:03:52 devstack sudo[105291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:52 devstack sudo[105289]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f35279fc-434e-4439-8c99-e636f8b8af7e tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ffedd131-87bf-4fcb-8422-e47ace8a4da0.92712e60-646c-49ea-b765-3aaae5129259" returned: 0 in 0.352s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f35279fc-434e-4439-8c99-e636f8b8af7e tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ffedd131-87bf-4fcb-8422-e47ace8a4da0.92712e60-646c-49ea-b765-3aaae5129259 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:52 devstack sudo[105296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ffedd131-87bf-4fcb-8422-e47ace8a4da0.92712e60-646c-49ea-b765-3aaae5129259 Nov 06 18:03:52 devstack sudo[105296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:52 devstack sudo[105291]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e86a3d2e-fe3f-48bf-9076-b498fbb90bf4 tempest-ProjectReaderTests-1299385716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3806a4d4-d8ab-43c9-91fc-e471698b2af9" returned: 0 in 0.381s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e86a3d2e-fe3f-48bf-9076-b498fbb90bf4 tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3806a4d4-d8ab-43c9-91fc-e471698b2af9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3806a4d4-d8ab-43c9-91fc-e471698b2af9.0c794833-a536-4804-a544-089fbf14470f 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:52 devstack sudo[105301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3806a4d4-d8ab-43c9-91fc-e471698b2af9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3806a4d4-d8ab-43c9-91fc-e471698b2af9.0c794833-a536-4804-a544-089fbf14470f 1G Nov 06 18:03:52 devstack sudo[105301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:52 devstack sudo[105296]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f35279fc-434e-4439-8c99-e636f8b8af7e tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ffedd131-87bf-4fcb-8422-e47ace8a4da0.92712e60-646c-49ea-b765-3aaae5129259" returned: 0 in 0.285s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:52 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2af8a0bf-b3fa-4120-8947-d38ae8b8ec03 tempest-CreateVolumesFromSnapshotTest-192351063 None] Acquiring lock "cinder-a03b789c-80be-4d49-86aa-03448a5d8824-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:03:52 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f35279fc-434e-4439-8c99-e636f8b8af7e tempest-ProjectMemberTests-819176810 None] Lock "cinder-quobyte-92712e60-646c-49ea-b765-3aaae5129259" released by "_delete_snapshot" :: held 1.798s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:03:52 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2af8a0bf-b3fa-4120-8947-d38ae8b8ec03 tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "cinder-a03b789c-80be-4d49-86aa-03448a5d8824-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:03:52 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f35279fc-434e-4439-8c99-e636f8b8af7e tempest-ProjectMemberTests-819176810 None] Lock "cinder-quobyte-ffedd131-87bf-4fcb-8422-e47ace8a4da0" released by "delete_snapshot" :: held 1.842s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:03:52 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2af8a0bf-b3fa-4120-8947-d38ae8b8ec03 tempest-CreateVolumesFromSnapshotTest-192351063 None] Acquiring lock "cinder-quobyte-a03b789c-80be-4d49-86aa-03448a5d8824" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:03:52 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2af8a0bf-b3fa-4120-8947-d38ae8b8ec03 tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "cinder-quobyte-a03b789c-80be-4d49-86aa-03448a5d8824" acquired by "delete_volume" :: waited 0.017s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:03:52 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d99d7cd-ad01-4c57-9d02-89d1df766a13]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:03:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2af8a0bf-b3fa-4120-8947-d38ae8b8ec03 tempest-CreateVolumesFromSnapshotTest-192351063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a03b789c-80be-4d49-86aa-03448a5d8824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:52 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-f35279fc-434e-4439-8c99-e636f8b8af7e tempest-ProjectMemberTests-819176810 None] Created reservations ['4e7b3615-ee4c-4a6f-892e-38724607e5a0', '93816f91-3321-4b9c-911c-86ac3e5c4f12', '6e1e58c0-494e-42c6-a181-dcafccb08344', 'd0e8fc84-7383-451e-a925-dfab1b9b14aa'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:03:53 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-f35279fc-434e-4439-8c99-e636f8b8af7e tempest-ProjectMemberTests-819176810 None] Delete snapshot completed successfully. Nov 06 18:03:53 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f35279fc-434e-4439-8c99-e636f8b8af7e tempest-ProjectMemberTests-819176810 None] Lock "cinder-92712e60-646c-49ea-b765-3aaae5129259-delete_snapshot" released by "delete_snapshot" :: held 2.098s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:03:53 devstack sudo[105313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a03b789c-80be-4d49-86aa-03448a5d8824 Nov 06 18:03:53 devstack sudo[105313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:53 devstack sudo[105301]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e86a3d2e-fe3f-48bf-9076-b498fbb90bf4 tempest-ProjectReaderTests-1299385716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3806a4d4-d8ab-43c9-91fc-e471698b2af9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3806a4d4-d8ab-43c9-91fc-e471698b2af9.0c794833-a536-4804-a544-089fbf14470f 1G" returned: 0 in 0.573s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e86a3d2e-fe3f-48bf-9076-b498fbb90bf4 tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3806a4d4-d8ab-43c9-91fc-e471698b2af9 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3806a4d4-d8ab-43c9-91fc-e471698b2af9.0c794833-a536-4804-a544-089fbf14470f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:53 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-17c389b4-015b-41a7-8cb6-0d0f779c79ea tempest-ProjectMemberTests-819176810 None] Acquiring lock "cinder-ffedd131-87bf-4fcb-8422-e47ace8a4da0-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:03:53 devstack sudo[105317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3806a4d4-d8ab-43c9-91fc-e471698b2af9 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3806a4d4-d8ab-43c9-91fc-e471698b2af9.0c794833-a536-4804-a544-089fbf14470f Nov 06 18:03:53 devstack sudo[105317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:53 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-17c389b4-015b-41a7-8cb6-0d0f779c79ea tempest-ProjectMemberTests-819176810 None] Lock "cinder-ffedd131-87bf-4fcb-8422-e47ace8a4da0-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:03:53 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-17c389b4-015b-41a7-8cb6-0d0f779c79ea tempest-ProjectMemberTests-819176810 None] Acquiring lock "cinder-quobyte-ffedd131-87bf-4fcb-8422-e47ace8a4da0" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:03:53 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-17c389b4-015b-41a7-8cb6-0d0f779c79ea tempest-ProjectMemberTests-819176810 None] Lock "cinder-quobyte-ffedd131-87bf-4fcb-8422-e47ace8a4da0" acquired by "delete_volume" :: waited 0.028s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:03:53 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3fe0bf-3f23-4e27-93a6-59e59a219de4]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:03:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-17c389b4-015b-41a7-8cb6-0d0f779c79ea tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ffedd131-87bf-4fcb-8422-e47ace8a4da0 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:53 devstack sudo[105313]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2af8a0bf-b3fa-4120-8947-d38ae8b8ec03 tempest-CreateVolumesFromSnapshotTest-192351063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a03b789c-80be-4d49-86aa-03448a5d8824" returned: 0 in 0.493s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2af8a0bf-b3fa-4120-8947-d38ae8b8ec03 tempest-CreateVolumesFromSnapshotTest-192351063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a03b789c-80be-4d49-86aa-03448a5d8824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:53 devstack sudo[105325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a03b789c-80be-4d49-86aa-03448a5d8824 Nov 06 18:03:53 devstack sudo[105325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:53 devstack sudo[105322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ffedd131-87bf-4fcb-8422-e47ace8a4da0 Nov 06 18:03:53 devstack sudo[105322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:53 devstack sudo[105317]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e86a3d2e-fe3f-48bf-9076-b498fbb90bf4 tempest-ProjectReaderTests-1299385716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3806a4d4-d8ab-43c9-91fc-e471698b2af9 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3806a4d4-d8ab-43c9-91fc-e471698b2af9.0c794833-a536-4804-a544-089fbf14470f" returned: 0 in 0.397s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:53 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-e86a3d2e-fe3f-48bf-9076-b498fbb90bf4 tempest-ProjectReaderTests-1299385716 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3806a4d4-d8ab-43c9-91fc-e471698b2af9.0c794833-a536-4804-a544-089fbf14470f is being set with open permissions: ugo+rw Nov 06 18:03:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e86a3d2e-fe3f-48bf-9076-b498fbb90bf4 tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3806a4d4-d8ab-43c9-91fc-e471698b2af9.0c794833-a536-4804-a544-089fbf14470f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:53 devstack sudo[105329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3806a4d4-d8ab-43c9-91fc-e471698b2af9.0c794833-a536-4804-a544-089fbf14470f Nov 06 18:03:53 devstack sudo[105329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:53 devstack sudo[105325]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2af8a0bf-b3fa-4120-8947-d38ae8b8ec03 tempest-CreateVolumesFromSnapshotTest-192351063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a03b789c-80be-4d49-86aa-03448a5d8824" returned: 0 in 0.319s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:53 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2af8a0bf-b3fa-4120-8947-d38ae8b8ec03 tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "cinder-quobyte-a03b789c-80be-4d49-86aa-03448a5d8824" released by "delete_volume" :: held 0.877s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:03:53 devstack sudo[105322]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-17c389b4-015b-41a7-8cb6-0d0f779c79ea tempest-ProjectMemberTests-819176810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ffedd131-87bf-4fcb-8422-e47ace8a4da0" returned: 0 in 0.466s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-17c389b4-015b-41a7-8cb6-0d0f779c79ea tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ffedd131-87bf-4fcb-8422-e47ace8a4da0 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:53 devstack sudo[105329]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:53 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-2af8a0bf-b3fa-4120-8947-d38ae8b8ec03 tempest-CreateVolumesFromSnapshotTest-192351063 None] Created reservations ['3a579d18-957d-4cfe-9ee0-024153a72905', '2a9b3698-cc13-4f46-a69d-5f4973bddece', '61dfd95b-81d0-4149-a5d0-61ebe7422840', 'dafb1603-b0da-47f3-85ec-c50594037c58'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:03:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e86a3d2e-fe3f-48bf-9076-b498fbb90bf4 tempest-ProjectReaderTests-1299385716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3806a4d4-d8ab-43c9-91fc-e471698b2af9.0c794833-a536-4804-a544-089fbf14470f" returned: 0 in 0.325s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:53 devstack sudo[105336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ffedd131-87bf-4fcb-8422-e47ace8a4da0 Nov 06 18:03:53 devstack sudo[105336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e86a3d2e-fe3f-48bf-9076-b498fbb90bf4 tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3806a4d4-d8ab-43c9-91fc-e471698b2af9.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:53 devstack sudo[105338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3806a4d4-d8ab-43c9-91fc-e471698b2af9.info Nov 06 18:03:54 devstack sudo[105338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2af8a0bf-b3fa-4120-8947-d38ae8b8ec03 tempest-CreateVolumesFromSnapshotTest-192351063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2af8a0bf-b3fa-4120-8947-d38ae8b8ec03 tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2af8a0bf-b3fa-4120-8947-d38ae8b8ec03 tempest-CreateVolumesFromSnapshotTest-192351063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:03:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2af8a0bf-b3fa-4120-8947-d38ae8b8ec03 tempest-CreateVolumesFromSnapshotTest-192351063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:03:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2af8a0bf-b3fa-4120-8947-d38ae8b8ec03 tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2af8a0bf-b3fa-4120-8947-d38ae8b8ec03 tempest-CreateVolumesFromSnapshotTest-192351063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:54 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e1eb1051-4256-4620-84bb-8df4b6ad2ded tempest-CreateVolumesFromSnapshotTest-192351063 None] Acquiring lock "cinder-cb296304-5fea-430c-9feb-ca10b5e5844e-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:03:54 devstack sudo[105340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:03:54 devstack sudo[105340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:54 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e1eb1051-4256-4620-84bb-8df4b6ad2ded tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "cinder-cb296304-5fea-430c-9feb-ca10b5e5844e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:03:54 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e1eb1051-4256-4620-84bb-8df4b6ad2ded tempest-CreateVolumesFromSnapshotTest-192351063 None] Acquiring lock "cinder-quobyte-cb296304-5fea-430c-9feb-ca10b5e5844e" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:03:54 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e1eb1051-4256-4620-84bb-8df4b6ad2ded tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "cinder-quobyte-cb296304-5fea-430c-9feb-ca10b5e5844e" acquired by "delete_volume" :: waited 0.016s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:03:54 devstack sudo[105336]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-17c389b4-015b-41a7-8cb6-0d0f779c79ea tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ffedd131-87bf-4fcb-8422-e47ace8a4da0" returned: 0 in 0.390s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:54 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2ee729-3f9a-4d85-94d7-990762d52aa4]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:03:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e1eb1051-4256-4620-84bb-8df4b6ad2ded tempest-CreateVolumesFromSnapshotTest-192351063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-cb296304-5fea-430c-9feb-ca10b5e5844e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:54 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-17c389b4-015b-41a7-8cb6-0d0f779c79ea tempest-ProjectMemberTests-819176810 None] Lock "cinder-quobyte-ffedd131-87bf-4fcb-8422-e47ace8a4da0" released by "delete_volume" :: held 0.960s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:03:54 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-17c389b4-015b-41a7-8cb6-0d0f779c79ea tempest-ProjectMemberTests-819176810 None] Created reservations ['6250a673-2805-46bf-9252-93d17d2b06e8', 'bf1c3cf1-2dda-497b-b152-63ff4fc7ffe1', '01579f32-88ea-43d7-afd9-4e4907df1f3b', 'ffbfbd2e-83b7-4010-86ed-4b3b98ccb06d'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:03:54 devstack sudo[105338]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e86a3d2e-fe3f-48bf-9076-b498fbb90bf4 tempest-ProjectReaderTests-1299385716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3806a4d4-d8ab-43c9-91fc-e471698b2af9.info" returned: 0 in 0.466s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:54 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-e86a3d2e-fe3f-48bf-9076-b498fbb90bf4 tempest-ProjectReaderTests-1299385716 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3806a4d4-d8ab-43c9-91fc-e471698b2af9.info is being set with open permissions: ugo+rw Nov 06 18:03:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e86a3d2e-fe3f-48bf-9076-b498fbb90bf4 tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3806a4d4-d8ab-43c9-91fc-e471698b2af9.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:54 devstack sudo[105340]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2af8a0bf-b3fa-4120-8947-d38ae8b8ec03 tempest-CreateVolumesFromSnapshotTest-192351063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.389s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:54 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-2af8a0bf-b3fa-4120-8947-d38ae8b8ec03 tempest-CreateVolumesFromSnapshotTest-192351063 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:03:54 devstack sudo[105346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3806a4d4-d8ab-43c9-91fc-e471698b2af9.info Nov 06 18:03:54 devstack sudo[105346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:54 devstack sudo[105343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-cb296304-5fea-430c-9feb-ca10b5e5844e Nov 06 18:03:54 devstack sudo[105343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:54 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-2af8a0bf-b3fa-4120-8947-d38ae8b8ec03 tempest-CreateVolumesFromSnapshotTest-192351063 None] Deleted volume successfully. Nov 06 18:03:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-17c389b4-015b-41a7-8cb6-0d0f779c79ea tempest-ProjectMemberTests-819176810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-17c389b4-015b-41a7-8cb6-0d0f779c79ea tempest-ProjectMemberTests-819176810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-17c389b4-015b-41a7-8cb6-0d0f779c79ea tempest-ProjectMemberTests-819176810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:03:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-17c389b4-015b-41a7-8cb6-0d0f779c79ea tempest-ProjectMemberTests-819176810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:03:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-17c389b4-015b-41a7-8cb6-0d0f779c79ea tempest-ProjectMemberTests-819176810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-17c389b4-015b-41a7-8cb6-0d0f779c79ea tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:54 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2af8a0bf-b3fa-4120-8947-d38ae8b8ec03 tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "cinder-a03b789c-80be-4d49-86aa-03448a5d8824-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:03:54 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 18:03:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:03:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:03:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:54 devstack sudo[105349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:03:54 devstack sudo[105349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:54 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:03:54 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:54 devstack sudo[105346]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e86a3d2e-fe3f-48bf-9076-b498fbb90bf4 tempest-ProjectReaderTests-1299385716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3806a4d4-d8ab-43c9-91fc-e471698b2af9.info" returned: 0 in 0.316s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:54 devstack sudo[105343]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e86a3d2e-fe3f-48bf-9076-b498fbb90bf4 tempest-ProjectReaderTests-1299385716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.569s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:54 devstack sudo[105349]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e1eb1051-4256-4620-84bb-8df4b6ad2ded tempest-CreateVolumesFromSnapshotTest-192351063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-cb296304-5fea-430c-9feb-ca10b5e5844e" returned: 0 in 0.494s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e1eb1051-4256-4620-84bb-8df4b6ad2ded tempest-CreateVolumesFromSnapshotTest-192351063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-cb296304-5fea-430c-9feb-ca10b5e5844e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-17c389b4-015b-41a7-8cb6-0d0f779c79ea tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.292s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:54 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-17c389b4-015b-41a7-8cb6-0d0f779c79ea tempest-ProjectMemberTests-819176810 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:03:54 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-17c389b4-015b-41a7-8cb6-0d0f779c79ea tempest-ProjectMemberTests-819176810 None] Deleted volume successfully. Nov 06 18:03:54 devstack sudo[105360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-cb296304-5fea-430c-9feb-ca10b5e5844e Nov 06 18:03:54 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:54 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-e86a3d2e-fe3f-48bf-9076-b498fbb90bf4 tempest-ProjectReaderTests-1299385716 None] Create snapshot completed successfully Nov 06 18:03:54 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:54 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-17c389b4-015b-41a7-8cb6-0d0f779c79ea tempest-ProjectMemberTests-819176810 None] Lock "cinder-ffedd131-87bf-4fcb-8422-e47ace8a4da0-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:03:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.307s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:54 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:03:54 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running periodic task VolumeManager._thread_info {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 18:03:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] thread count: 28 {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 18:03:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] thread info: [<_MainThread(MainThread, started 133940619505792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 18:03:55 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e1eb1051-4256-4620-84bb-8df4b6ad2ded tempest-CreateVolumesFromSnapshotTest-192351063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-cb296304-5fea-430c-9feb-ca10b5e5844e" returned: 0 in 0.277s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e1eb1051-4256-4620-84bb-8df4b6ad2ded tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "cinder-quobyte-cb296304-5fea-430c-9feb-ca10b5e5844e" released by "delete_volume" :: held 0.826s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:03:55 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-e1eb1051-4256-4620-84bb-8df4b6ad2ded tempest-CreateVolumesFromSnapshotTest-192351063 None] Created reservations ['b8f1b00d-b903-4f6c-8fb1-7747fd100c4a', '2347c2e2-90a0-4cb3-8b11-ae979fffcde7', 'f74fc6eb-560e-4862-9e80-92fcfc08b2ef', '0f8cc111-6341-4424-a4b8-33d385bf2e9c'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:03:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e1eb1051-4256-4620-84bb-8df4b6ad2ded tempest-CreateVolumesFromSnapshotTest-192351063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e1eb1051-4256-4620-84bb-8df4b6ad2ded tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:55 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e1eb1051-4256-4620-84bb-8df4b6ad2ded tempest-CreateVolumesFromSnapshotTest-192351063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:03:55 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e1eb1051-4256-4620-84bb-8df4b6ad2ded tempest-CreateVolumesFromSnapshotTest-192351063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:03:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e1eb1051-4256-4620-84bb-8df4b6ad2ded tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e1eb1051-4256-4620-84bb-8df4b6ad2ded tempest-CreateVolumesFromSnapshotTest-192351063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:55 devstack sudo[105363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:03:55 devstack sudo[105363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:55 devstack sudo[105363]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2f93f3cd-06a4-4ce7-850f-c7cfef2d24f1 tempest-CreateVolumesFromSnapshotTest-192351063 None] Acquiring lock "cinder-43390945-db4d-4826-8495-1c743aae7feb-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:03:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e1eb1051-4256-4620-84bb-8df4b6ad2ded tempest-CreateVolumesFromSnapshotTest-192351063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.301s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:55 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-e1eb1051-4256-4620-84bb-8df4b6ad2ded tempest-CreateVolumesFromSnapshotTest-192351063 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:03:55 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-e1eb1051-4256-4620-84bb-8df4b6ad2ded tempest-CreateVolumesFromSnapshotTest-192351063 None] Deleted volume successfully. Nov 06 18:03:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2f93f3cd-06a4-4ce7-850f-c7cfef2d24f1 tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "cinder-43390945-db4d-4826-8495-1c743aae7feb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:03:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2f93f3cd-06a4-4ce7-850f-c7cfef2d24f1 tempest-CreateVolumesFromSnapshotTest-192351063 None] Acquiring lock "cinder-quobyte-6f16a30d-32fc-4a8f-a868-f8368fa74425" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:03:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e1eb1051-4256-4620-84bb-8df4b6ad2ded tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "cinder-cb296304-5fea-430c-9feb-ca10b5e5844e-delete_volume" released by "delete_volume" :: held 1.414s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:03:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2f93f3cd-06a4-4ce7-850f-c7cfef2d24f1 tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "cinder-quobyte-6f16a30d-32fc-4a8f-a868-f8368fa74425" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:03:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2f93f3cd-06a4-4ce7-850f-c7cfef2d24f1 tempest-CreateVolumesFromSnapshotTest-192351063 None] Acquiring lock "cinder-quobyte-43390945-db4d-4826-8495-1c743aae7feb" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:03:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-22c75f90-3682-4d18-b2a5-784d6cc3373d tempest-ProjectReaderTests-1299385716 None] Acquiring lock "cinder-0c794833-a536-4804-a544-089fbf14470f-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:03:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2f93f3cd-06a4-4ce7-850f-c7cfef2d24f1 tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "cinder-quobyte-43390945-db4d-4826-8495-1c743aae7feb" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:03:55 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-2f93f3cd-06a4-4ce7-850f-c7cfef2d24f1 tempest-CreateVolumesFromSnapshotTest-192351063 None] Deleting offline snapshot 43390945-db4d-4826-8495-1c743aae7feb of volume 6f16a30d-32fc-4a8f-a868-f8368fa74425 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:03:55 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-2f93f3cd-06a4-4ce7-850f-c7cfef2d24f1 tempest-CreateVolumesFromSnapshotTest-192351063 None] snapshot_file for this snap is: volume-6f16a30d-32fc-4a8f-a868-f8368fa74425.43390945-db4d-4826-8495-1c743aae7feb {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:03:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-22c75f90-3682-4d18-b2a5-784d6cc3373d tempest-ProjectReaderTests-1299385716 None] Lock "cinder-0c794833-a536-4804-a544-089fbf14470f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.086s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:03:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-22c75f90-3682-4d18-b2a5-784d6cc3373d tempest-ProjectReaderTests-1299385716 None] Acquiring lock "cinder-quobyte-3806a4d4-d8ab-43c9-91fc-e471698b2af9" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:03:55 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4605d88-62bf-492a-a50b-a5c45f6ed635]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:03:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2f93f3cd-06a4-4ce7-850f-c7cfef2d24f1 tempest-CreateVolumesFromSnapshotTest-192351063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f16a30d-32fc-4a8f-a868-f8368fa74425.43390945-db4d-4826-8495-1c743aae7feb {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-22c75f90-3682-4d18-b2a5-784d6cc3373d tempest-ProjectReaderTests-1299385716 None] Lock "cinder-quobyte-3806a4d4-d8ab-43c9-91fc-e471698b2af9" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:03:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-22c75f90-3682-4d18-b2a5-784d6cc3373d tempest-ProjectReaderTests-1299385716 None] Acquiring lock "cinder-quobyte-0c794833-a536-4804-a544-089fbf14470f" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:03:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-22c75f90-3682-4d18-b2a5-784d6cc3373d tempest-ProjectReaderTests-1299385716 None] Lock "cinder-quobyte-0c794833-a536-4804-a544-089fbf14470f" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:03:55 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-22c75f90-3682-4d18-b2a5-784d6cc3373d tempest-ProjectReaderTests-1299385716 None] Deleting offline snapshot 0c794833-a536-4804-a544-089fbf14470f of volume 3806a4d4-d8ab-43c9-91fc-e471698b2af9 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:03:55 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-22c75f90-3682-4d18-b2a5-784d6cc3373d tempest-ProjectReaderTests-1299385716 None] snapshot_file for this snap is: volume-3806a4d4-d8ab-43c9-91fc-e471698b2af9.0c794833-a536-4804-a544-089fbf14470f {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:03:55 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6832bfde-782f-42a0-a486-fb5b51506884]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:03:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-22c75f90-3682-4d18-b2a5-784d6cc3373d tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3806a4d4-d8ab-43c9-91fc-e471698b2af9.0c794833-a536-4804-a544-089fbf14470f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:55 devstack sudo[105366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f16a30d-32fc-4a8f-a868-f8368fa74425.43390945-db4d-4826-8495-1c743aae7feb Nov 06 18:03:55 devstack sudo[105366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:55 devstack sudo[105367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3806a4d4-d8ab-43c9-91fc-e471698b2af9.0c794833-a536-4804-a544-089fbf14470f Nov 06 18:03:55 devstack sudo[105367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:56 devstack sudo[105366]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2f93f3cd-06a4-4ce7-850f-c7cfef2d24f1 tempest-CreateVolumesFromSnapshotTest-192351063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f16a30d-32fc-4a8f-a868-f8368fa74425.43390945-db4d-4826-8495-1c743aae7feb" returned: 0 in 0.542s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:56 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-2f93f3cd-06a4-4ce7-850f-c7cfef2d24f1 tempest-CreateVolumesFromSnapshotTest-192351063 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f16a30d-32fc-4a8f-a868-f8368fa74425(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:03:56 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[022c2a32-7070-44a2-9c02-b6e40d053a2b]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:03:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2f93f3cd-06a4-4ce7-850f-c7cfef2d24f1 tempest-CreateVolumesFromSnapshotTest-192351063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f16a30d-32fc-4a8f-a868-f8368fa74425 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:56 devstack sudo[105367]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-22c75f90-3682-4d18-b2a5-784d6cc3373d tempest-ProjectReaderTests-1299385716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3806a4d4-d8ab-43c9-91fc-e471698b2af9.0c794833-a536-4804-a544-089fbf14470f" returned: 0 in 0.562s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:56 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-22c75f90-3682-4d18-b2a5-784d6cc3373d tempest-ProjectReaderTests-1299385716 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3806a4d4-d8ab-43c9-91fc-e471698b2af9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:03:56 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-6916d57c-0801-4989-824f-2c130f7bc117 tempest-ProjectMemberTests-819176810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:03:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6916d57c-0801-4989-824f-2c130f7bc117 tempest-ProjectMemberTests-819176810 None] Flow 'volume_create_manager' (c52796db-0d0f-49e2-ad01-1e0c63761ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:03:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6916d57c-0801-4989-824f-2c130f7bc117 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (126f54af-0836-47b6-aa94-24594e31f4a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:56 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18e546d-d9c8-47ad-a931-281a0c52740d]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:03:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-22c75f90-3682-4d18-b2a5-784d6cc3373d tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3806a4d4-d8ab-43c9-91fc-e471698b2af9 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:56 devstack sudo[105378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f16a30d-32fc-4a8f-a868-f8368fa74425 Nov 06 18:03:56 devstack sudo[105378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6916d57c-0801-4989-824f-2c130f7bc117 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (126f54af-0836-47b6-aa94-24594e31f4a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1718978619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f1aaa74-fa3f-4116-b481-91bfeb8d2388,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b97cd7ef94764995a9e8c62cda23171f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:03:56Z,use_quota=True,user_id='a34e6465a98c4c289547d49a900a6bde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6916d57c-0801-4989-824f-2c130f7bc117 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bb3131b-fad1-40c8-9bd7-21d7f4e9cbec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6916d57c-0801-4989-824f-2c130f7bc117 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bb3131b-fad1-40c8-9bd7-21d7f4e9cbec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6916d57c-0801-4989-824f-2c130f7bc117 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54622c00-be60-49e6-8ad0-258a9d7f6192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6916d57c-0801-4989-824f-2c130f7bc117 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54622c00-be60-49e6-8ad0-258a9d7f6192) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f1aaa74-fa3f-4116-b481-91bfeb8d2388', 'volume_name': 'volume-2f1aaa74-fa3f-4116-b481-91bfeb8d2388', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6916d57c-0801-4989-824f-2c130f7bc117 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b73a44d5-a455-4fcd-86b5-94970727992e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6916d57c-0801-4989-824f-2c130f7bc117 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b73a44d5-a455-4fcd-86b5-94970727992e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6916d57c-0801-4989-824f-2c130f7bc117 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cf18286-8361-4d83-9763-4ae30bf1e75e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:56 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-6916d57c-0801-4989-824f-2c130f7bc117 tempest-ProjectMemberTests-819176810 None] Volume 2f1aaa74-fa3f-4116-b481-91bfeb8d2388: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f1aaa74-fa3f-4116-b481-91bfeb8d2388', 'volume_size': 1} Nov 06 18:03:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6916d57c-0801-4989-824f-2c130f7bc117 tempest-ProjectMemberTests-819176810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6916d57c-0801-4989-824f-2c130f7bc117 tempest-ProjectMemberTests-819176810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:56 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-6916d57c-0801-4989-824f-2c130f7bc117 tempest-ProjectMemberTests-819176810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1718978619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f1aaa74-fa3f-4116-b481-91bfeb8d2388,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b97cd7ef94764995a9e8c62cda23171f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:03:56Z,use_quota=True,user_id='a34e6465a98c4c289547d49a900a6bde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:03:56 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-6916d57c-0801-4989-824f-2c130f7bc117 tempest-ProjectMemberTests-819176810 None] Creating volume 2f1aaa74-fa3f-4116-b481-91bfeb8d2388 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:03:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6916d57c-0801-4989-824f-2c130f7bc117 tempest-ProjectMemberTests-819176810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6916d57c-0801-4989-824f-2c130f7bc117 tempest-ProjectMemberTests-819176810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:56 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-6916d57c-0801-4989-824f-2c130f7bc117 tempest-ProjectMemberTests-819176810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:03:56 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-6916d57c-0801-4989-824f-2c130f7bc117 tempest-ProjectMemberTests-819176810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:03:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6916d57c-0801-4989-824f-2c130f7bc117 tempest-ProjectMemberTests-819176810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:56 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-6916d57c-0801-4989-824f-2c130f7bc117 tempest-ProjectMemberTests-819176810 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:03:56 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-6916d57c-0801-4989-824f-2c130f7bc117 tempest-ProjectMemberTests-819176810 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:03:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6916d57c-0801-4989-824f-2c130f7bc117 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-2f1aaa74-fa3f-4116-b481-91bfeb8d2388 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:56 devstack sudo[105381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-2f1aaa74-fa3f-4116-b481-91bfeb8d2388 1073741824 Nov 06 18:03:56 devstack sudo[105381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:56 devstack sudo[105379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3806a4d4-d8ab-43c9-91fc-e471698b2af9 Nov 06 18:03:56 devstack sudo[105379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:56 devstack sudo[105378]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2f93f3cd-06a4-4ce7-850f-c7cfef2d24f1 tempest-CreateVolumesFromSnapshotTest-192351063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f16a30d-32fc-4a8f-a868-f8368fa74425" returned: 0 in 0.453s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2f93f3cd-06a4-4ce7-850f-c7cfef2d24f1 tempest-CreateVolumesFromSnapshotTest-192351063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f16a30d-32fc-4a8f-a868-f8368fa74425.43390945-db4d-4826-8495-1c743aae7feb {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:56 devstack sudo[105388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f16a30d-32fc-4a8f-a868-f8368fa74425.43390945-db4d-4826-8495-1c743aae7feb Nov 06 18:03:56 devstack sudo[105388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:56 devstack sudo[105379]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-22c75f90-3682-4d18-b2a5-784d6cc3373d tempest-ProjectReaderTests-1299385716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3806a4d4-d8ab-43c9-91fc-e471698b2af9" returned: 0 in 0.474s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-22c75f90-3682-4d18-b2a5-784d6cc3373d tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3806a4d4-d8ab-43c9-91fc-e471698b2af9.0c794833-a536-4804-a544-089fbf14470f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:56 devstack sudo[105430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3806a4d4-d8ab-43c9-91fc-e471698b2af9.0c794833-a536-4804-a544-089fbf14470f Nov 06 18:03:56 devstack sudo[105430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:57 devstack sudo[105381]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6916d57c-0801-4989-824f-2c130f7bc117 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-2f1aaa74-fa3f-4116-b481-91bfeb8d2388 1073741824" returned: 0 in 0.693s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6916d57c-0801-4989-824f-2c130f7bc117 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-2f1aaa74-fa3f-4116-b481-91bfeb8d2388 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:57 devstack sudo[105388]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2f93f3cd-06a4-4ce7-850f-c7cfef2d24f1 tempest-CreateVolumesFromSnapshotTest-192351063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f16a30d-32fc-4a8f-a868-f8368fa74425.43390945-db4d-4826-8495-1c743aae7feb" returned: 0 in 0.582s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2f93f3cd-06a4-4ce7-850f-c7cfef2d24f1 tempest-CreateVolumesFromSnapshotTest-192351063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f16a30d-32fc-4a8f-a868-f8368fa74425.43390945-db4d-4826-8495-1c743aae7feb {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:57 devstack sudo[105440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-2f1aaa74-fa3f-4116-b481-91bfeb8d2388 Nov 06 18:03:57 devstack sudo[105440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:57 devstack sudo[105442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f16a30d-32fc-4a8f-a868-f8368fa74425.43390945-db4d-4826-8495-1c743aae7feb Nov 06 18:03:57 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:57 devstack sudo[105430]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-22c75f90-3682-4d18-b2a5-784d6cc3373d tempest-ProjectReaderTests-1299385716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3806a4d4-d8ab-43c9-91fc-e471698b2af9.0c794833-a536-4804-a544-089fbf14470f" returned: 0 in 0.587s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-22c75f90-3682-4d18-b2a5-784d6cc3373d tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3806a4d4-d8ab-43c9-91fc-e471698b2af9.0c794833-a536-4804-a544-089fbf14470f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:57 devstack sudo[105446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3806a4d4-d8ab-43c9-91fc-e471698b2af9.0c794833-a536-4804-a544-089fbf14470f Nov 06 18:03:57 devstack sudo[105446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:57 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2f93f3cd-06a4-4ce7-850f-c7cfef2d24f1 tempest-CreateVolumesFromSnapshotTest-192351063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f16a30d-32fc-4a8f-a868-f8368fa74425.43390945-db4d-4826-8495-1c743aae7feb" returned: 0 in 0.318s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:57 devstack sudo[105440]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6916d57c-0801-4989-824f-2c130f7bc117 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-2f1aaa74-fa3f-4116-b481-91bfeb8d2388" returned: 0 in 0.409s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:57 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-6916d57c-0801-4989-824f-2c130f7bc117 tempest-ProjectMemberTests-819176810 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:03:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6916d57c-0801-4989-824f-2c130f7bc117 tempest-ProjectMemberTests-819176810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.209s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:03:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2f93f3cd-06a4-4ce7-850f-c7cfef2d24f1 tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "cinder-quobyte-43390945-db4d-4826-8495-1c743aae7feb" released by "_delete_snapshot" :: held 2.097s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:03:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2f93f3cd-06a4-4ce7-850f-c7cfef2d24f1 tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "cinder-quobyte-6f16a30d-32fc-4a8f-a868-f8368fa74425" released by "delete_snapshot" :: held 2.153s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:03:57 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6916d57c-0801-4989-824f-2c130f7bc117 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cf18286-8361-4d83-9763-4ae30bf1e75e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f1aaa74-fa3f-4116-b481-91bfeb8d2388', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:57 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6916d57c-0801-4989-824f-2c130f7bc117 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c2ebfab-a195-450d-bf12-d6806b57987b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:03:57 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-6916d57c-0801-4989-824f-2c130f7bc117 tempest-ProjectMemberTests-819176810 None] Volume volume-2f1aaa74-fa3f-4116-b481-91bfeb8d2388 (2f1aaa74-fa3f-4116-b481-91bfeb8d2388): created successfully Nov 06 18:03:57 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6916d57c-0801-4989-824f-2c130f7bc117 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c2ebfab-a195-450d-bf12-d6806b57987b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:03:57 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6916d57c-0801-4989-824f-2c130f7bc117 tempest-ProjectMemberTests-819176810 None] Flow 'volume_create_manager' (c52796db-0d0f-49e2-ad01-1e0c63761ad8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:03:57 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-6916d57c-0801-4989-824f-2c130f7bc117 tempest-ProjectMemberTests-819176810 None] Created volume successfully. Nov 06 18:03:57 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-2f93f3cd-06a4-4ce7-850f-c7cfef2d24f1 tempest-CreateVolumesFromSnapshotTest-192351063 None] Created reservations ['02eab784-0c32-44c4-bc4f-801a8371edf8', '05f2749a-d8fe-4548-be66-aa4651f1f647', '0c535caa-2163-46f7-932d-1b997d88ecf6', 'be5e208f-ce98-42f8-9d41-dfdf30fc7869'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:03:57 devstack sudo[105446]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-22c75f90-3682-4d18-b2a5-784d6cc3373d tempest-ProjectReaderTests-1299385716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3806a4d4-d8ab-43c9-91fc-e471698b2af9.0c794833-a536-4804-a544-089fbf14470f" returned: 0 in 0.385s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-22c75f90-3682-4d18-b2a5-784d6cc3373d tempest-ProjectReaderTests-1299385716 None] Lock "cinder-quobyte-0c794833-a536-4804-a544-089fbf14470f" released by "_delete_snapshot" :: held 2.162s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:03:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-22c75f90-3682-4d18-b2a5-784d6cc3373d tempest-ProjectReaderTests-1299385716 None] Lock "cinder-quobyte-3806a4d4-d8ab-43c9-91fc-e471698b2af9" released by "delete_snapshot" :: held 2.197s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:03:57 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-2f93f3cd-06a4-4ce7-850f-c7cfef2d24f1 tempest-CreateVolumesFromSnapshotTest-192351063 None] Delete snapshot completed successfully. Nov 06 18:03:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2f93f3cd-06a4-4ce7-850f-c7cfef2d24f1 tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "cinder-43390945-db4d-4826-8495-1c743aae7feb-delete_snapshot" released by "delete_snapshot" :: held 2.415s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:03:57 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-22c75f90-3682-4d18-b2a5-784d6cc3373d tempest-ProjectReaderTests-1299385716 None] Created reservations ['ed9c2082-661f-4470-947d-a86920c3d112', '5ce26a0f-f2e4-4f01-ac3e-e695a9d99654', '3aa74c1a-ed3f-460d-9c6e-6ae728546b45', '687e0b2c-77e6-4039-90f2-286d50eaa411'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:03:57 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-22c75f90-3682-4d18-b2a5-784d6cc3373d tempest-ProjectReaderTests-1299385716 None] Delete snapshot completed successfully. Nov 06 18:03:58 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-22c75f90-3682-4d18-b2a5-784d6cc3373d tempest-ProjectReaderTests-1299385716 None] Lock "cinder-0c794833-a536-4804-a544-089fbf14470f-delete_snapshot" released by "delete_snapshot" :: held 2.369s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:03:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-eebbe0d4-5eaf-4af7-85a3-2de74d333439 tempest-ProjectMemberTests-819176810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-eebbe0d4-5eaf-4af7-85a3-2de74d333439 tempest-ProjectMemberTests-819176810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:58 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-eebbe0d4-5eaf-4af7-85a3-2de74d333439 tempest-ProjectMemberTests-819176810 None] Creating offline snapshot dc7ddc40-743b-4b50-b08f-e065ebff8d16 of volume 2f1aaa74-fa3f-4116-b481-91bfeb8d2388 {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:03:58 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad571ac-f5ee-4821-aea5-743e71267fa4]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:03:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-eebbe0d4-5eaf-4af7-85a3-2de74d333439 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-2f1aaa74-fa3f-4116-b481-91bfeb8d2388 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:58 devstack sudo[105453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-2f1aaa74-fa3f-4116-b481-91bfeb8d2388 Nov 06 18:03:58 devstack sudo[105453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:58 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a60a6de5-1fc2-452b-b357-ecd9da5f1ca2 tempest-CreateVolumesFromSnapshotTest-192351063 None] Acquiring lock "cinder-6f16a30d-32fc-4a8f-a868-f8368fa74425-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:03:58 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a60a6de5-1fc2-452b-b357-ecd9da5f1ca2 tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "cinder-6f16a30d-32fc-4a8f-a868-f8368fa74425-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:03:58 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c1618488-bbfb-4293-b7cd-3c4cfcfa2ec8 tempest-ProjectReaderTests-1299385716 None] Acquiring lock "cinder-3806a4d4-d8ab-43c9-91fc-e471698b2af9-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:03:58 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c1618488-bbfb-4293-b7cd-3c4cfcfa2ec8 tempest-ProjectReaderTests-1299385716 None] Lock "cinder-3806a4d4-d8ab-43c9-91fc-e471698b2af9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:03:58 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a60a6de5-1fc2-452b-b357-ecd9da5f1ca2 tempest-CreateVolumesFromSnapshotTest-192351063 None] Acquiring lock "cinder-quobyte-6f16a30d-32fc-4a8f-a868-f8368fa74425" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:03:58 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a60a6de5-1fc2-452b-b357-ecd9da5f1ca2 tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "cinder-quobyte-6f16a30d-32fc-4a8f-a868-f8368fa74425" acquired by "delete_volume" :: waited 0.039s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:03:59 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c1618488-bbfb-4293-b7cd-3c4cfcfa2ec8 tempest-ProjectReaderTests-1299385716 None] Acquiring lock "cinder-quobyte-3806a4d4-d8ab-43c9-91fc-e471698b2af9" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:03:59 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ded9127-ff92-4d20-a56d-33ed93b1b4fa]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:03:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a60a6de5-1fc2-452b-b357-ecd9da5f1ca2 tempest-CreateVolumesFromSnapshotTest-192351063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f16a30d-32fc-4a8f-a868-f8368fa74425 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:59 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c1618488-bbfb-4293-b7cd-3c4cfcfa2ec8 tempest-ProjectReaderTests-1299385716 None] Lock "cinder-quobyte-3806a4d4-d8ab-43c9-91fc-e471698b2af9" acquired by "delete_volume" :: waited 0.038s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:03:59 devstack sudo[105453]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-eebbe0d4-5eaf-4af7-85a3-2de74d333439 tempest-ProjectMemberTests-819176810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-2f1aaa74-fa3f-4116-b481-91bfeb8d2388" returned: 0 in 0.487s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-eebbe0d4-5eaf-4af7-85a3-2de74d333439 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-2f1aaa74-fa3f-4116-b481-91bfeb8d2388,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-2f1aaa74-fa3f-4116-b481-91bfeb8d2388.dc7ddc40-743b-4b50-b08f-e065ebff8d16 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:59 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[125ac816-6bb1-4f7b-b053-9846c42b04cc]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:03:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c1618488-bbfb-4293-b7cd-3c4cfcfa2ec8 tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3806a4d4-d8ab-43c9-91fc-e471698b2af9 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:59 devstack sudo[105459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-2f1aaa74-fa3f-4116-b481-91bfeb8d2388,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-2f1aaa74-fa3f-4116-b481-91bfeb8d2388.dc7ddc40-743b-4b50-b08f-e065ebff8d16 1G Nov 06 18:03:59 devstack sudo[105459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:59 devstack sudo[105458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f16a30d-32fc-4a8f-a868-f8368fa74425 Nov 06 18:03:59 devstack sudo[105458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:59 devstack sudo[105460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3806a4d4-d8ab-43c9-91fc-e471698b2af9 Nov 06 18:03:59 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:59 devstack sudo[105458]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a60a6de5-1fc2-452b-b357-ecd9da5f1ca2 tempest-CreateVolumesFromSnapshotTest-192351063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f16a30d-32fc-4a8f-a868-f8368fa74425" returned: 0 in 0.425s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a60a6de5-1fc2-452b-b357-ecd9da5f1ca2 tempest-CreateVolumesFromSnapshotTest-192351063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f16a30d-32fc-4a8f-a868-f8368fa74425 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:59 devstack sudo[105471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f16a30d-32fc-4a8f-a868-f8368fa74425 Nov 06 18:03:59 devstack sudo[105471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:59 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c1618488-bbfb-4293-b7cd-3c4cfcfa2ec8 tempest-ProjectReaderTests-1299385716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3806a4d4-d8ab-43c9-91fc-e471698b2af9" returned: 0 in 0.440s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c1618488-bbfb-4293-b7cd-3c4cfcfa2ec8 tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3806a4d4-d8ab-43c9-91fc-e471698b2af9 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:59 devstack sudo[105476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3806a4d4-d8ab-43c9-91fc-e471698b2af9 Nov 06 18:03:59 devstack sudo[105476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:59 devstack sudo[105459]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-eebbe0d4-5eaf-4af7-85a3-2de74d333439 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-2f1aaa74-fa3f-4116-b481-91bfeb8d2388,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-2f1aaa74-fa3f-4116-b481-91bfeb8d2388.dc7ddc40-743b-4b50-b08f-e065ebff8d16 1G" returned: 0 in 0.516s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-eebbe0d4-5eaf-4af7-85a3-2de74d333439 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f1aaa74-fa3f-4116-b481-91bfeb8d2388 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-2f1aaa74-fa3f-4116-b481-91bfeb8d2388.dc7ddc40-743b-4b50-b08f-e065ebff8d16 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:03:59 devstack sudo[105478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f1aaa74-fa3f-4116-b481-91bfeb8d2388 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-2f1aaa74-fa3f-4116-b481-91bfeb8d2388.dc7ddc40-743b-4b50-b08f-e065ebff8d16 Nov 06 18:03:59 devstack sudo[105478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:03:59 devstack sudo[105471]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a60a6de5-1fc2-452b-b357-ecd9da5f1ca2 tempest-CreateVolumesFromSnapshotTest-192351063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6f16a30d-32fc-4a8f-a868-f8368fa74425" returned: 0 in 0.318s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:59 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a60a6de5-1fc2-452b-b357-ecd9da5f1ca2 tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "cinder-quobyte-6f16a30d-32fc-4a8f-a868-f8368fa74425" released by "delete_volume" :: held 0.827s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:03:59 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-a60a6de5-1fc2-452b-b357-ecd9da5f1ca2 tempest-CreateVolumesFromSnapshotTest-192351063 None] Created reservations ['6fa88a5f-a72e-495f-ae4f-77b039588c92', 'd076442e-8547-4ef5-b074-b12a12e1dcd5', 'bbf9a84d-f56c-4fcc-9383-f98d8e30e3f6', '31362119-f2e2-43fc-a13a-5b3437234cb1'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:03:59 devstack sudo[105476]: pam_unix(sudo:session): session closed for user root Nov 06 18:03:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c1618488-bbfb-4293-b7cd-3c4cfcfa2ec8 tempest-ProjectReaderTests-1299385716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-3806a4d4-d8ab-43c9-91fc-e471698b2af9" returned: 0 in 0.304s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:03:59 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c1618488-bbfb-4293-b7cd-3c4cfcfa2ec8 tempest-ProjectReaderTests-1299385716 None] Lock "cinder-quobyte-3806a4d4-d8ab-43c9-91fc-e471698b2af9" released by "delete_volume" :: held 0.853s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:03:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a60a6de5-1fc2-452b-b357-ecd9da5f1ca2 tempest-CreateVolumesFromSnapshotTest-192351063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:03:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a60a6de5-1fc2-452b-b357-ecd9da5f1ca2 tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:03:59 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a60a6de5-1fc2-452b-b357-ecd9da5f1ca2 tempest-CreateVolumesFromSnapshotTest-192351063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:04:00 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a60a6de5-1fc2-452b-b357-ecd9da5f1ca2 tempest-CreateVolumesFromSnapshotTest-192351063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:04:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a60a6de5-1fc2-452b-b357-ecd9da5f1ca2 tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a60a6de5-1fc2-452b-b357-ecd9da5f1ca2 tempest-CreateVolumesFromSnapshotTest-192351063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:00 devstack sudo[105478]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-eebbe0d4-5eaf-4af7-85a3-2de74d333439 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f1aaa74-fa3f-4116-b481-91bfeb8d2388 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-2f1aaa74-fa3f-4116-b481-91bfeb8d2388.dc7ddc40-743b-4b50-b08f-e065ebff8d16" returned: 0 in 0.417s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:00 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-eebbe0d4-5eaf-4af7-85a3-2de74d333439 tempest-ProjectMemberTests-819176810 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-2f1aaa74-fa3f-4116-b481-91bfeb8d2388.dc7ddc40-743b-4b50-b08f-e065ebff8d16 is being set with open permissions: ugo+rw Nov 06 18:04:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-eebbe0d4-5eaf-4af7-85a3-2de74d333439 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-2f1aaa74-fa3f-4116-b481-91bfeb8d2388.dc7ddc40-743b-4b50-b08f-e065ebff8d16 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:00 devstack sudo[105485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:04:00 devstack sudo[105485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:00 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-c1618488-bbfb-4293-b7cd-3c4cfcfa2ec8 tempest-ProjectReaderTests-1299385716 None] Created reservations ['13474dc5-8b73-4755-ad3a-a992c3a672ce', '46ab98e7-301d-46bb-81b0-a8be7f44e02c', 'c94adb4b-de68-4566-92e9-8ff45e417eaf', '0d80aad3-dc32-4b72-9dab-6601b6c66ff1'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:04:00 devstack sudo[105486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-2f1aaa74-fa3f-4116-b481-91bfeb8d2388.dc7ddc40-743b-4b50-b08f-e065ebff8d16 Nov 06 18:04:00 devstack sudo[105486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c1618488-bbfb-4293-b7cd-3c4cfcfa2ec8 tempest-ProjectReaderTests-1299385716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c1618488-bbfb-4293-b7cd-3c4cfcfa2ec8 tempest-ProjectReaderTests-1299385716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:00 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c1618488-bbfb-4293-b7cd-3c4cfcfa2ec8 tempest-ProjectReaderTests-1299385716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:04:00 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c1618488-bbfb-4293-b7cd-3c4cfcfa2ec8 tempest-ProjectReaderTests-1299385716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:04:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c1618488-bbfb-4293-b7cd-3c4cfcfa2ec8 tempest-ProjectReaderTests-1299385716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c1618488-bbfb-4293-b7cd-3c4cfcfa2ec8 tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:00 devstack sudo[105489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:04:00 devstack sudo[105489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:00 devstack sudo[105485]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a60a6de5-1fc2-452b-b357-ecd9da5f1ca2 tempest-CreateVolumesFromSnapshotTest-192351063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.407s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:00 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-a60a6de5-1fc2-452b-b357-ecd9da5f1ca2 tempest-CreateVolumesFromSnapshotTest-192351063 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:04:00 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-a60a6de5-1fc2-452b-b357-ecd9da5f1ca2 tempest-CreateVolumesFromSnapshotTest-192351063 None] Deleted volume successfully. Nov 06 18:04:00 devstack sudo[105486]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-eebbe0d4-5eaf-4af7-85a3-2de74d333439 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-2f1aaa74-fa3f-4116-b481-91bfeb8d2388.dc7ddc40-743b-4b50-b08f-e065ebff8d16" returned: 0 in 0.406s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:00 devstack sudo[105489]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c1618488-bbfb-4293-b7cd-3c4cfcfa2ec8 tempest-ProjectReaderTests-1299385716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.296s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:00 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-c1618488-bbfb-4293-b7cd-3c4cfcfa2ec8 tempest-ProjectReaderTests-1299385716 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:04:00 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-c1618488-bbfb-4293-b7cd-3c4cfcfa2ec8 tempest-ProjectReaderTests-1299385716 None] Deleted volume successfully. Nov 06 18:04:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-eebbe0d4-5eaf-4af7-85a3-2de74d333439 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-2f1aaa74-fa3f-4116-b481-91bfeb8d2388.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:00 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a60a6de5-1fc2-452b-b357-ecd9da5f1ca2 tempest-CreateVolumesFromSnapshotTest-192351063 None] Lock "cinder-6f16a30d-32fc-4a8f-a868-f8368fa74425-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:00 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c1618488-bbfb-4293-b7cd-3c4cfcfa2ec8 tempest-ProjectReaderTests-1299385716 None] Lock "cinder-3806a4d4-d8ab-43c9-91fc-e471698b2af9-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:00 devstack sudo[105494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-2f1aaa74-fa3f-4116-b481-91bfeb8d2388.info Nov 06 18:04:00 devstack sudo[105494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:00 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-2438460e-886d-4137-b595-9559fda40f13 tempest-ProjectReaderTests-504795444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:04:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2438460e-886d-4137-b595-9559fda40f13 tempest-ProjectReaderTests-504795444 None] Flow 'volume_create_manager' (9cb5c2e7-775a-4e91-99e1-513edb6c6f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:04:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2438460e-886d-4137-b595-9559fda40f13 tempest-ProjectReaderTests-504795444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be450fb4-64c9-4e19-a27e-38f999038a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2438460e-886d-4137-b595-9559fda40f13 tempest-ProjectReaderTests-504795444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be450fb4-64c9-4e19-a27e-38f999038a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:04:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2000587192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a542ee7-4909-46e6-8c1b-3277d1c621bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8af9d84684994850b6a6f75b1dd41e07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:04:01Z,use_quota=True,user_id='ffdaa10b1a234e0ea970e1538ea3c29b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2438460e-886d-4137-b595-9559fda40f13 tempest-ProjectReaderTests-504795444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97c71f0b-375d-4dae-b6d2-96a1ce2bbe8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2438460e-886d-4137-b595-9559fda40f13 tempest-ProjectReaderTests-504795444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97c71f0b-375d-4dae-b6d2-96a1ce2bbe8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2438460e-886d-4137-b595-9559fda40f13 tempest-ProjectReaderTests-504795444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f0f424c-05de-4454-b1cf-228cb57a2826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2438460e-886d-4137-b595-9559fda40f13 tempest-ProjectReaderTests-504795444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f0f424c-05de-4454-b1cf-228cb57a2826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a542ee7-4909-46e6-8c1b-3277d1c621bc', 'volume_name': 'volume-0a542ee7-4909-46e6-8c1b-3277d1c621bc', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2438460e-886d-4137-b595-9559fda40f13 tempest-ProjectReaderTests-504795444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e92c75f-15f7-4deb-9a69-50ec66accc34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2438460e-886d-4137-b595-9559fda40f13 tempest-ProjectReaderTests-504795444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e92c75f-15f7-4deb-9a69-50ec66accc34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2438460e-886d-4137-b595-9559fda40f13 tempest-ProjectReaderTests-504795444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07de26d6-538b-4a01-a2b7-ceca23aa31d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:00 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-2438460e-886d-4137-b595-9559fda40f13 tempest-ProjectReaderTests-504795444 None] Volume 0a542ee7-4909-46e6-8c1b-3277d1c621bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a542ee7-4909-46e6-8c1b-3277d1c621bc', 'volume_size': 1} Nov 06 18:04:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2438460e-886d-4137-b595-9559fda40f13 tempest-ProjectReaderTests-504795444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:00 devstack sudo[105494]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-eebbe0d4-5eaf-4af7-85a3-2de74d333439 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-2f1aaa74-fa3f-4116-b481-91bfeb8d2388.info" returned: 0 in 0.279s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:00 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-eebbe0d4-5eaf-4af7-85a3-2de74d333439 tempest-ProjectMemberTests-819176810 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-2f1aaa74-fa3f-4116-b481-91bfeb8d2388.info is being set with open permissions: ugo+rw Nov 06 18:04:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-eebbe0d4-5eaf-4af7-85a3-2de74d333439 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-2f1aaa74-fa3f-4116-b481-91bfeb8d2388.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:00 devstack sudo[105497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-2f1aaa74-fa3f-4116-b481-91bfeb8d2388.info Nov 06 18:04:00 devstack sudo[105497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:01 devstack sudo[105497]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-eebbe0d4-5eaf-4af7-85a3-2de74d333439 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-2f1aaa74-fa3f-4116-b481-91bfeb8d2388.info" returned: 0 in 0.285s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-eebbe0d4-5eaf-4af7-85a3-2de74d333439 tempest-ProjectMemberTests-819176810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.535s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2438460e-886d-4137-b595-9559fda40f13 tempest-ProjectReaderTests-504795444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.379s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2438460e-886d-4137-b595-9559fda40f13 tempest-ProjectReaderTests-504795444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:04:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2000587192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a542ee7-4909-46e6-8c1b-3277d1c621bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8af9d84684994850b6a6f75b1dd41e07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:04:01Z,use_quota=True,user_id='ffdaa10b1a234e0ea970e1538ea3c29b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:04:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-2438460e-886d-4137-b595-9559fda40f13 tempest-ProjectReaderTests-504795444 None] Creating volume 0a542ee7-4909-46e6-8c1b-3277d1c621bc {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:04:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2438460e-886d-4137-b595-9559fda40f13 tempest-ProjectReaderTests-504795444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2438460e-886d-4137-b595-9559fda40f13 tempest-ProjectReaderTests-504795444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2438460e-886d-4137-b595-9559fda40f13 tempest-ProjectReaderTests-504795444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:04:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2438460e-886d-4137-b595-9559fda40f13 tempest-ProjectReaderTests-504795444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:04:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2438460e-886d-4137-b595-9559fda40f13 tempest-ProjectReaderTests-504795444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2438460e-886d-4137-b595-9559fda40f13 tempest-ProjectReaderTests-504795444 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:04:01 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-2438460e-886d-4137-b595-9559fda40f13 tempest-ProjectReaderTests-504795444 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:04:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2438460e-886d-4137-b595-9559fda40f13 tempest-ProjectReaderTests-504795444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-0a542ee7-4909-46e6-8c1b-3277d1c621bc 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:01 devstack sudo[105501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-0a542ee7-4909-46e6-8c1b-3277d1c621bc 1073741824 Nov 06 18:04:01 devstack sudo[105501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:01 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-eebbe0d4-5eaf-4af7-85a3-2de74d333439 tempest-ProjectMemberTests-819176810 None] Create snapshot completed successfully Nov 06 18:04:01 devstack sudo[105501]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2438460e-886d-4137-b595-9559fda40f13 tempest-ProjectReaderTests-504795444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-0a542ee7-4909-46e6-8c1b-3277d1c621bc 1073741824" returned: 0 in 0.543s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:01 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-890899f5-e068-4b5d-afad-aa1e6116e8a0 tempest-ProjectReaderTests-1299385716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:04:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-890899f5-e068-4b5d-afad-aa1e6116e8a0 tempest-ProjectReaderTests-1299385716 None] Flow 'volume_create_manager' (137f3431-69ff-4c43-adc5-191bea37a966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:04:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-890899f5-e068-4b5d-afad-aa1e6116e8a0 tempest-ProjectReaderTests-1299385716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90133860-94b6-42d5-8ba6-c0016c00b0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2438460e-886d-4137-b595-9559fda40f13 tempest-ProjectReaderTests-504795444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-0a542ee7-4909-46e6-8c1b-3277d1c621bc {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-890899f5-e068-4b5d-afad-aa1e6116e8a0 tempest-ProjectReaderTests-1299385716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90133860-94b6-42d5-8ba6-c0016c00b0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-232110809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c41285b9-34df-49fa-be68-4df96c8d243b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c5284ac37ff4d179815435f871ca0fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:04:02Z,use_quota=True,user_id='caa4f376bb65466cba7edd807cf24033',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-890899f5-e068-4b5d-afad-aa1e6116e8a0 tempest-ProjectReaderTests-1299385716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c17ca99-660b-4ccc-9d64-0e2bfec0a271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:01 devstack sudo[105508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-0a542ee7-4909-46e6-8c1b-3277d1c621bc Nov 06 18:04:01 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-890899f5-e068-4b5d-afad-aa1e6116e8a0 tempest-ProjectReaderTests-1299385716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c17ca99-660b-4ccc-9d64-0e2bfec0a271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-890899f5-e068-4b5d-afad-aa1e6116e8a0 tempest-ProjectReaderTests-1299385716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a992f068-0754-4045-baeb-37a792631942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-890899f5-e068-4b5d-afad-aa1e6116e8a0 tempest-ProjectReaderTests-1299385716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a992f068-0754-4045-baeb-37a792631942) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c41285b9-34df-49fa-be68-4df96c8d243b', 'volume_name': 'volume-c41285b9-34df-49fa-be68-4df96c8d243b', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-890899f5-e068-4b5d-afad-aa1e6116e8a0 tempest-ProjectReaderTests-1299385716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93366420-2835-4c83-ba54-ff629a8e34ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-890899f5-e068-4b5d-afad-aa1e6116e8a0 tempest-ProjectReaderTests-1299385716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93366420-2835-4c83-ba54-ff629a8e34ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-890899f5-e068-4b5d-afad-aa1e6116e8a0 tempest-ProjectReaderTests-1299385716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (967bb654-f16f-4316-bd54-3aa92cf3afbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:01 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-890899f5-e068-4b5d-afad-aa1e6116e8a0 tempest-ProjectReaderTests-1299385716 None] Volume c41285b9-34df-49fa-be68-4df96c8d243b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c41285b9-34df-49fa-be68-4df96c8d243b', 'volume_size': 1} Nov 06 18:04:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-890899f5-e068-4b5d-afad-aa1e6116e8a0 tempest-ProjectReaderTests-1299385716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:01 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ab6e15a3-057e-49f7-8e4f-5b925595708b tempest-ProjectMemberTests-819176810 None] Acquiring lock "cinder-dc7ddc40-743b-4b50-b08f-e065ebff8d16-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:01 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ab6e15a3-057e-49f7-8e4f-5b925595708b tempest-ProjectMemberTests-819176810 None] Lock "cinder-dc7ddc40-743b-4b50-b08f-e065ebff8d16-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:01 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ab6e15a3-057e-49f7-8e4f-5b925595708b tempest-ProjectMemberTests-819176810 None] Acquiring lock "cinder-quobyte-2f1aaa74-fa3f-4116-b481-91bfeb8d2388" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:01 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ab6e15a3-057e-49f7-8e4f-5b925595708b tempest-ProjectMemberTests-819176810 None] Lock "cinder-quobyte-2f1aaa74-fa3f-4116-b481-91bfeb8d2388" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:01 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ab6e15a3-057e-49f7-8e4f-5b925595708b tempest-ProjectMemberTests-819176810 None] Acquiring lock "cinder-quobyte-dc7ddc40-743b-4b50-b08f-e065ebff8d16" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:01 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ab6e15a3-057e-49f7-8e4f-5b925595708b tempest-ProjectMemberTests-819176810 None] Lock "cinder-quobyte-dc7ddc40-743b-4b50-b08f-e065ebff8d16" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-ab6e15a3-057e-49f7-8e4f-5b925595708b tempest-ProjectMemberTests-819176810 None] Deleting offline snapshot dc7ddc40-743b-4b50-b08f-e065ebff8d16 of volume 2f1aaa74-fa3f-4116-b481-91bfeb8d2388 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:04:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-ab6e15a3-057e-49f7-8e4f-5b925595708b tempest-ProjectMemberTests-819176810 None] snapshot_file for this snap is: volume-2f1aaa74-fa3f-4116-b481-91bfeb8d2388.dc7ddc40-743b-4b50-b08f-e065ebff8d16 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:04:01 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc19f31-e95c-4392-9091-d84ee51ee14e]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:04:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ab6e15a3-057e-49f7-8e4f-5b925595708b tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-2f1aaa74-fa3f-4116-b481-91bfeb8d2388.dc7ddc40-743b-4b50-b08f-e065ebff8d16 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:02 devstack sudo[105510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-2f1aaa74-fa3f-4116-b481-91bfeb8d2388.dc7ddc40-743b-4b50-b08f-e065ebff8d16 Nov 06 18:04:02 devstack sudo[105510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:02 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2438460e-886d-4137-b595-9559fda40f13 tempest-ProjectReaderTests-504795444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-0a542ee7-4909-46e6-8c1b-3277d1c621bc" returned: 0 in 0.331s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:02 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2438460e-886d-4137-b595-9559fda40f13 tempest-ProjectReaderTests-504795444 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:04:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2438460e-886d-4137-b595-9559fda40f13 tempest-ProjectReaderTests-504795444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-890899f5-e068-4b5d-afad-aa1e6116e8a0 tempest-ProjectReaderTests-1299385716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.271s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:02 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-890899f5-e068-4b5d-afad-aa1e6116e8a0 tempest-ProjectReaderTests-1299385716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-232110809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c41285b9-34df-49fa-be68-4df96c8d243b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c5284ac37ff4d179815435f871ca0fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:04:02Z,use_quota=True,user_id='caa4f376bb65466cba7edd807cf24033',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:04:02 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-890899f5-e068-4b5d-afad-aa1e6116e8a0 tempest-ProjectReaderTests-1299385716 None] Creating volume c41285b9-34df-49fa-be68-4df96c8d243b {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:04:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-890899f5-e068-4b5d-afad-aa1e6116e8a0 tempest-ProjectReaderTests-1299385716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-890899f5-e068-4b5d-afad-aa1e6116e8a0 tempest-ProjectReaderTests-1299385716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:02 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-890899f5-e068-4b5d-afad-aa1e6116e8a0 tempest-ProjectReaderTests-1299385716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:04:02 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-890899f5-e068-4b5d-afad-aa1e6116e8a0 tempest-ProjectReaderTests-1299385716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:04:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-890899f5-e068-4b5d-afad-aa1e6116e8a0 tempest-ProjectReaderTests-1299385716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:02 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-890899f5-e068-4b5d-afad-aa1e6116e8a0 tempest-ProjectReaderTests-1299385716 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:04:02 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-890899f5-e068-4b5d-afad-aa1e6116e8a0 tempest-ProjectReaderTests-1299385716 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:04:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-890899f5-e068-4b5d-afad-aa1e6116e8a0 tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c41285b9-34df-49fa-be68-4df96c8d243b 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:02 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2438460e-886d-4137-b595-9559fda40f13 tempest-ProjectReaderTests-504795444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07de26d6-538b-4a01-a2b7-ceca23aa31d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a542ee7-4909-46e6-8c1b-3277d1c621bc', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:02 devstack sudo[105513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c41285b9-34df-49fa-be68-4df96c8d243b 1073741824 Nov 06 18:04:02 devstack sudo[105513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:02 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2438460e-886d-4137-b595-9559fda40f13 tempest-ProjectReaderTests-504795444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (035d5764-881f-48ce-88b5-bab047875318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:02 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-2438460e-886d-4137-b595-9559fda40f13 tempest-ProjectReaderTests-504795444 None] Volume volume-0a542ee7-4909-46e6-8c1b-3277d1c621bc (0a542ee7-4909-46e6-8c1b-3277d1c621bc): created successfully Nov 06 18:04:02 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2438460e-886d-4137-b595-9559fda40f13 tempest-ProjectReaderTests-504795444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (035d5764-881f-48ce-88b5-bab047875318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:02 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2438460e-886d-4137-b595-9559fda40f13 tempest-ProjectReaderTests-504795444 None] Flow 'volume_create_manager' (9cb5c2e7-775a-4e91-99e1-513edb6c6f26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:04:02 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-2438460e-886d-4137-b595-9559fda40f13 tempest-ProjectReaderTests-504795444 None] Created volume successfully. Nov 06 18:04:02 devstack sudo[105510]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ab6e15a3-057e-49f7-8e4f-5b925595708b tempest-ProjectMemberTests-819176810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-2f1aaa74-fa3f-4116-b481-91bfeb8d2388.dc7ddc40-743b-4b50-b08f-e065ebff8d16" returned: 0 in 0.437s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:02 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-ab6e15a3-057e-49f7-8e4f-5b925595708b tempest-ProjectMemberTests-819176810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f1aaa74-fa3f-4116-b481-91bfeb8d2388(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:04:02 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[47883ca4-4ac6-4d15-81f1-ca90f39f4f60]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:04:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ab6e15a3-057e-49f7-8e4f-5b925595708b tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-2f1aaa74-fa3f-4116-b481-91bfeb8d2388 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:02 devstack sudo[105521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-2f1aaa74-fa3f-4116-b481-91bfeb8d2388 Nov 06 18:04:02 devstack sudo[105521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:02 devstack sudo[105513]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-890899f5-e068-4b5d-afad-aa1e6116e8a0 tempest-ProjectReaderTests-1299385716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c41285b9-34df-49fa-be68-4df96c8d243b 1073741824" returned: 0 in 0.555s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-890899f5-e068-4b5d-afad-aa1e6116e8a0 tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c41285b9-34df-49fa-be68-4df96c8d243b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:02 devstack sudo[105523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c41285b9-34df-49fa-be68-4df96c8d243b Nov 06 18:04:02 devstack sudo[105523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:02 devstack sudo[105521]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ab6e15a3-057e-49f7-8e4f-5b925595708b tempest-ProjectMemberTests-819176810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-2f1aaa74-fa3f-4116-b481-91bfeb8d2388" returned: 0 in 0.434s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ab6e15a3-057e-49f7-8e4f-5b925595708b tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-2f1aaa74-fa3f-4116-b481-91bfeb8d2388.dc7ddc40-743b-4b50-b08f-e065ebff8d16 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:02 devstack sudo[105529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-2f1aaa74-fa3f-4116-b481-91bfeb8d2388.dc7ddc40-743b-4b50-b08f-e065ebff8d16 Nov 06 18:04:02 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:02 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-14e80bd9-e656-442a-b4b4-2949abc561c0 tempest-ProjectReaderTests-504795444 None] Acquiring lock "cinder-0a542ee7-4909-46e6-8c1b-3277d1c621bc-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:03 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-14e80bd9-e656-442a-b4b4-2949abc561c0 tempest-ProjectReaderTests-504795444 None] Lock "cinder-0a542ee7-4909-46e6-8c1b-3277d1c621bc-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:03 devstack sudo[105523]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-890899f5-e068-4b5d-afad-aa1e6116e8a0 tempest-ProjectReaderTests-1299385716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c41285b9-34df-49fa-be68-4df96c8d243b" returned: 0 in 0.361s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:03 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-890899f5-e068-4b5d-afad-aa1e6116e8a0 tempest-ProjectReaderTests-1299385716 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:04:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-890899f5-e068-4b5d-afad-aa1e6116e8a0 tempest-ProjectReaderTests-1299385716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-890899f5-e068-4b5d-afad-aa1e6116e8a0 tempest-ProjectReaderTests-1299385716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (967bb654-f16f-4316-bd54-3aa92cf3afbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c41285b9-34df-49fa-be68-4df96c8d243b', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-890899f5-e068-4b5d-afad-aa1e6116e8a0 tempest-ProjectReaderTests-1299385716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0783e0c2-409a-4451-b59b-d67a21374d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:03 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-14e80bd9-e656-442a-b4b4-2949abc561c0 tempest-ProjectReaderTests-504795444 None] Acquiring lock "cinder-quobyte-0a542ee7-4909-46e6-8c1b-3277d1c621bc" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:03 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-890899f5-e068-4b5d-afad-aa1e6116e8a0 tempest-ProjectReaderTests-1299385716 None] Volume volume-c41285b9-34df-49fa-be68-4df96c8d243b (c41285b9-34df-49fa-be68-4df96c8d243b): created successfully Nov 06 18:04:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-890899f5-e068-4b5d-afad-aa1e6116e8a0 tempest-ProjectReaderTests-1299385716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0783e0c2-409a-4451-b59b-d67a21374d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-890899f5-e068-4b5d-afad-aa1e6116e8a0 tempest-ProjectReaderTests-1299385716 None] Flow 'volume_create_manager' (137f3431-69ff-4c43-adc5-191bea37a966) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:04:03 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-14e80bd9-e656-442a-b4b4-2949abc561c0 tempest-ProjectReaderTests-504795444 None] Lock "cinder-quobyte-0a542ee7-4909-46e6-8c1b-3277d1c621bc" acquired by "delete_volume" :: waited 0.036s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:03 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-890899f5-e068-4b5d-afad-aa1e6116e8a0 tempest-ProjectReaderTests-1299385716 None] Created volume successfully. Nov 06 18:04:03 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[492add3a-09a8-4ba6-b72f-6e4e64985f7d]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:04:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-14e80bd9-e656-442a-b4b4-2949abc561c0 tempest-ProjectReaderTests-504795444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-0a542ee7-4909-46e6-8c1b-3277d1c621bc {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:03 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ab6e15a3-057e-49f7-8e4f-5b925595708b tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-2f1aaa74-fa3f-4116-b481-91bfeb8d2388.dc7ddc40-743b-4b50-b08f-e065ebff8d16" returned: 0 in 0.449s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ab6e15a3-057e-49f7-8e4f-5b925595708b tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-2f1aaa74-fa3f-4116-b481-91bfeb8d2388.dc7ddc40-743b-4b50-b08f-e065ebff8d16 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:03 devstack sudo[105535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-0a542ee7-4909-46e6-8c1b-3277d1c621bc Nov 06 18:04:03 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:03 devstack sudo[105536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-2f1aaa74-fa3f-4116-b481-91bfeb8d2388.dc7ddc40-743b-4b50-b08f-e065ebff8d16 Nov 06 18:04:03 devstack sudo[105536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:03 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d9eda90-4b94-44c2-956c-fbb3cd2c1620 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:04:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8d9eda90-4b94-44c2-956c-fbb3cd2c1620 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Flow 'volume_create_manager' (c9b8ccaa-26d5-4d4c-bc43-19dd748fc265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:04:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8d9eda90-4b94-44c2-956c-fbb3cd2c1620 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd443b3d-1c01-40c3-9478-7656d48fb84d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8d9eda90-4b94-44c2-956c-fbb3cd2c1620 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd443b3d-1c01-40c3-9478-7656d48fb84d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-907735035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=257ead5d-838e-4942-8c6a-e9ff20960469,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89b2ee431c0f4e1f890ab2d1a7038ca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:04:03Z,use_quota=True,user_id='d7b3d28dc823442c955947e48d35a71f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8d9eda90-4b94-44c2-956c-fbb3cd2c1620 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9349864-9adb-47e5-9eda-d30dd4df67b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8d9eda90-4b94-44c2-956c-fbb3cd2c1620 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9349864-9adb-47e5-9eda-d30dd4df67b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8d9eda90-4b94-44c2-956c-fbb3cd2c1620 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f771822f-25f4-4147-9470-cf1494a9279e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8d9eda90-4b94-44c2-956c-fbb3cd2c1620 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f771822f-25f4-4147-9470-cf1494a9279e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '257ead5d-838e-4942-8c6a-e9ff20960469', 'volume_name': 'volume-257ead5d-838e-4942-8c6a-e9ff20960469', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8d9eda90-4b94-44c2-956c-fbb3cd2c1620 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f541bf10-c916-4253-91c5-ee0a7340d8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8d9eda90-4b94-44c2-956c-fbb3cd2c1620 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f541bf10-c916-4253-91c5-ee0a7340d8ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8d9eda90-4b94-44c2-956c-fbb3cd2c1620 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aca76d3-6fcc-46f6-9662-45c9bd3be83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:03 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-8d9eda90-4b94-44c2-956c-fbb3cd2c1620 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Volume 257ead5d-838e-4942-8c6a-e9ff20960469: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-257ead5d-838e-4942-8c6a-e9ff20960469', 'volume_size': 1} Nov 06 18:04:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8d9eda90-4b94-44c2-956c-fbb3cd2c1620 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8d9eda90-4b94-44c2-956c-fbb3cd2c1620 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:03 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8d9eda90-4b94-44c2-956c-fbb3cd2c1620 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-907735035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=257ead5d-838e-4942-8c6a-e9ff20960469,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89b2ee431c0f4e1f890ab2d1a7038ca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:04:03Z,use_quota=True,user_id='d7b3d28dc823442c955947e48d35a71f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:04:03 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-8d9eda90-4b94-44c2-956c-fbb3cd2c1620 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Creating volume 257ead5d-838e-4942-8c6a-e9ff20960469 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:04:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8d9eda90-4b94-44c2-956c-fbb3cd2c1620 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8d9eda90-4b94-44c2-956c-fbb3cd2c1620 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:03 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8d9eda90-4b94-44c2-956c-fbb3cd2c1620 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:04:03 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8d9eda90-4b94-44c2-956c-fbb3cd2c1620 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:04:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8d9eda90-4b94-44c2-956c-fbb3cd2c1620 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:03 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8d9eda90-4b94-44c2-956c-fbb3cd2c1620 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:04:03 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-8d9eda90-4b94-44c2-956c-fbb3cd2c1620 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:04:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8d9eda90-4b94-44c2-956c-fbb3cd2c1620 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-257ead5d-838e-4942-8c6a-e9ff20960469 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:03 devstack sudo[105536]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ab6e15a3-057e-49f7-8e4f-5b925595708b tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-2f1aaa74-fa3f-4116-b481-91bfeb8d2388.dc7ddc40-743b-4b50-b08f-e065ebff8d16" returned: 0 in 0.283s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:03 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:03 devstack sudo[105543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-257ead5d-838e-4942-8c6a-e9ff20960469 1073741824 Nov 06 18:04:03 devstack sudo[105543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-14e80bd9-e656-442a-b4b4-2949abc561c0 tempest-ProjectReaderTests-504795444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-0a542ee7-4909-46e6-8c1b-3277d1c621bc" returned: 0 in 0.426s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-14e80bd9-e656-442a-b4b4-2949abc561c0 tempest-ProjectReaderTests-504795444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-0a542ee7-4909-46e6-8c1b-3277d1c621bc {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:03 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ab6e15a3-057e-49f7-8e4f-5b925595708b tempest-ProjectMemberTests-819176810 None] Lock "cinder-quobyte-dc7ddc40-743b-4b50-b08f-e065ebff8d16" released by "_delete_snapshot" :: held 1.733s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:03 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ab6e15a3-057e-49f7-8e4f-5b925595708b tempest-ProjectMemberTests-819176810 None] Lock "cinder-quobyte-2f1aaa74-fa3f-4116-b481-91bfeb8d2388" released by "delete_snapshot" :: held 1.761s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:03 devstack sudo[105545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-0a542ee7-4909-46e6-8c1b-3277d1c621bc Nov 06 18:04:03 devstack sudo[105545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:03 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-ab6e15a3-057e-49f7-8e4f-5b925595708b tempest-ProjectMemberTests-819176810 None] Created reservations ['f2135c9b-8a57-43b7-b493-75b9cfc1d31e', 'd500776f-9e91-41bc-a0fd-7c8d995c4f7a', '5f7b5403-e23d-4392-8ad4-e0572fcb77b8', '2d6eb0a2-5193-4752-a1f8-8a856717df15'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:04:03 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-ab6e15a3-057e-49f7-8e4f-5b925595708b tempest-ProjectMemberTests-819176810 None] Delete snapshot completed successfully. Nov 06 18:04:03 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ab6e15a3-057e-49f7-8e4f-5b925595708b tempest-ProjectMemberTests-819176810 None] Lock "cinder-dc7ddc40-743b-4b50-b08f-e065ebff8d16-delete_snapshot" released by "delete_snapshot" :: held 1.906s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:03 devstack sudo[105545]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-14e80bd9-e656-442a-b4b4-2949abc561c0 tempest-ProjectReaderTests-504795444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-0a542ee7-4909-46e6-8c1b-3277d1c621bc" returned: 0 in 0.255s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:03 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-14e80bd9-e656-442a-b4b4-2949abc561c0 tempest-ProjectReaderTests-504795444 None] Lock "cinder-quobyte-0a542ee7-4909-46e6-8c1b-3277d1c621bc" released by "delete_volume" :: held 0.730s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:03 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-14e80bd9-e656-442a-b4b4-2949abc561c0 tempest-ProjectReaderTests-504795444 None] Created reservations ['98c981b8-9f25-4f87-83f8-152295dd96f2', '5be896cf-4ab6-403a-8511-93e7cf507466', 'b5f23ad1-0002-4898-95f3-09af65f36590', '237f7f75-1a7e-41e0-b7a6-36adcd37e078'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:04:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-14e80bd9-e656-442a-b4b4-2949abc561c0 tempest-ProjectReaderTests-504795444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-14e80bd9-e656-442a-b4b4-2949abc561c0 tempest-ProjectReaderTests-504795444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:04 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-14e80bd9-e656-442a-b4b4-2949abc561c0 tempest-ProjectReaderTests-504795444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:04:04 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-14e80bd9-e656-442a-b4b4-2949abc561c0 tempest-ProjectReaderTests-504795444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:04:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-14e80bd9-e656-442a-b4b4-2949abc561c0 tempest-ProjectReaderTests-504795444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-14e80bd9-e656-442a-b4b4-2949abc561c0 tempest-ProjectReaderTests-504795444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:04 devstack sudo[105552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:04:04 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:04 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6f219a44-1d35-45cd-a933-c07ad16ae827 tempest-ProjectMemberTests-819176810 None] Acquiring lock "cinder-2f1aaa74-fa3f-4116-b481-91bfeb8d2388-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:04 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6f219a44-1d35-45cd-a933-c07ad16ae827 tempest-ProjectMemberTests-819176810 None] Lock "cinder-2f1aaa74-fa3f-4116-b481-91bfeb8d2388-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:04 devstack sudo[105543]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8d9eda90-4b94-44c2-956c-fbb3cd2c1620 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-257ead5d-838e-4942-8c6a-e9ff20960469 1073741824" returned: 0 in 0.540s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8d9eda90-4b94-44c2-956c-fbb3cd2c1620 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-257ead5d-838e-4942-8c6a-e9ff20960469 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:04 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6f219a44-1d35-45cd-a933-c07ad16ae827 tempest-ProjectMemberTests-819176810 None] Acquiring lock "cinder-quobyte-2f1aaa74-fa3f-4116-b481-91bfeb8d2388" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:04 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6f219a44-1d35-45cd-a933-c07ad16ae827 tempest-ProjectMemberTests-819176810 None] Lock "cinder-quobyte-2f1aaa74-fa3f-4116-b481-91bfeb8d2388" acquired by "delete_volume" :: waited 0.022s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:04 devstack sudo[105554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-257ead5d-838e-4942-8c6a-e9ff20960469 Nov 06 18:04:04 devstack sudo[105554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:04 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b821bc83-ac5e-457b-96c9-6957bec1f70d]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:04:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6f219a44-1d35-45cd-a933-c07ad16ae827 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-2f1aaa74-fa3f-4116-b481-91bfeb8d2388 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ace12ad8-a706-417f-b033-3be5e4db50c1 tempest-ProjectReaderTests-1299385716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:04 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-14e80bd9-e656-442a-b4b4-2949abc561c0 tempest-ProjectReaderTests-504795444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.404s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:04 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-14e80bd9-e656-442a-b4b4-2949abc561c0 tempest-ProjectReaderTests-504795444 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:04:04 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-14e80bd9-e656-442a-b4b4-2949abc561c0 tempest-ProjectReaderTests-504795444 None] Deleted volume successfully. Nov 06 18:04:04 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-14e80bd9-e656-442a-b4b4-2949abc561c0 tempest-ProjectReaderTests-504795444 None] Lock "cinder-0a542ee7-4909-46e6-8c1b-3277d1c621bc-delete_volume" released by "delete_volume" :: held 1.448s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:04 devstack sudo[105556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-2f1aaa74-fa3f-4116-b481-91bfeb8d2388 Nov 06 18:04:04 devstack sudo[105556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:04 devstack sudo[105554]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8d9eda90-4b94-44c2-956c-fbb3cd2c1620 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-257ead5d-838e-4942-8c6a-e9ff20960469" returned: 0 in 0.384s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:04 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8d9eda90-4b94-44c2-956c-fbb3cd2c1620 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:04:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8d9eda90-4b94-44c2-956c-fbb3cd2c1620 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ace12ad8-a706-417f-b033-3be5e4db50c1 tempest-ProjectReaderTests-1299385716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.176s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8d9eda90-4b94-44c2-956c-fbb3cd2c1620 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aca76d3-6fcc-46f6-9662-45c9bd3be83c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-257ead5d-838e-4942-8c6a-e9ff20960469', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8d9eda90-4b94-44c2-956c-fbb3cd2c1620 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (517d4f95-ca86-4a67-b4e5-4f398152b629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:04 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-ace12ad8-a706-417f-b033-3be5e4db50c1 tempest-ProjectReaderTests-1299385716 None] Creating offline snapshot b5f88402-ca0f-45e9-9652-b5fff5ebe6ba of volume c41285b9-34df-49fa-be68-4df96c8d243b {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:04:04 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-8d9eda90-4b94-44c2-956c-fbb3cd2c1620 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Volume volume-257ead5d-838e-4942-8c6a-e9ff20960469 (257ead5d-838e-4942-8c6a-e9ff20960469): created successfully Nov 06 18:04:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8d9eda90-4b94-44c2-956c-fbb3cd2c1620 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (517d4f95-ca86-4a67-b4e5-4f398152b629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8d9eda90-4b94-44c2-956c-fbb3cd2c1620 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Flow 'volume_create_manager' (c9b8ccaa-26d5-4d4c-bc43-19dd748fc265) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:04:04 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[3846e49d-8067-439a-85e9-aff27b9646be]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:04:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ace12ad8-a706-417f-b033-3be5e4db50c1 tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c41285b9-34df-49fa-be68-4df96c8d243b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:04 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-8d9eda90-4b94-44c2-956c-fbb3cd2c1620 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Created volume successfully. Nov 06 18:04:04 devstack sudo[105560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c41285b9-34df-49fa-be68-4df96c8d243b Nov 06 18:04:04 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:04 devstack sudo[105556]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6f219a44-1d35-45cd-a933-c07ad16ae827 tempest-ProjectMemberTests-819176810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-2f1aaa74-fa3f-4116-b481-91bfeb8d2388" returned: 0 in 0.542s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6f219a44-1d35-45cd-a933-c07ad16ae827 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-2f1aaa74-fa3f-4116-b481-91bfeb8d2388 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:04 devstack sudo[105565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-2f1aaa74-fa3f-4116-b481-91bfeb8d2388 Nov 06 18:04:04 devstack sudo[105565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:04 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-8baacb04-0338-4c83-8acb-462c0928b958 tempest-ProjectReaderTests-504795444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:04:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8baacb04-0338-4c83-8acb-462c0928b958 tempest-ProjectReaderTests-504795444 None] Flow 'volume_create_manager' (3a258634-466a-46bc-8f6f-a28b413fbdca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:04:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8baacb04-0338-4c83-8acb-462c0928b958 tempest-ProjectReaderTests-504795444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c7d9ea1-b6b6-4fa0-a88d-9698d77628a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8baacb04-0338-4c83-8acb-462c0928b958 tempest-ProjectReaderTests-504795444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c7d9ea1-b6b6-4fa0-a88d-9698d77628a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-818860013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=046ae3ce-ef2d-40a6-8f26-8259a6ec46f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8af9d84684994850b6a6f75b1dd41e07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:04:05Z,use_quota=True,user_id='ffdaa10b1a234e0ea970e1538ea3c29b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8baacb04-0338-4c83-8acb-462c0928b958 tempest-ProjectReaderTests-504795444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c57ff4e2-185f-4cdb-919d-4b8e4cc97d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8baacb04-0338-4c83-8acb-462c0928b958 tempest-ProjectReaderTests-504795444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c57ff4e2-185f-4cdb-919d-4b8e4cc97d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8baacb04-0338-4c83-8acb-462c0928b958 tempest-ProjectReaderTests-504795444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec060a33-f210-45ec-9c60-74ea14861d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8baacb04-0338-4c83-8acb-462c0928b958 tempest-ProjectReaderTests-504795444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec060a33-f210-45ec-9c60-74ea14861d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '046ae3ce-ef2d-40a6-8f26-8259a6ec46f6', 'volume_name': 'volume-046ae3ce-ef2d-40a6-8f26-8259a6ec46f6', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8baacb04-0338-4c83-8acb-462c0928b958 tempest-ProjectReaderTests-504795444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e198a194-d592-4b13-aec7-d4ed7d0b6184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8baacb04-0338-4c83-8acb-462c0928b958 tempest-ProjectReaderTests-504795444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e198a194-d592-4b13-aec7-d4ed7d0b6184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8baacb04-0338-4c83-8acb-462c0928b958 tempest-ProjectReaderTests-504795444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f0d9b75-f466-4478-ab3e-ec61bf69bec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:05 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-8baacb04-0338-4c83-8acb-462c0928b958 tempest-ProjectReaderTests-504795444 None] Volume 046ae3ce-ef2d-40a6-8f26-8259a6ec46f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-046ae3ce-ef2d-40a6-8f26-8259a6ec46f6', 'volume_size': 1} Nov 06 18:04:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8baacb04-0338-4c83-8acb-462c0928b958 tempest-ProjectReaderTests-504795444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:05 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ace12ad8-a706-417f-b033-3be5e4db50c1 tempest-ProjectReaderTests-1299385716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c41285b9-34df-49fa-be68-4df96c8d243b" returned: 0 in 0.432s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ace12ad8-a706-417f-b033-3be5e4db50c1 tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c41285b9-34df-49fa-be68-4df96c8d243b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c41285b9-34df-49fa-be68-4df96c8d243b.b5f88402-ca0f-45e9-9652-b5fff5ebe6ba 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:05 devstack sudo[105571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c41285b9-34df-49fa-be68-4df96c8d243b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c41285b9-34df-49fa-be68-4df96c8d243b.b5f88402-ca0f-45e9-9652-b5fff5ebe6ba 1G Nov 06 18:04:05 devstack sudo[105571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:05 devstack sudo[105565]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6f219a44-1d35-45cd-a933-c07ad16ae827 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-2f1aaa74-fa3f-4116-b481-91bfeb8d2388" returned: 0 in 0.292s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:05 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6f219a44-1d35-45cd-a933-c07ad16ae827 tempest-ProjectMemberTests-819176810 None] Lock "cinder-quobyte-2f1aaa74-fa3f-4116-b481-91bfeb8d2388" released by "delete_volume" :: held 0.945s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:05 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-6f219a44-1d35-45cd-a933-c07ad16ae827 tempest-ProjectMemberTests-819176810 None] Created reservations ['8b318afb-93b5-4160-8855-14a56c8d367f', 'f292f7b8-9b7b-40ac-a832-eb46d2b3e48c', '1cea8add-3c25-406a-9358-959f72ef7eda', '2974396b-4b93-4765-b544-c3be64d2aff4'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:04:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6f219a44-1d35-45cd-a933-c07ad16ae827 tempest-ProjectMemberTests-819176810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6f219a44-1d35-45cd-a933-c07ad16ae827 tempest-ProjectMemberTests-819176810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:05 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-6f219a44-1d35-45cd-a933-c07ad16ae827 tempest-ProjectMemberTests-819176810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:04:05 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-6f219a44-1d35-45cd-a933-c07ad16ae827 tempest-ProjectMemberTests-819176810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:04:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6f219a44-1d35-45cd-a933-c07ad16ae827 tempest-ProjectMemberTests-819176810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6f219a44-1d35-45cd-a933-c07ad16ae827 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:05 devstack sudo[105574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:04:05 devstack sudo[105574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:05 devstack sudo[105571]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ace12ad8-a706-417f-b033-3be5e4db50c1 tempest-ProjectReaderTests-1299385716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c41285b9-34df-49fa-be68-4df96c8d243b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c41285b9-34df-49fa-be68-4df96c8d243b.b5f88402-ca0f-45e9-9652-b5fff5ebe6ba 1G" returned: 0 in 0.479s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ace12ad8-a706-417f-b033-3be5e4db50c1 tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c41285b9-34df-49fa-be68-4df96c8d243b -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c41285b9-34df-49fa-be68-4df96c8d243b.b5f88402-ca0f-45e9-9652-b5fff5ebe6ba {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:05 devstack sudo[105574]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6f219a44-1d35-45cd-a933-c07ad16ae827 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.279s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:05 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-6f219a44-1d35-45cd-a933-c07ad16ae827 tempest-ProjectMemberTests-819176810 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:04:05 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-6f219a44-1d35-45cd-a933-c07ad16ae827 tempest-ProjectMemberTests-819176810 None] Deleted volume successfully. Nov 06 18:04:05 devstack sudo[105580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c41285b9-34df-49fa-be68-4df96c8d243b -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c41285b9-34df-49fa-be68-4df96c8d243b.b5f88402-ca0f-45e9-9652-b5fff5ebe6ba Nov 06 18:04:05 devstack sudo[105580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:05 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6f219a44-1d35-45cd-a933-c07ad16ae827 tempest-ProjectMemberTests-819176810 None] Lock "cinder-2f1aaa74-fa3f-4116-b481-91bfeb8d2388-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:05 devstack sudo[105580]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ace12ad8-a706-417f-b033-3be5e4db50c1 tempest-ProjectReaderTests-1299385716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c41285b9-34df-49fa-be68-4df96c8d243b -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c41285b9-34df-49fa-be68-4df96c8d243b.b5f88402-ca0f-45e9-9652-b5fff5ebe6ba" returned: 0 in 0.364s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:05 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-ace12ad8-a706-417f-b033-3be5e4db50c1 tempest-ProjectReaderTests-1299385716 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c41285b9-34df-49fa-be68-4df96c8d243b.b5f88402-ca0f-45e9-9652-b5fff5ebe6ba is being set with open permissions: ugo+rw Nov 06 18:04:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ace12ad8-a706-417f-b033-3be5e4db50c1 tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c41285b9-34df-49fa-be68-4df96c8d243b.b5f88402-ca0f-45e9-9652-b5fff5ebe6ba {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:05 devstack sudo[105585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c41285b9-34df-49fa-be68-4df96c8d243b.b5f88402-ca0f-45e9-9652-b5fff5ebe6ba Nov 06 18:04:05 devstack sudo[105585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:06 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=229,cinder:UPDATE=281,cinder:DELETE=19,cinder:INSERT=89 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:04:06 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=217,cinder:UPDATE=301,cinder:INSERT=72,cinder:DELETE=32 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:04:06 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f4ad6b8-9e9a-47ff-a878-f93ef97fb805 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:04:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9f4ad6b8-9e9a-47ff-a878-f93ef97fb805 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Flow 'volume_create_manager' (11ff65f4-070a-4c7b-8efb-3771ed4667ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:04:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9f4ad6b8-9e9a-47ff-a878-f93ef97fb805 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6fedf14-c858-4269-a052-b85fea4ad586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9f4ad6b8-9e9a-47ff-a878-f93ef97fb805 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6fedf14-c858-4269-a052-b85fea4ad586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1454686918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=372b17fe-5474-4d98-b16d-77631ab03d9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89b2ee431c0f4e1f890ab2d1a7038ca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:04:06Z,use_quota=True,user_id='d7b3d28dc823442c955947e48d35a71f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9f4ad6b8-9e9a-47ff-a878-f93ef97fb805 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c946379d-d48f-41ef-b417-9bdc04a6be45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9f4ad6b8-9e9a-47ff-a878-f93ef97fb805 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c946379d-d48f-41ef-b417-9bdc04a6be45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9f4ad6b8-9e9a-47ff-a878-f93ef97fb805 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd7ab268-7edb-43bb-b702-69671859a55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9f4ad6b8-9e9a-47ff-a878-f93ef97fb805 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd7ab268-7edb-43bb-b702-69671859a55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '372b17fe-5474-4d98-b16d-77631ab03d9c', 'volume_name': 'volume-372b17fe-5474-4d98-b16d-77631ab03d9c', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9f4ad6b8-9e9a-47ff-a878-f93ef97fb805 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3ef7b39-9b6c-4a31-93c7-db2d40f591c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9f4ad6b8-9e9a-47ff-a878-f93ef97fb805 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3ef7b39-9b6c-4a31-93c7-db2d40f591c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9f4ad6b8-9e9a-47ff-a878-f93ef97fb805 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5130275-2146-46e3-93c4-2b3e33cdbef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:06 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-9f4ad6b8-9e9a-47ff-a878-f93ef97fb805 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Volume 372b17fe-5474-4d98-b16d-77631ab03d9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-372b17fe-5474-4d98-b16d-77631ab03d9c', 'volume_size': 1} Nov 06 18:04:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9f4ad6b8-9e9a-47ff-a878-f93ef97fb805 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:06 devstack sudo[105585]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ace12ad8-a706-417f-b033-3be5e4db50c1 tempest-ProjectReaderTests-1299385716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c41285b9-34df-49fa-be68-4df96c8d243b.b5f88402-ca0f-45e9-9652-b5fff5ebe6ba" returned: 0 in 0.461s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ace12ad8-a706-417f-b033-3be5e4db50c1 tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c41285b9-34df-49fa-be68-4df96c8d243b.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:06 devstack sudo[105589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c41285b9-34df-49fa-be68-4df96c8d243b.info Nov 06 18:04:06 devstack sudo[105589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:06 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fcd2226-d99f-433b-9de1-a320e1e25185 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:04:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1fcd2226-d99f-433b-9de1-a320e1e25185 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Flow 'volume_create_manager' (d287d7f2-313f-44f0-9993-c235ceb35876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:04:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1fcd2226-d99f-433b-9de1-a320e1e25185 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5339e7f1-a7a9-4638-9eff-ebfa4febc94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1fcd2226-d99f-433b-9de1-a320e1e25185 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5339e7f1-a7a9-4638-9eff-ebfa4febc94d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1337564858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2eea451-9a31-4298-9d88-12c1b446f426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89b2ee431c0f4e1f890ab2d1a7038ca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:04:06Z,use_quota=True,user_id='d7b3d28dc823442c955947e48d35a71f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1fcd2226-d99f-433b-9de1-a320e1e25185 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0518a29-7828-49e8-bd0f-7cb728745796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1fcd2226-d99f-433b-9de1-a320e1e25185 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0518a29-7828-49e8-bd0f-7cb728745796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1fcd2226-d99f-433b-9de1-a320e1e25185 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4326e02-a960-450a-9bda-0fed2970203d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1fcd2226-d99f-433b-9de1-a320e1e25185 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4326e02-a960-450a-9bda-0fed2970203d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2eea451-9a31-4298-9d88-12c1b446f426', 'volume_name': 'volume-b2eea451-9a31-4298-9d88-12c1b446f426', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1fcd2226-d99f-433b-9de1-a320e1e25185 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (643c43d6-cb96-47eb-948e-fdc1f0d93acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1fcd2226-d99f-433b-9de1-a320e1e25185 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (643c43d6-cb96-47eb-948e-fdc1f0d93acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1fcd2226-d99f-433b-9de1-a320e1e25185 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0604bd2b-b220-4751-999a-423b6a617d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:06 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-1fcd2226-d99f-433b-9de1-a320e1e25185 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Volume b2eea451-9a31-4298-9d88-12c1b446f426: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2eea451-9a31-4298-9d88-12c1b446f426', 'volume_size': 1} Nov 06 18:04:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1fcd2226-d99f-433b-9de1-a320e1e25185 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:06 devstack sudo[105589]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ace12ad8-a706-417f-b033-3be5e4db50c1 tempest-ProjectReaderTests-1299385716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c41285b9-34df-49fa-be68-4df96c8d243b.info" returned: 0 in 0.343s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:06 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-ace12ad8-a706-417f-b033-3be5e4db50c1 tempest-ProjectReaderTests-1299385716 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c41285b9-34df-49fa-be68-4df96c8d243b.info is being set with open permissions: ugo+rw Nov 06 18:04:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ace12ad8-a706-417f-b033-3be5e4db50c1 tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c41285b9-34df-49fa-be68-4df96c8d243b.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:06 devstack sudo[105592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c41285b9-34df-49fa-be68-4df96c8d243b.info Nov 06 18:04:06 devstack sudo[105592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:07 devstack sudo[105592]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ace12ad8-a706-417f-b033-3be5e4db50c1 tempest-ProjectReaderTests-1299385716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c41285b9-34df-49fa-be68-4df96c8d243b.info" returned: 0 in 0.335s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ace12ad8-a706-417f-b033-3be5e4db50c1 tempest-ProjectReaderTests-1299385716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.566s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8baacb04-0338-4c83-8acb-462c0928b958 tempest-ProjectReaderTests-504795444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.112s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8baacb04-0338-4c83-8acb-462c0928b958 tempest-ProjectReaderTests-504795444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-818860013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=046ae3ce-ef2d-40a6-8f26-8259a6ec46f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8af9d84684994850b6a6f75b1dd41e07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:04:05Z,use_quota=True,user_id='ffdaa10b1a234e0ea970e1538ea3c29b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-8baacb04-0338-4c83-8acb-462c0928b958 tempest-ProjectReaderTests-504795444 None] Creating volume 046ae3ce-ef2d-40a6-8f26-8259a6ec46f6 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8baacb04-0338-4c83-8acb-462c0928b958 tempest-ProjectReaderTests-504795444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8baacb04-0338-4c83-8acb-462c0928b958 tempest-ProjectReaderTests-504795444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8baacb04-0338-4c83-8acb-462c0928b958 tempest-ProjectReaderTests-504795444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8baacb04-0338-4c83-8acb-462c0928b958 tempest-ProjectReaderTests-504795444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8baacb04-0338-4c83-8acb-462c0928b958 tempest-ProjectReaderTests-504795444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8baacb04-0338-4c83-8acb-462c0928b958 tempest-ProjectReaderTests-504795444 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:04:07 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-8baacb04-0338-4c83-8acb-462c0928b958 tempest-ProjectReaderTests-504795444 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8baacb04-0338-4c83-8acb-462c0928b958 tempest-ProjectReaderTests-504795444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-046ae3ce-ef2d-40a6-8f26-8259a6ec46f6 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:07 devstack sudo[105595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-046ae3ce-ef2d-40a6-8f26-8259a6ec46f6 1073741824 Nov 06 18:04:07 devstack sudo[105595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:07 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-ace12ad8-a706-417f-b033-3be5e4db50c1 tempest-ProjectReaderTests-1299385716 None] Create snapshot completed successfully Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-01bf01ce-74a5-4a27-ba93-8b8a7f380a6e tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-01bf01ce-74a5-4a27-ba93-8b8a7f380a6e tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Flow 'volume_create_manager' (684d4adf-165a-4095-a1cd-6871e4a44d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-01bf01ce-74a5-4a27-ba93-8b8a7f380a6e tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (517a4291-c1a6-4a9f-8f0d-10539fe99d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-01bf01ce-74a5-4a27-ba93-8b8a7f380a6e tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (517a4291-c1a6-4a9f-8f0d-10539fe99d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:04:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-651604924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44b4d981-f8d4-4943-af44-ace1269d12e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89b2ee431c0f4e1f890ab2d1a7038ca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:04:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:04:07Z,use_quota=True,user_id='d7b3d28dc823442c955947e48d35a71f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-01bf01ce-74a5-4a27-ba93-8b8a7f380a6e tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3b56b79-4136-4f67-b88c-5f0f95713a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-01bf01ce-74a5-4a27-ba93-8b8a7f380a6e tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3b56b79-4136-4f67-b88c-5f0f95713a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-01bf01ce-74a5-4a27-ba93-8b8a7f380a6e tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (618116ba-44b0-43d9-b226-9226d300e9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-01bf01ce-74a5-4a27-ba93-8b8a7f380a6e tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (618116ba-44b0-43d9-b226-9226d300e9d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44b4d981-f8d4-4943-af44-ace1269d12e2', 'volume_name': 'volume-44b4d981-f8d4-4943-af44-ace1269d12e2', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-01bf01ce-74a5-4a27-ba93-8b8a7f380a6e tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e3fe093-b121-492c-aa7b-87f8c7188a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-01bf01ce-74a5-4a27-ba93-8b8a7f380a6e tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e3fe093-b121-492c-aa7b-87f8c7188a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-01bf01ce-74a5-4a27-ba93-8b8a7f380a6e tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e03a31e-99fc-4114-8420-169748be8c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:07 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-01bf01ce-74a5-4a27-ba93-8b8a7f380a6e tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Volume 44b4d981-f8d4-4943-af44-ace1269d12e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44b4d981-f8d4-4943-af44-ace1269d12e2', 'volume_size': 1} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-01bf01ce-74a5-4a27-ba93-8b8a7f380a6e tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdf22902-3c6c-47da-9663-7b781d18c126 tempest-ProjectMemberTests-819176810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fdf22902-3c6c-47da-9663-7b781d18c126 tempest-ProjectMemberTests-819176810 None] Flow 'volume_create_manager' (b1f4208c-4c9d-4f87-9513-5d249c551463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fdf22902-3c6c-47da-9663-7b781d18c126 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4273d2a8-5aa8-45dc-b91e-eb74bab8c760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fdf22902-3c6c-47da-9663-7b781d18c126 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4273d2a8-5aa8-45dc-b91e-eb74bab8c760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:04:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1747832789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a16ec3f3-15f5-48fa-98dc-3e224221b69f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b97cd7ef94764995a9e8c62cda23171f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:04:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:04:07Z,use_quota=True,user_id='a34e6465a98c4c289547d49a900a6bde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fdf22902-3c6c-47da-9663-7b781d18c126 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b52719c-434a-4c2d-9bc9-b0e18c233b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fdf22902-3c6c-47da-9663-7b781d18c126 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b52719c-434a-4c2d-9bc9-b0e18c233b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fdf22902-3c6c-47da-9663-7b781d18c126 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e63429b0-c1b1-4540-8cf2-352832b7a086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fdf22902-3c6c-47da-9663-7b781d18c126 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e63429b0-c1b1-4540-8cf2-352832b7a086) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a16ec3f3-15f5-48fa-98dc-3e224221b69f', 'volume_name': 'volume-a16ec3f3-15f5-48fa-98dc-3e224221b69f', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fdf22902-3c6c-47da-9663-7b781d18c126 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d74e1886-f3b4-4669-b798-1d90015be840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fdf22902-3c6c-47da-9663-7b781d18c126 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d74e1886-f3b4-4669-b798-1d90015be840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fdf22902-3c6c-47da-9663-7b781d18c126 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e229ca5-7937-4175-8a0b-63dec62fb98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:07 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-fdf22902-3c6c-47da-9663-7b781d18c126 tempest-ProjectMemberTests-819176810 None] Volume a16ec3f3-15f5-48fa-98dc-3e224221b69f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a16ec3f3-15f5-48fa-98dc-3e224221b69f', 'volume_size': 1} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fdf22902-3c6c-47da-9663-7b781d18c126 tempest-ProjectMemberTests-819176810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-432b4b41-0a16-432a-b9c5-9986f7851b24 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-432b4b41-0a16-432a-b9c5-9986f7851b24 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Flow 'volume_create_manager' (7df27417-6bd3-4ade-87b1-d965c601e4b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-432b4b41-0a16-432a-b9c5-9986f7851b24 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3754116a-b277-4b16-b3a1-4c8db2fadb39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-432b4b41-0a16-432a-b9c5-9986f7851b24 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3754116a-b277-4b16-b3a1-4c8db2fadb39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:04:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-695719324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d8315c7-b78d-4369-90e9-7121fac7cbdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89b2ee431c0f4e1f890ab2d1a7038ca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:04:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:04:08Z,use_quota=True,user_id='d7b3d28dc823442c955947e48d35a71f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-432b4b41-0a16-432a-b9c5-9986f7851b24 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49ceb5c7-443a-4f50-9a29-52e1afd3e7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-432b4b41-0a16-432a-b9c5-9986f7851b24 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49ceb5c7-443a-4f50-9a29-52e1afd3e7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-432b4b41-0a16-432a-b9c5-9986f7851b24 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a21c4592-eca6-44bd-933f-654869eb39ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-432b4b41-0a16-432a-b9c5-9986f7851b24 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a21c4592-eca6-44bd-933f-654869eb39ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d8315c7-b78d-4369-90e9-7121fac7cbdd', 'volume_name': 'volume-6d8315c7-b78d-4369-90e9-7121fac7cbdd', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-432b4b41-0a16-432a-b9c5-9986f7851b24 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7d66e33-9f79-40aa-8ab6-f44da7617005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-432b4b41-0a16-432a-b9c5-9986f7851b24 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7d66e33-9f79-40aa-8ab6-f44da7617005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-432b4b41-0a16-432a-b9c5-9986f7851b24 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beb440f6-3adc-40d0-b8cb-5e1ea9bbde5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:07 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-432b4b41-0a16-432a-b9c5-9986f7851b24 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Volume 6d8315c7-b78d-4369-90e9-7121fac7cbdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d8315c7-b78d-4369-90e9-7121fac7cbdd', 'volume_size': 1} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-432b4b41-0a16-432a-b9c5-9986f7851b24 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:07 devstack sudo[105595]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8baacb04-0338-4c83-8acb-462c0928b958 tempest-ProjectReaderTests-504795444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-046ae3ce-ef2d-40a6-8f26-8259a6ec46f6 1073741824" returned: 0 in 0.632s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-fede31a2-96a1-453b-b739-8abd0143ea19 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fede31a2-96a1-453b-b739-8abd0143ea19 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Flow 'volume_create_manager' (d4e8bc33-6567-45c6-b7e7-1dd75fdf9205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fede31a2-96a1-453b-b739-8abd0143ea19 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07379427-b673-4ecd-9770-00bf7c578c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fede31a2-96a1-453b-b739-8abd0143ea19 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07379427-b673-4ecd-9770-00bf7c578c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:04:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1246488261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1a73a31-5b7e-4555-a24d-1c43262f60fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89b2ee431c0f4e1f890ab2d1a7038ca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:04:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:04:08Z,use_quota=True,user_id='d7b3d28dc823442c955947e48d35a71f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fede31a2-96a1-453b-b739-8abd0143ea19 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e159fcfd-bab0-4dc2-a39e-fa23393162af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fede31a2-96a1-453b-b739-8abd0143ea19 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e159fcfd-bab0-4dc2-a39e-fa23393162af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fede31a2-96a1-453b-b739-8abd0143ea19 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (818c8397-8aec-4f3b-b763-63b3313a1c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fede31a2-96a1-453b-b739-8abd0143ea19 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (818c8397-8aec-4f3b-b763-63b3313a1c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1a73a31-5b7e-4555-a24d-1c43262f60fc', 'volume_name': 'volume-c1a73a31-5b7e-4555-a24d-1c43262f60fc', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fede31a2-96a1-453b-b739-8abd0143ea19 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6382aded-3000-4491-ac50-a5f9a67e9ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fede31a2-96a1-453b-b739-8abd0143ea19 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6382aded-3000-4491-ac50-a5f9a67e9ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fede31a2-96a1-453b-b739-8abd0143ea19 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb278c65-53f8-4bf4-9e18-6d63b2455775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:07 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-fede31a2-96a1-453b-b739-8abd0143ea19 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Volume c1a73a31-5b7e-4555-a24d-1c43262f60fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1a73a31-5b7e-4555-a24d-1c43262f60fc', 'volume_size': 1} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fede31a2-96a1-453b-b739-8abd0143ea19 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f11b01ea-8ce9-42e1-8368-b5011e3d0f56 tempest-ProjectReaderTests-1299385716 None] Acquiring lock "cinder-b5f88402-ca0f-45e9-9652-b5fff5ebe6ba-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8baacb04-0338-4c83-8acb-462c0928b958 tempest-ProjectReaderTests-504795444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-046ae3ce-ef2d-40a6-8f26-8259a6ec46f6 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f11b01ea-8ce9-42e1-8368-b5011e3d0f56 tempest-ProjectReaderTests-1299385716 None] Lock "cinder-b5f88402-ca0f-45e9-9652-b5fff5ebe6ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f11b01ea-8ce9-42e1-8368-b5011e3d0f56 tempest-ProjectReaderTests-1299385716 None] Acquiring lock "cinder-quobyte-c41285b9-34df-49fa-be68-4df96c8d243b" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:07 devstack sudo[105602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-046ae3ce-ef2d-40a6-8f26-8259a6ec46f6 Nov 06 18:04:07 devstack sudo[105602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f11b01ea-8ce9-42e1-8368-b5011e3d0f56 tempest-ProjectReaderTests-1299385716 None] Lock "cinder-quobyte-c41285b9-34df-49fa-be68-4df96c8d243b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f11b01ea-8ce9-42e1-8368-b5011e3d0f56 tempest-ProjectReaderTests-1299385716 None] Acquiring lock "cinder-quobyte-b5f88402-ca0f-45e9-9652-b5fff5ebe6ba" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:07 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f11b01ea-8ce9-42e1-8368-b5011e3d0f56 tempest-ProjectReaderTests-1299385716 None] Lock "cinder-quobyte-b5f88402-ca0f-45e9-9652-b5fff5ebe6ba" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:08 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-f11b01ea-8ce9-42e1-8368-b5011e3d0f56 tempest-ProjectReaderTests-1299385716 None] Deleting offline snapshot b5f88402-ca0f-45e9-9652-b5fff5ebe6ba of volume c41285b9-34df-49fa-be68-4df96c8d243b {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:04:08 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-f11b01ea-8ce9-42e1-8368-b5011e3d0f56 tempest-ProjectReaderTests-1299385716 None] snapshot_file for this snap is: volume-c41285b9-34df-49fa-be68-4df96c8d243b.b5f88402-ca0f-45e9-9652-b5fff5ebe6ba {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:04:08 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[432b78e3-4320-42de-b20c-b6ddf5d9a4bc]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:04:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f11b01ea-8ce9-42e1-8368-b5011e3d0f56 tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c41285b9-34df-49fa-be68-4df96c8d243b.b5f88402-ca0f-45e9-9652-b5fff5ebe6ba {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:08 devstack sudo[105604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c41285b9-34df-49fa-be68-4df96c8d243b.b5f88402-ca0f-45e9-9652-b5fff5ebe6ba Nov 06 18:04:08 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:08 devstack sudo[105602]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8baacb04-0338-4c83-8acb-462c0928b958 tempest-ProjectReaderTests-504795444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-046ae3ce-ef2d-40a6-8f26-8259a6ec46f6" returned: 0 in 0.275s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:08 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8baacb04-0338-4c83-8acb-462c0928b958 tempest-ProjectReaderTests-504795444 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:04:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8baacb04-0338-4c83-8acb-462c0928b958 tempest-ProjectReaderTests-504795444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9f4ad6b8-9e9a-47ff-a878-f93ef97fb805 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.024s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:08 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9f4ad6b8-9e9a-47ff-a878-f93ef97fb805 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1454686918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=372b17fe-5474-4d98-b16d-77631ab03d9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89b2ee431c0f4e1f890ab2d1a7038ca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:04:06Z,use_quota=True,user_id='d7b3d28dc823442c955947e48d35a71f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:04:08 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-9f4ad6b8-9e9a-47ff-a878-f93ef97fb805 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Creating volume 372b17fe-5474-4d98-b16d-77631ab03d9c {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:04:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9f4ad6b8-9e9a-47ff-a878-f93ef97fb805 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9f4ad6b8-9e9a-47ff-a878-f93ef97fb805 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:08 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9f4ad6b8-9e9a-47ff-a878-f93ef97fb805 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:04:08 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9f4ad6b8-9e9a-47ff-a878-f93ef97fb805 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:04:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9f4ad6b8-9e9a-47ff-a878-f93ef97fb805 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:08 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9f4ad6b8-9e9a-47ff-a878-f93ef97fb805 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:04:08 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-9f4ad6b8-9e9a-47ff-a878-f93ef97fb805 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:04:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9f4ad6b8-9e9a-47ff-a878-f93ef97fb805 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-372b17fe-5474-4d98-b16d-77631ab03d9c 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8baacb04-0338-4c83-8acb-462c0928b958 tempest-ProjectReaderTests-504795444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f0d9b75-f466-4478-ab3e-ec61bf69bec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-046ae3ce-ef2d-40a6-8f26-8259a6ec46f6', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8baacb04-0338-4c83-8acb-462c0928b958 tempest-ProjectReaderTests-504795444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (422d610e-c7a7-44ef-9d72-a7f2b91aeaa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:08 devstack sudo[105607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-372b17fe-5474-4d98-b16d-77631ab03d9c 1073741824 Nov 06 18:04:08 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:08 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-8baacb04-0338-4c83-8acb-462c0928b958 tempest-ProjectReaderTests-504795444 None] Volume volume-046ae3ce-ef2d-40a6-8f26-8259a6ec46f6 (046ae3ce-ef2d-40a6-8f26-8259a6ec46f6): created successfully Nov 06 18:04:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8baacb04-0338-4c83-8acb-462c0928b958 tempest-ProjectReaderTests-504795444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (422d610e-c7a7-44ef-9d72-a7f2b91aeaa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8baacb04-0338-4c83-8acb-462c0928b958 tempest-ProjectReaderTests-504795444 None] Flow 'volume_create_manager' (3a258634-466a-46bc-8f6f-a28b413fbdca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:04:08 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-8baacb04-0338-4c83-8acb-462c0928b958 tempest-ProjectReaderTests-504795444 None] Created volume successfully. Nov 06 18:04:08 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f11b01ea-8ce9-42e1-8368-b5011e3d0f56 tempest-ProjectReaderTests-1299385716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c41285b9-34df-49fa-be68-4df96c8d243b.b5f88402-ca0f-45e9-9652-b5fff5ebe6ba" returned: 0 in 0.395s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:08 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-f11b01ea-8ce9-42e1-8368-b5011e3d0f56 tempest-ProjectReaderTests-1299385716 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c41285b9-34df-49fa-be68-4df96c8d243b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:04:08 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43573e0-f038-46c1-8b08-f8fc8e5c3557]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:04:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f11b01ea-8ce9-42e1-8368-b5011e3d0f56 tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c41285b9-34df-49fa-be68-4df96c8d243b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:08 devstack sudo[105615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c41285b9-34df-49fa-be68-4df96c8d243b Nov 06 18:04:08 devstack sudo[105615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:08 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9f4ad6b8-9e9a-47ff-a878-f93ef97fb805 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-372b17fe-5474-4d98-b16d-77631ab03d9c 1073741824" returned: 0 in 0.500s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9f4ad6b8-9e9a-47ff-a878-f93ef97fb805 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-372b17fe-5474-4d98-b16d-77631ab03d9c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:08 devstack sudo[105619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-372b17fe-5474-4d98-b16d-77631ab03d9c Nov 06 18:04:08 devstack sudo[105619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:08 devstack sudo[105615]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f11b01ea-8ce9-42e1-8368-b5011e3d0f56 tempest-ProjectReaderTests-1299385716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c41285b9-34df-49fa-be68-4df96c8d243b" returned: 0 in 0.391s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f11b01ea-8ce9-42e1-8368-b5011e3d0f56 tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c41285b9-34df-49fa-be68-4df96c8d243b.b5f88402-ca0f-45e9-9652-b5fff5ebe6ba {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:08 devstack sudo[105624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c41285b9-34df-49fa-be68-4df96c8d243b.b5f88402-ca0f-45e9-9652-b5fff5ebe6ba Nov 06 18:04:08 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:09 devstack sudo[105619]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9f4ad6b8-9e9a-47ff-a878-f93ef97fb805 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-372b17fe-5474-4d98-b16d-77631ab03d9c" returned: 0 in 0.287s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:09 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9f4ad6b8-9e9a-47ff-a878-f93ef97fb805 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:04:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9f4ad6b8-9e9a-47ff-a878-f93ef97fb805 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1fcd2226-d99f-433b-9de1-a320e1e25185 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.400s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:09 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1fcd2226-d99f-433b-9de1-a320e1e25185 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1337564858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2eea451-9a31-4298-9d88-12c1b446f426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89b2ee431c0f4e1f890ab2d1a7038ca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:04:06Z,use_quota=True,user_id='d7b3d28dc823442c955947e48d35a71f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:04:09 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-1fcd2226-d99f-433b-9de1-a320e1e25185 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Creating volume b2eea451-9a31-4298-9d88-12c1b446f426 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:04:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1fcd2226-d99f-433b-9de1-a320e1e25185 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1fcd2226-d99f-433b-9de1-a320e1e25185 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:09 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1fcd2226-d99f-433b-9de1-a320e1e25185 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:04:09 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1fcd2226-d99f-433b-9de1-a320e1e25185 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:04:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1fcd2226-d99f-433b-9de1-a320e1e25185 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:09 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1fcd2226-d99f-433b-9de1-a320e1e25185 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:04:09 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-1fcd2226-d99f-433b-9de1-a320e1e25185 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:04:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1fcd2226-d99f-433b-9de1-a320e1e25185 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b2eea451-9a31-4298-9d88-12c1b446f426 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9f4ad6b8-9e9a-47ff-a878-f93ef97fb805 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5130275-2146-46e3-93c4-2b3e33cdbef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-372b17fe-5474-4d98-b16d-77631ab03d9c', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:09 devstack sudo[105628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b2eea451-9a31-4298-9d88-12c1b446f426 1073741824 Nov 06 18:04:09 devstack sudo[105628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9f4ad6b8-9e9a-47ff-a878-f93ef97fb805 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dabdfdc-c345-4d2a-b92c-c56c05749d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:09 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-9f4ad6b8-9e9a-47ff-a878-f93ef97fb805 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Volume volume-372b17fe-5474-4d98-b16d-77631ab03d9c (372b17fe-5474-4d98-b16d-77631ab03d9c): created successfully Nov 06 18:04:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9f4ad6b8-9e9a-47ff-a878-f93ef97fb805 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dabdfdc-c345-4d2a-b92c-c56c05749d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9f4ad6b8-9e9a-47ff-a878-f93ef97fb805 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Flow 'volume_create_manager' (11ff65f4-070a-4c7b-8efb-3771ed4667ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:04:09 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-9f4ad6b8-9e9a-47ff-a878-f93ef97fb805 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Created volume successfully. Nov 06 18:04:09 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-fe7c3e7e-ccda-4d04-a3d8-ad0f1aa9edc0 tempest-ProjectReaderTests-504795444 None] Acquiring lock "cinder-046ae3ce-ef2d-40a6-8f26-8259a6ec46f6-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:09 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-fe7c3e7e-ccda-4d04-a3d8-ad0f1aa9edc0 tempest-ProjectReaderTests-504795444 None] Lock "cinder-046ae3ce-ef2d-40a6-8f26-8259a6ec46f6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:09 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-fe7c3e7e-ccda-4d04-a3d8-ad0f1aa9edc0 tempest-ProjectReaderTests-504795444 None] Acquiring lock "cinder-quobyte-046ae3ce-ef2d-40a6-8f26-8259a6ec46f6" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:09 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-fe7c3e7e-ccda-4d04-a3d8-ad0f1aa9edc0 tempest-ProjectReaderTests-504795444 None] Lock "cinder-quobyte-046ae3ce-ef2d-40a6-8f26-8259a6ec46f6" acquired by "delete_volume" :: waited 0.018s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:09 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f11b01ea-8ce9-42e1-8368-b5011e3d0f56 tempest-ProjectReaderTests-1299385716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c41285b9-34df-49fa-be68-4df96c8d243b.b5f88402-ca0f-45e9-9652-b5fff5ebe6ba" returned: 0 in 0.440s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f11b01ea-8ce9-42e1-8368-b5011e3d0f56 tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c41285b9-34df-49fa-be68-4df96c8d243b.b5f88402-ca0f-45e9-9652-b5fff5ebe6ba {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:09 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca42db1d-cf55-4645-bdb1-aa95282de4ec]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:04:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fe7c3e7e-ccda-4d04-a3d8-ad0f1aa9edc0 tempest-ProjectReaderTests-504795444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-046ae3ce-ef2d-40a6-8f26-8259a6ec46f6 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:09 devstack sudo[105633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c41285b9-34df-49fa-be68-4df96c8d243b.b5f88402-ca0f-45e9-9652-b5fff5ebe6ba Nov 06 18:04:09 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:09 devstack sudo[105636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-046ae3ce-ef2d-40a6-8f26-8259a6ec46f6 Nov 06 18:04:09 devstack sudo[105636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:09 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f11b01ea-8ce9-42e1-8368-b5011e3d0f56 tempest-ProjectReaderTests-1299385716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c41285b9-34df-49fa-be68-4df96c8d243b.b5f88402-ca0f-45e9-9652-b5fff5ebe6ba" returned: 0 in 0.268s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:09 devstack sudo[105628]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1fcd2226-d99f-433b-9de1-a320e1e25185 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b2eea451-9a31-4298-9d88-12c1b446f426 1073741824" returned: 0 in 0.537s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:09 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f11b01ea-8ce9-42e1-8368-b5011e3d0f56 tempest-ProjectReaderTests-1299385716 None] Lock "cinder-quobyte-b5f88402-ca0f-45e9-9652-b5fff5ebe6ba" released by "_delete_snapshot" :: held 1.614s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:09 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f11b01ea-8ce9-42e1-8368-b5011e3d0f56 tempest-ProjectReaderTests-1299385716 None] Lock "cinder-quobyte-c41285b9-34df-49fa-be68-4df96c8d243b" released by "delete_snapshot" :: held 1.661s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1fcd2226-d99f-433b-9de1-a320e1e25185 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b2eea451-9a31-4298-9d88-12c1b446f426 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:09 devstack sudo[105642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b2eea451-9a31-4298-9d88-12c1b446f426 Nov 06 18:04:09 devstack sudo[105642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:09 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-f11b01ea-8ce9-42e1-8368-b5011e3d0f56 tempest-ProjectReaderTests-1299385716 None] Created reservations ['b59269e0-5965-4ea8-8216-f8331a8c4610', '07e6e04e-aafb-47ba-92fb-172179cdca4f', '924a89e0-3f8a-46de-b1b7-edabfa08f2ba', '527bd1d4-5a49-48d4-9f35-1e38a3c70a4e'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:04:09 devstack sudo[105636]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fe7c3e7e-ccda-4d04-a3d8-ad0f1aa9edc0 tempest-ProjectReaderTests-504795444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-046ae3ce-ef2d-40a6-8f26-8259a6ec46f6" returned: 0 in 0.450s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fe7c3e7e-ccda-4d04-a3d8-ad0f1aa9edc0 tempest-ProjectReaderTests-504795444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-046ae3ce-ef2d-40a6-8f26-8259a6ec46f6 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:09 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-f11b01ea-8ce9-42e1-8368-b5011e3d0f56 tempest-ProjectReaderTests-1299385716 None] Delete snapshot completed successfully. Nov 06 18:04:09 devstack sudo[105647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-046ae3ce-ef2d-40a6-8f26-8259a6ec46f6 Nov 06 18:04:09 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:09 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f11b01ea-8ce9-42e1-8368-b5011e3d0f56 tempest-ProjectReaderTests-1299385716 None] Lock "cinder-b5f88402-ca0f-45e9-9652-b5fff5ebe6ba-delete_snapshot" released by "delete_snapshot" :: held 1.868s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:09 devstack sudo[105642]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1fcd2226-d99f-433b-9de1-a320e1e25185 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b2eea451-9a31-4298-9d88-12c1b446f426" returned: 0 in 0.281s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:09 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1fcd2226-d99f-433b-9de1-a320e1e25185 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:04:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1fcd2226-d99f-433b-9de1-a320e1e25185 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-01bf01ce-74a5-4a27-ba93-8b8a7f380a6e tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.478s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:09 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-01bf01ce-74a5-4a27-ba93-8b8a7f380a6e tempest-CreateVolumesFromSourceVolumeTest-633862983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:04:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-651604924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44b4d981-f8d4-4943-af44-ace1269d12e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89b2ee431c0f4e1f890ab2d1a7038ca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:04:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:04:07Z,use_quota=True,user_id='d7b3d28dc823442c955947e48d35a71f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:04:09 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-01bf01ce-74a5-4a27-ba93-8b8a7f380a6e tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Creating volume 44b4d981-f8d4-4943-af44-ace1269d12e2 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:04:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-01bf01ce-74a5-4a27-ba93-8b8a7f380a6e tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-01bf01ce-74a5-4a27-ba93-8b8a7f380a6e tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:09 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-01bf01ce-74a5-4a27-ba93-8b8a7f380a6e tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:04:09 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-01bf01ce-74a5-4a27-ba93-8b8a7f380a6e tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:04:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-01bf01ce-74a5-4a27-ba93-8b8a7f380a6e tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:09 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-01bf01ce-74a5-4a27-ba93-8b8a7f380a6e tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:04:09 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-01bf01ce-74a5-4a27-ba93-8b8a7f380a6e tempest-CreateVolumesFromSourceVolumeTest-633862983 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:04:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-01bf01ce-74a5-4a27-ba93-8b8a7f380a6e tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-44b4d981-f8d4-4943-af44-ace1269d12e2 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:09 devstack sudo[105650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-44b4d981-f8d4-4943-af44-ace1269d12e2 1073741824 Nov 06 18:04:09 devstack sudo[105650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1fcd2226-d99f-433b-9de1-a320e1e25185 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0604bd2b-b220-4751-999a-423b6a617d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2eea451-9a31-4298-9d88-12c1b446f426', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1fcd2226-d99f-433b-9de1-a320e1e25185 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53989921-491a-48a8-a9e1-9ec39ef7dea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:10 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-1fcd2226-d99f-433b-9de1-a320e1e25185 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Volume volume-b2eea451-9a31-4298-9d88-12c1b446f426 (b2eea451-9a31-4298-9d88-12c1b446f426): created successfully Nov 06 18:04:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1fcd2226-d99f-433b-9de1-a320e1e25185 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53989921-491a-48a8-a9e1-9ec39ef7dea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1fcd2226-d99f-433b-9de1-a320e1e25185 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Flow 'volume_create_manager' (d287d7f2-313f-44f0-9993-c235ceb35876) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:04:10 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-1fcd2226-d99f-433b-9de1-a320e1e25185 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Created volume successfully. Nov 06 18:04:10 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fe7c3e7e-ccda-4d04-a3d8-ad0f1aa9edc0 tempest-ProjectReaderTests-504795444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-046ae3ce-ef2d-40a6-8f26-8259a6ec46f6" returned: 0 in 0.310s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:10 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-fe7c3e7e-ccda-4d04-a3d8-ad0f1aa9edc0 tempest-ProjectReaderTests-504795444 None] Lock "cinder-quobyte-046ae3ce-ef2d-40a6-8f26-8259a6ec46f6" released by "delete_volume" :: held 0.814s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:10 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c5626e57-85ff-467a-9494-89b44b5f96d6 tempest-ProjectReaderTests-1299385716 None] Acquiring lock "cinder-c41285b9-34df-49fa-be68-4df96c8d243b-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:10 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c5626e57-85ff-467a-9494-89b44b5f96d6 tempest-ProjectReaderTests-1299385716 None] Lock "cinder-c41285b9-34df-49fa-be68-4df96c8d243b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:10 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c5626e57-85ff-467a-9494-89b44b5f96d6 tempest-ProjectReaderTests-1299385716 None] Acquiring lock "cinder-quobyte-c41285b9-34df-49fa-be68-4df96c8d243b" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:10 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-fe7c3e7e-ccda-4d04-a3d8-ad0f1aa9edc0 tempest-ProjectReaderTests-504795444 None] Created reservations ['00d15c48-caf7-4816-98f1-be51d4456921', '9312b239-cc0d-4634-8455-762e5cb3cc0f', 'b63a8dc3-275d-4cc6-b5da-07db45b6b3be', '0c77af2d-b9f3-4072-b217-a5a520db61d2'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:04:10 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c5626e57-85ff-467a-9494-89b44b5f96d6 tempest-ProjectReaderTests-1299385716 None] Lock "cinder-quobyte-c41285b9-34df-49fa-be68-4df96c8d243b" acquired by "delete_volume" :: waited 0.025s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:10 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a30f5d3-857f-4b11-999f-135e4db68caa]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:04:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c5626e57-85ff-467a-9494-89b44b5f96d6 tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c41285b9-34df-49fa-be68-4df96c8d243b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fe7c3e7e-ccda-4d04-a3d8-ad0f1aa9edc0 tempest-ProjectReaderTests-504795444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fe7c3e7e-ccda-4d04-a3d8-ad0f1aa9edc0 tempest-ProjectReaderTests-504795444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fe7c3e7e-ccda-4d04-a3d8-ad0f1aa9edc0 tempest-ProjectReaderTests-504795444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:04:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fe7c3e7e-ccda-4d04-a3d8-ad0f1aa9edc0 tempest-ProjectReaderTests-504795444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:04:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fe7c3e7e-ccda-4d04-a3d8-ad0f1aa9edc0 tempest-ProjectReaderTests-504795444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fe7c3e7e-ccda-4d04-a3d8-ad0f1aa9edc0 tempest-ProjectReaderTests-504795444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:10 devstack sudo[105658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:04:10 devstack sudo[105658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:10 devstack sudo[105656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c41285b9-34df-49fa-be68-4df96c8d243b Nov 06 18:04:10 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:10 devstack sudo[105650]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-01bf01ce-74a5-4a27-ba93-8b8a7f380a6e tempest-CreateVolumesFromSourceVolumeTest-633862983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-44b4d981-f8d4-4943-af44-ace1269d12e2 1073741824" returned: 0 in 0.516s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-01bf01ce-74a5-4a27-ba93-8b8a7f380a6e tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-44b4d981-f8d4-4943-af44-ace1269d12e2 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:10 devstack sudo[105661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-44b4d981-f8d4-4943-af44-ace1269d12e2 Nov 06 18:04:10 devstack sudo[105661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:10 devstack sudo[105658]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fe7c3e7e-ccda-4d04-a3d8-ad0f1aa9edc0 tempest-ProjectReaderTests-504795444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.316s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:10 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-fe7c3e7e-ccda-4d04-a3d8-ad0f1aa9edc0 tempest-ProjectReaderTests-504795444 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:04:10 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-fe7c3e7e-ccda-4d04-a3d8-ad0f1aa9edc0 tempest-ProjectReaderTests-504795444 None] Deleted volume successfully. Nov 06 18:04:10 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-fe7c3e7e-ccda-4d04-a3d8-ad0f1aa9edc0 tempest-ProjectReaderTests-504795444 None] Lock "cinder-046ae3ce-ef2d-40a6-8f26-8259a6ec46f6-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:10 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c5626e57-85ff-467a-9494-89b44b5f96d6 tempest-ProjectReaderTests-1299385716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c41285b9-34df-49fa-be68-4df96c8d243b" returned: 0 in 0.472s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c5626e57-85ff-467a-9494-89b44b5f96d6 tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c41285b9-34df-49fa-be68-4df96c8d243b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:10 devstack sudo[105668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c41285b9-34df-49fa-be68-4df96c8d243b Nov 06 18:04:10 devstack sudo[105668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:10 devstack sudo[105661]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-01bf01ce-74a5-4a27-ba93-8b8a7f380a6e tempest-CreateVolumesFromSourceVolumeTest-633862983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-44b4d981-f8d4-4943-af44-ace1269d12e2" returned: 0 in 0.303s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-01bf01ce-74a5-4a27-ba93-8b8a7f380a6e tempest-CreateVolumesFromSourceVolumeTest-633862983 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:04:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-01bf01ce-74a5-4a27-ba93-8b8a7f380a6e tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fdf22902-3c6c-47da-9663-7b781d18c126 tempest-ProjectMemberTests-819176810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.211s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fdf22902-3c6c-47da-9663-7b781d18c126 tempest-ProjectMemberTests-819176810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:04:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1747832789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a16ec3f3-15f5-48fa-98dc-3e224221b69f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b97cd7ef94764995a9e8c62cda23171f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:04:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:04:07Z,use_quota=True,user_id='a34e6465a98c4c289547d49a900a6bde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:04:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-fdf22902-3c6c-47da-9663-7b781d18c126 tempest-ProjectMemberTests-819176810 None] Creating volume a16ec3f3-15f5-48fa-98dc-3e224221b69f {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:04:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fdf22902-3c6c-47da-9663-7b781d18c126 tempest-ProjectMemberTests-819176810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fdf22902-3c6c-47da-9663-7b781d18c126 tempest-ProjectMemberTests-819176810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fdf22902-3c6c-47da-9663-7b781d18c126 tempest-ProjectMemberTests-819176810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:04:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fdf22902-3c6c-47da-9663-7b781d18c126 tempest-ProjectMemberTests-819176810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:04:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fdf22902-3c6c-47da-9663-7b781d18c126 tempest-ProjectMemberTests-819176810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fdf22902-3c6c-47da-9663-7b781d18c126 tempest-ProjectMemberTests-819176810 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:04:10 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-fdf22902-3c6c-47da-9663-7b781d18c126 tempest-ProjectMemberTests-819176810 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:04:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fdf22902-3c6c-47da-9663-7b781d18c126 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a16ec3f3-15f5-48fa-98dc-3e224221b69f 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:10 devstack sudo[105671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a16ec3f3-15f5-48fa-98dc-3e224221b69f 1073741824 Nov 06 18:04:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-01bf01ce-74a5-4a27-ba93-8b8a7f380a6e tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e03a31e-99fc-4114-8420-169748be8c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44b4d981-f8d4-4943-af44-ace1269d12e2', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:10 devstack sudo[105671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-01bf01ce-74a5-4a27-ba93-8b8a7f380a6e tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f2a9bf6-6776-4e6d-9d2b-82c483636d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:10 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-01bf01ce-74a5-4a27-ba93-8b8a7f380a6e tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Volume volume-44b4d981-f8d4-4943-af44-ace1269d12e2 (44b4d981-f8d4-4943-af44-ace1269d12e2): created successfully Nov 06 18:04:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-01bf01ce-74a5-4a27-ba93-8b8a7f380a6e tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f2a9bf6-6776-4e6d-9d2b-82c483636d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-01bf01ce-74a5-4a27-ba93-8b8a7f380a6e tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Flow 'volume_create_manager' (684d4adf-165a-4095-a1cd-6871e4a44d42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:04:10 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-01bf01ce-74a5-4a27-ba93-8b8a7f380a6e tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Created volume successfully. Nov 06 18:04:11 devstack sudo[105668]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c5626e57-85ff-467a-9494-89b44b5f96d6 tempest-ProjectReaderTests-1299385716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c41285b9-34df-49fa-be68-4df96c8d243b" returned: 0 in 0.286s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:11 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c5626e57-85ff-467a-9494-89b44b5f96d6 tempest-ProjectReaderTests-1299385716 None] Lock "cinder-quobyte-c41285b9-34df-49fa-be68-4df96c8d243b" released by "delete_volume" :: held 0.833s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:11 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-c5626e57-85ff-467a-9494-89b44b5f96d6 tempest-ProjectReaderTests-1299385716 None] Created reservations ['b6e42527-13bb-494f-aeea-d87f5a2b6d3b', '401e80a8-2b04-41dc-9971-31d4c552330a', 'b3b1f352-cb7d-4fbe-a31b-38eba96ba92d', 'f3cf2ee5-603e-4dce-abe9-5f0c30547123'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:04:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c5626e57-85ff-467a-9494-89b44b5f96d6 tempest-ProjectReaderTests-1299385716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c5626e57-85ff-467a-9494-89b44b5f96d6 tempest-ProjectReaderTests-1299385716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c5626e57-85ff-467a-9494-89b44b5f96d6 tempest-ProjectReaderTests-1299385716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:04:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c5626e57-85ff-467a-9494-89b44b5f96d6 tempest-ProjectReaderTests-1299385716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:04:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c5626e57-85ff-467a-9494-89b44b5f96d6 tempest-ProjectReaderTests-1299385716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c5626e57-85ff-467a-9494-89b44b5f96d6 tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:11 devstack sudo[105678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:04:11 devstack sudo[105678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:11 devstack sudo[105671]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fdf22902-3c6c-47da-9663-7b781d18c126 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a16ec3f3-15f5-48fa-98dc-3e224221b69f 1073741824" returned: 0 in 0.661s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fdf22902-3c6c-47da-9663-7b781d18c126 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a16ec3f3-15f5-48fa-98dc-3e224221b69f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:11 devstack sudo[105682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a16ec3f3-15f5-48fa-98dc-3e224221b69f Nov 06 18:04:11 devstack sudo[105682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:11 devstack sudo[105678]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c5626e57-85ff-467a-9494-89b44b5f96d6 tempest-ProjectReaderTests-1299385716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.363s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:11 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-c5626e57-85ff-467a-9494-89b44b5f96d6 tempest-ProjectReaderTests-1299385716 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:04:11 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-c5626e57-85ff-467a-9494-89b44b5f96d6 tempest-ProjectReaderTests-1299385716 None] Deleted volume successfully. Nov 06 18:04:11 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c5626e57-85ff-467a-9494-89b44b5f96d6 tempest-ProjectReaderTests-1299385716 None] Lock "cinder-c41285b9-34df-49fa-be68-4df96c8d243b-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:11 devstack sudo[105682]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fdf22902-3c6c-47da-9663-7b781d18c126 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a16ec3f3-15f5-48fa-98dc-3e224221b69f" returned: 0 in 0.350s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fdf22902-3c6c-47da-9663-7b781d18c126 tempest-ProjectMemberTests-819176810 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:04:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fdf22902-3c6c-47da-9663-7b781d18c126 tempest-ProjectMemberTests-819176810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-432b4b41-0a16-432a-b9c5-9986f7851b24 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.165s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-432b4b41-0a16-432a-b9c5-9986f7851b24 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:04:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-695719324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d8315c7-b78d-4369-90e9-7121fac7cbdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89b2ee431c0f4e1f890ab2d1a7038ca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:04:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:04:08Z,use_quota=True,user_id='d7b3d28dc823442c955947e48d35a71f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:04:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-432b4b41-0a16-432a-b9c5-9986f7851b24 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Creating volume 6d8315c7-b78d-4369-90e9-7121fac7cbdd {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:04:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-432b4b41-0a16-432a-b9c5-9986f7851b24 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-432b4b41-0a16-432a-b9c5-9986f7851b24 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-432b4b41-0a16-432a-b9c5-9986f7851b24 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:04:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-432b4b41-0a16-432a-b9c5-9986f7851b24 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:04:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-432b4b41-0a16-432a-b9c5-9986f7851b24 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-432b4b41-0a16-432a-b9c5-9986f7851b24 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:04:11 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-432b4b41-0a16-432a-b9c5-9986f7851b24 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:04:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-432b4b41-0a16-432a-b9c5-9986f7851b24 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6d8315c7-b78d-4369-90e9-7121fac7cbdd 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:11 devstack sudo[105685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6d8315c7-b78d-4369-90e9-7121fac7cbdd 1073741824 Nov 06 18:04:11 devstack sudo[105685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fdf22902-3c6c-47da-9663-7b781d18c126 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e229ca5-7937-4175-8a0b-63dec62fb98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a16ec3f3-15f5-48fa-98dc-3e224221b69f', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fdf22902-3c6c-47da-9663-7b781d18c126 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (552b8c56-06b4-4483-8d37-4a07624bfd33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:11 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-60d28e76-118e-4955-8811-8f8260540371 tempest-ProjectReaderTests-1299385716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:04:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-60d28e76-118e-4955-8811-8f8260540371 tempest-ProjectReaderTests-1299385716 None] Flow 'volume_create_manager' (97a2f773-3bcb-49d2-9237-413c924bcaca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:04:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-60d28e76-118e-4955-8811-8f8260540371 tempest-ProjectReaderTests-1299385716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e19185c-f46b-4e6c-8389-fdda1c909409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:11 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-fdf22902-3c6c-47da-9663-7b781d18c126 tempest-ProjectMemberTests-819176810 None] Volume volume-a16ec3f3-15f5-48fa-98dc-3e224221b69f (a16ec3f3-15f5-48fa-98dc-3e224221b69f): created successfully Nov 06 18:04:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fdf22902-3c6c-47da-9663-7b781d18c126 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (552b8c56-06b4-4483-8d37-4a07624bfd33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fdf22902-3c6c-47da-9663-7b781d18c126 tempest-ProjectMemberTests-819176810 None] Flow 'volume_create_manager' (b1f4208c-4c9d-4f87-9513-5d249c551463) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:04:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-60d28e76-118e-4955-8811-8f8260540371 tempest-ProjectReaderTests-1299385716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e19185c-f46b-4e6c-8389-fdda1c909409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:04:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1963282592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=457d8c32-c45d-448c-9fc6-7b122e4b644c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c5284ac37ff4d179815435f871ca0fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:04:12Z,use_quota=True,user_id='caa4f376bb65466cba7edd807cf24033',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-60d28e76-118e-4955-8811-8f8260540371 tempest-ProjectReaderTests-1299385716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77e76cc7-e1ec-4c80-a490-082c6ee55bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-60d28e76-118e-4955-8811-8f8260540371 tempest-ProjectReaderTests-1299385716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77e76cc7-e1ec-4c80-a490-082c6ee55bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-60d28e76-118e-4955-8811-8f8260540371 tempest-ProjectReaderTests-1299385716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06fa9dbc-ebb6-4cd7-81df-68994a89d6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-60d28e76-118e-4955-8811-8f8260540371 tempest-ProjectReaderTests-1299385716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06fa9dbc-ebb6-4cd7-81df-68994a89d6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '457d8c32-c45d-448c-9fc6-7b122e4b644c', 'volume_name': 'volume-457d8c32-c45d-448c-9fc6-7b122e4b644c', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-60d28e76-118e-4955-8811-8f8260540371 tempest-ProjectReaderTests-1299385716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c31f1a84-5802-4355-885d-602c1e7c1c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-60d28e76-118e-4955-8811-8f8260540371 tempest-ProjectReaderTests-1299385716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c31f1a84-5802-4355-885d-602c1e7c1c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-60d28e76-118e-4955-8811-8f8260540371 tempest-ProjectReaderTests-1299385716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8db0c04b-c57f-4ad0-8c70-58c28485fb1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:12 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-60d28e76-118e-4955-8811-8f8260540371 tempest-ProjectReaderTests-1299385716 None] Volume 457d8c32-c45d-448c-9fc6-7b122e4b644c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-457d8c32-c45d-448c-9fc6-7b122e4b644c', 'volume_size': 1} Nov 06 18:04:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-60d28e76-118e-4955-8811-8f8260540371 tempest-ProjectReaderTests-1299385716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:12 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-fdf22902-3c6c-47da-9663-7b781d18c126 tempest-ProjectMemberTests-819176810 None] Created volume successfully. Nov 06 18:04:12 devstack sudo[105685]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-432b4b41-0a16-432a-b9c5-9986f7851b24 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6d8315c7-b78d-4369-90e9-7121fac7cbdd 1073741824" returned: 0 in 0.624s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fb3ff403-308a-4c6a-b01a-c8b9819ab3d5 tempest-ProjectMemberTests-819176810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-432b4b41-0a16-432a-b9c5-9986f7851b24 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6d8315c7-b78d-4369-90e9-7121fac7cbdd {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:12 devstack sudo[105691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6d8315c7-b78d-4369-90e9-7121fac7cbdd Nov 06 18:04:12 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:12 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-432b4b41-0a16-432a-b9c5-9986f7851b24 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6d8315c7-b78d-4369-90e9-7121fac7cbdd" returned: 0 in 0.254s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:12 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-432b4b41-0a16-432a-b9c5-9986f7851b24 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:04:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-432b4b41-0a16-432a-b9c5-9986f7851b24 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fede31a2-96a1-453b-b739-8abd0143ea19 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.921s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:12 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fede31a2-96a1-453b-b739-8abd0143ea19 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:04:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1246488261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1a73a31-5b7e-4555-a24d-1c43262f60fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89b2ee431c0f4e1f890ab2d1a7038ca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:04:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:04:08Z,use_quota=True,user_id='d7b3d28dc823442c955947e48d35a71f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:04:12 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-fede31a2-96a1-453b-b739-8abd0143ea19 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Creating volume c1a73a31-5b7e-4555-a24d-1c43262f60fc {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:04:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fede31a2-96a1-453b-b739-8abd0143ea19 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fede31a2-96a1-453b-b739-8abd0143ea19 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:12 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fede31a2-96a1-453b-b739-8abd0143ea19 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:04:12 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fede31a2-96a1-453b-b739-8abd0143ea19 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:04:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fede31a2-96a1-453b-b739-8abd0143ea19 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:12 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fede31a2-96a1-453b-b739-8abd0143ea19 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:04:12 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-fede31a2-96a1-453b-b739-8abd0143ea19 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:04:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fede31a2-96a1-453b-b739-8abd0143ea19 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c1a73a31-5b7e-4555-a24d-1c43262f60fc 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-432b4b41-0a16-432a-b9c5-9986f7851b24 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beb440f6-3adc-40d0-b8cb-5e1ea9bbde5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d8315c7-b78d-4369-90e9-7121fac7cbdd', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-432b4b41-0a16-432a-b9c5-9986f7851b24 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9335c1f8-3bda-45a9-b5cf-967a97c24e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:12 devstack sudo[105694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c1a73a31-5b7e-4555-a24d-1c43262f60fc 1073741824 Nov 06 18:04:12 devstack sudo[105694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:12 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-432b4b41-0a16-432a-b9c5-9986f7851b24 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Volume volume-6d8315c7-b78d-4369-90e9-7121fac7cbdd (6d8315c7-b78d-4369-90e9-7121fac7cbdd): created successfully Nov 06 18:04:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-432b4b41-0a16-432a-b9c5-9986f7851b24 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9335c1f8-3bda-45a9-b5cf-967a97c24e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-432b4b41-0a16-432a-b9c5-9986f7851b24 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Flow 'volume_create_manager' (7df27417-6bd3-4ade-87b1-d965c601e4b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:04:12 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-432b4b41-0a16-432a-b9c5-9986f7851b24 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Created volume successfully. Nov 06 18:04:13 devstack sudo[105694]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fede31a2-96a1-453b-b739-8abd0143ea19 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c1a73a31-5b7e-4555-a24d-1c43262f60fc 1073741824" returned: 0 in 0.469s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fede31a2-96a1-453b-b739-8abd0143ea19 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c1a73a31-5b7e-4555-a24d-1c43262f60fc {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:13 devstack sudo[105699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c1a73a31-5b7e-4555-a24d-1c43262f60fc Nov 06 18:04:13 devstack sudo[105699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:13 devstack sudo[105699]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fede31a2-96a1-453b-b739-8abd0143ea19 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c1a73a31-5b7e-4555-a24d-1c43262f60fc" returned: 0 in 0.277s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:13 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fede31a2-96a1-453b-b739-8abd0143ea19 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:04:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fede31a2-96a1-453b-b739-8abd0143ea19 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-60d28e76-118e-4955-8811-8f8260540371 tempest-ProjectReaderTests-1299385716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.525s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:13 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-60d28e76-118e-4955-8811-8f8260540371 tempest-ProjectReaderTests-1299385716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:04:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1963282592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=457d8c32-c45d-448c-9fc6-7b122e4b644c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c5284ac37ff4d179815435f871ca0fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:04:12Z,use_quota=True,user_id='caa4f376bb65466cba7edd807cf24033',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:04:13 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-60d28e76-118e-4955-8811-8f8260540371 tempest-ProjectReaderTests-1299385716 None] Creating volume 457d8c32-c45d-448c-9fc6-7b122e4b644c {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:04:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-60d28e76-118e-4955-8811-8f8260540371 tempest-ProjectReaderTests-1299385716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-60d28e76-118e-4955-8811-8f8260540371 tempest-ProjectReaderTests-1299385716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:13 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-60d28e76-118e-4955-8811-8f8260540371 tempest-ProjectReaderTests-1299385716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:04:13 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-60d28e76-118e-4955-8811-8f8260540371 tempest-ProjectReaderTests-1299385716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:04:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-60d28e76-118e-4955-8811-8f8260540371 tempest-ProjectReaderTests-1299385716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:13 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-60d28e76-118e-4955-8811-8f8260540371 tempest-ProjectReaderTests-1299385716 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:04:13 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-60d28e76-118e-4955-8811-8f8260540371 tempest-ProjectReaderTests-1299385716 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:04:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-60d28e76-118e-4955-8811-8f8260540371 tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-457d8c32-c45d-448c-9fc6-7b122e4b644c 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fede31a2-96a1-453b-b739-8abd0143ea19 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb278c65-53f8-4bf4-9e18-6d63b2455775) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1a73a31-5b7e-4555-a24d-1c43262f60fc', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:13 devstack sudo[105702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-457d8c32-c45d-448c-9fc6-7b122e4b644c 1073741824 Nov 06 18:04:13 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fede31a2-96a1-453b-b739-8abd0143ea19 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (badea273-2103-455f-818c-810623404541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:13 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-fede31a2-96a1-453b-b739-8abd0143ea19 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Volume volume-c1a73a31-5b7e-4555-a24d-1c43262f60fc (c1a73a31-5b7e-4555-a24d-1c43262f60fc): created successfully Nov 06 18:04:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fede31a2-96a1-453b-b739-8abd0143ea19 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (badea273-2103-455f-818c-810623404541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fede31a2-96a1-453b-b739-8abd0143ea19 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Flow 'volume_create_manager' (d4e8bc33-6567-45c6-b7e7-1dd75fdf9205) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:04:13 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-fede31a2-96a1-453b-b739-8abd0143ea19 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Created volume successfully. Nov 06 18:04:14 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-60d28e76-118e-4955-8811-8f8260540371 tempest-ProjectReaderTests-1299385716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-457d8c32-c45d-448c-9fc6-7b122e4b644c 1073741824" returned: 0 in 0.513s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-60d28e76-118e-4955-8811-8f8260540371 tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-457d8c32-c45d-448c-9fc6-7b122e4b644c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:14 devstack sudo[105708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-457d8c32-c45d-448c-9fc6-7b122e4b644c Nov 06 18:04:14 devstack sudo[105708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:14 devstack sudo[105708]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-60d28e76-118e-4955-8811-8f8260540371 tempest-ProjectReaderTests-1299385716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-457d8c32-c45d-448c-9fc6-7b122e4b644c" returned: 0 in 0.253s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-60d28e76-118e-4955-8811-8f8260540371 tempest-ProjectReaderTests-1299385716 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:04:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-60d28e76-118e-4955-8811-8f8260540371 tempest-ProjectReaderTests-1299385716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fb3ff403-308a-4c6a-b01a-c8b9819ab3d5 tempest-ProjectMemberTests-819176810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.878s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-60d28e76-118e-4955-8811-8f8260540371 tempest-ProjectReaderTests-1299385716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8db0c04b-c57f-4ad0-8c70-58c28485fb1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-457d8c32-c45d-448c-9fc6-7b122e4b644c', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-60d28e76-118e-4955-8811-8f8260540371 tempest-ProjectReaderTests-1299385716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (660cb84c-7bce-49f9-aa58-f332dd80589d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-fb3ff403-308a-4c6a-b01a-c8b9819ab3d5 tempest-ProjectMemberTests-819176810 None] Creating offline snapshot cf903eb3-7c28-4e98-a11a-e982d3fd63b7 of volume a16ec3f3-15f5-48fa-98dc-3e224221b69f {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:04:14 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-60d28e76-118e-4955-8811-8f8260540371 tempest-ProjectReaderTests-1299385716 None] Volume volume-457d8c32-c45d-448c-9fc6-7b122e4b644c (457d8c32-c45d-448c-9fc6-7b122e4b644c): created successfully Nov 06 18:04:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-60d28e76-118e-4955-8811-8f8260540371 tempest-ProjectReaderTests-1299385716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (660cb84c-7bce-49f9-aa58-f332dd80589d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-60d28e76-118e-4955-8811-8f8260540371 tempest-ProjectReaderTests-1299385716 None] Flow 'volume_create_manager' (97a2f773-3bcb-49d2-9237-413c924bcaca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:04:14 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0866c4dc-8ac7-402f-860f-287e51e98d09]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:04:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fb3ff403-308a-4c6a-b01a-c8b9819ab3d5 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a16ec3f3-15f5-48fa-98dc-3e224221b69f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:14 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-60d28e76-118e-4955-8811-8f8260540371 tempest-ProjectReaderTests-1299385716 None] Created volume successfully. Nov 06 18:04:14 devstack sudo[105711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a16ec3f3-15f5-48fa-98dc-3e224221b69f Nov 06 18:04:14 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:14 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-dc07e023-c6f6-4e84-b975-6c7c243c20b8 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Acquiring lock "cinder-c1a73a31-5b7e-4555-a24d-1c43262f60fc-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:14 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-dc07e023-c6f6-4e84-b975-6c7c243c20b8 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Lock "cinder-c1a73a31-5b7e-4555-a24d-1c43262f60fc-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:14 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-dc07e023-c6f6-4e84-b975-6c7c243c20b8 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Acquiring lock "cinder-quobyte-c1a73a31-5b7e-4555-a24d-1c43262f60fc" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:14 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-dc07e023-c6f6-4e84-b975-6c7c243c20b8 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Lock "cinder-quobyte-c1a73a31-5b7e-4555-a24d-1c43262f60fc" acquired by "delete_volume" :: waited 0.018s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:14 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85c1a5c-1992-4d8e-ada1-f9395e4b9c8a]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:04:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-dc07e023-c6f6-4e84-b975-6c7c243c20b8 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c1a73a31-5b7e-4555-a24d-1c43262f60fc {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:14 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fb3ff403-308a-4c6a-b01a-c8b9819ab3d5 tempest-ProjectMemberTests-819176810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a16ec3f3-15f5-48fa-98dc-3e224221b69f" returned: 0 in 0.440s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fb3ff403-308a-4c6a-b01a-c8b9819ab3d5 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a16ec3f3-15f5-48fa-98dc-3e224221b69f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a16ec3f3-15f5-48fa-98dc-3e224221b69f.cf903eb3-7c28-4e98-a11a-e982d3fd63b7 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:14 devstack sudo[105717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a16ec3f3-15f5-48fa-98dc-3e224221b69f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a16ec3f3-15f5-48fa-98dc-3e224221b69f.cf903eb3-7c28-4e98-a11a-e982d3fd63b7 1G Nov 06 18:04:14 devstack sudo[105717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:15 devstack sudo[105716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c1a73a31-5b7e-4555-a24d-1c43262f60fc Nov 06 18:04:15 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-068910c6-bd3f-4a85-8886-6442a0056ef9 tempest-ProjectReaderTests-1299385716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:15 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-dc07e023-c6f6-4e84-b975-6c7c243c20b8 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c1a73a31-5b7e-4555-a24d-1c43262f60fc" returned: 0 in 0.494s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-dc07e023-c6f6-4e84-b975-6c7c243c20b8 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c1a73a31-5b7e-4555-a24d-1c43262f60fc {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:15 devstack sudo[105727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c1a73a31-5b7e-4555-a24d-1c43262f60fc Nov 06 18:04:15 devstack sudo[105727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:15 devstack sudo[105717]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fb3ff403-308a-4c6a-b01a-c8b9819ab3d5 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a16ec3f3-15f5-48fa-98dc-3e224221b69f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a16ec3f3-15f5-48fa-98dc-3e224221b69f.cf903eb3-7c28-4e98-a11a-e982d3fd63b7 1G" returned: 0 in 0.512s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fb3ff403-308a-4c6a-b01a-c8b9819ab3d5 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a16ec3f3-15f5-48fa-98dc-3e224221b69f -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a16ec3f3-15f5-48fa-98dc-3e224221b69f.cf903eb3-7c28-4e98-a11a-e982d3fd63b7 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:15 devstack sudo[105729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a16ec3f3-15f5-48fa-98dc-3e224221b69f -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a16ec3f3-15f5-48fa-98dc-3e224221b69f.cf903eb3-7c28-4e98-a11a-e982d3fd63b7 Nov 06 18:04:15 devstack sudo[105729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:15 devstack sudo[105727]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-dc07e023-c6f6-4e84-b975-6c7c243c20b8 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-c1a73a31-5b7e-4555-a24d-1c43262f60fc" returned: 0 in 0.307s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:15 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-dc07e023-c6f6-4e84-b975-6c7c243c20b8 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Lock "cinder-quobyte-c1a73a31-5b7e-4555-a24d-1c43262f60fc" released by "delete_volume" :: held 0.851s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:15 devstack sudo[105729]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fb3ff403-308a-4c6a-b01a-c8b9819ab3d5 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a16ec3f3-15f5-48fa-98dc-3e224221b69f -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a16ec3f3-15f5-48fa-98dc-3e224221b69f.cf903eb3-7c28-4e98-a11a-e982d3fd63b7" returned: 0 in 0.325s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:15 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-fb3ff403-308a-4c6a-b01a-c8b9819ab3d5 tempest-ProjectMemberTests-819176810 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a16ec3f3-15f5-48fa-98dc-3e224221b69f.cf903eb3-7c28-4e98-a11a-e982d3fd63b7 is being set with open permissions: ugo+rw Nov 06 18:04:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fb3ff403-308a-4c6a-b01a-c8b9819ab3d5 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a16ec3f3-15f5-48fa-98dc-3e224221b69f.cf903eb3-7c28-4e98-a11a-e982d3fd63b7 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:15 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-dc07e023-c6f6-4e84-b975-6c7c243c20b8 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Created reservations ['8bbc34a9-32f3-44c1-8ff5-88122f37c7b5', '46389d6d-67b3-4713-b2df-1ad314372380', 'f09f2e12-96fb-4556-89cf-1bdf175a61dc', '60d14d22-9a63-4545-ae69-b61d3505fa20'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:04:15 devstack sudo[105735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a16ec3f3-15f5-48fa-98dc-3e224221b69f.cf903eb3-7c28-4e98-a11a-e982d3fd63b7 Nov 06 18:04:15 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-dc07e023-c6f6-4e84-b975-6c7c243c20b8 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-dc07e023-c6f6-4e84-b975-6c7c243c20b8 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:15 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-dc07e023-c6f6-4e84-b975-6c7c243c20b8 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:04:15 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-dc07e023-c6f6-4e84-b975-6c7c243c20b8 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:04:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-dc07e023-c6f6-4e84-b975-6c7c243c20b8 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-dc07e023-c6f6-4e84-b975-6c7c243c20b8 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:15 devstack sudo[105737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:04:15 devstack sudo[105737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:16 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-681af671-0cdb-467e-88dc-3f96d056312b tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Acquiring lock "cinder-6d8315c7-b78d-4369-90e9-7121fac7cbdd-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:16 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-681af671-0cdb-467e-88dc-3f96d056312b tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Lock "cinder-6d8315c7-b78d-4369-90e9-7121fac7cbdd-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:16 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-681af671-0cdb-467e-88dc-3f96d056312b tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Acquiring lock "cinder-quobyte-6d8315c7-b78d-4369-90e9-7121fac7cbdd" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:16 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fb3ff403-308a-4c6a-b01a-c8b9819ab3d5 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a16ec3f3-15f5-48fa-98dc-3e224221b69f.cf903eb3-7c28-4e98-a11a-e982d3fd63b7" returned: 0 in 0.340s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:16 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-681af671-0cdb-467e-88dc-3f96d056312b tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Lock "cinder-quobyte-6d8315c7-b78d-4369-90e9-7121fac7cbdd" acquired by "delete_volume" :: waited 0.034s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:16 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c644bfce-261c-4e07-aa38-4bc571470854]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:04:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-681af671-0cdb-467e-88dc-3f96d056312b tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6d8315c7-b78d-4369-90e9-7121fac7cbdd {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fb3ff403-308a-4c6a-b01a-c8b9819ab3d5 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a16ec3f3-15f5-48fa-98dc-3e224221b69f.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:16 devstack sudo[105741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a16ec3f3-15f5-48fa-98dc-3e224221b69f.info Nov 06 18:04:16 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:16 devstack sudo[105737]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-dc07e023-c6f6-4e84-b975-6c7c243c20b8 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.382s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:16 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-dc07e023-c6f6-4e84-b975-6c7c243c20b8 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:04:16 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-dc07e023-c6f6-4e84-b975-6c7c243c20b8 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Deleted volume successfully. Nov 06 18:04:16 devstack sudo[105740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6d8315c7-b78d-4369-90e9-7121fac7cbdd Nov 06 18:04:16 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:16 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-dc07e023-c6f6-4e84-b975-6c7c243c20b8 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Lock "cinder-c1a73a31-5b7e-4555-a24d-1c43262f60fc-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:16 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fb3ff403-308a-4c6a-b01a-c8b9819ab3d5 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a16ec3f3-15f5-48fa-98dc-3e224221b69f.info" returned: 0 in 0.302s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:16 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-fb3ff403-308a-4c6a-b01a-c8b9819ab3d5 tempest-ProjectMemberTests-819176810 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a16ec3f3-15f5-48fa-98dc-3e224221b69f.info is being set with open permissions: ugo+rw Nov 06 18:04:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fb3ff403-308a-4c6a-b01a-c8b9819ab3d5 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a16ec3f3-15f5-48fa-98dc-3e224221b69f.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:16 devstack sudo[105746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a16ec3f3-15f5-48fa-98dc-3e224221b69f.info Nov 06 18:04:16 devstack sudo[105746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:16 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-681af671-0cdb-467e-88dc-3f96d056312b tempest-CreateVolumesFromSourceVolumeTest-633862983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6d8315c7-b78d-4369-90e9-7121fac7cbdd" returned: 0 in 0.465s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-681af671-0cdb-467e-88dc-3f96d056312b tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6d8315c7-b78d-4369-90e9-7121fac7cbdd {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:16 devstack sudo[105752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6d8315c7-b78d-4369-90e9-7121fac7cbdd Nov 06 18:04:16 devstack sudo[105752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:16 devstack sudo[105746]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fb3ff403-308a-4c6a-b01a-c8b9819ab3d5 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a16ec3f3-15f5-48fa-98dc-3e224221b69f.info" returned: 0 in 0.304s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fb3ff403-308a-4c6a-b01a-c8b9819ab3d5 tempest-ProjectMemberTests-819176810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.396s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-068910c6-bd3f-4a85-8886-6442a0056ef9 tempest-ProjectReaderTests-1299385716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.544s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-068910c6-bd3f-4a85-8886-6442a0056ef9 tempest-ProjectReaderTests-1299385716 None] Creating offline snapshot 6664c1ff-a66f-4e32-b799-43c1ae28bca0 of volume 457d8c32-c45d-448c-9fc6-7b122e4b644c {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:04:16 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-fb3ff403-308a-4c6a-b01a-c8b9819ab3d5 tempest-ProjectMemberTests-819176810 None] Create snapshot completed successfully Nov 06 18:04:16 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ffc456-7b1f-413f-bc4a-934d31764f3c]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:04:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-068910c6-bd3f-4a85-8886-6442a0056ef9 tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-457d8c32-c45d-448c-9fc6-7b122e4b644c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:16 devstack sudo[105752]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-681af671-0cdb-467e-88dc-3f96d056312b tempest-CreateVolumesFromSourceVolumeTest-633862983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-6d8315c7-b78d-4369-90e9-7121fac7cbdd" returned: 0 in 0.286s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:16 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-681af671-0cdb-467e-88dc-3f96d056312b tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Lock "cinder-quobyte-6d8315c7-b78d-4369-90e9-7121fac7cbdd" released by "delete_volume" :: held 0.810s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:17 devstack sudo[105756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-457d8c32-c45d-448c-9fc6-7b122e4b644c Nov 06 18:04:17 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:17 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-681af671-0cdb-467e-88dc-3f96d056312b tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Created reservations ['443a15cf-43d4-4cc6-a4a4-f125fe248285', 'ca0bd960-b000-494f-a2f6-bb2155d12b87', 'e08c2376-de12-4303-90c2-f20f05aba42e', '33b5397a-7235-4ff2-b72c-d77949c400b4'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:04:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-681af671-0cdb-467e-88dc-3f96d056312b tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-681af671-0cdb-467e-88dc-3f96d056312b tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-681af671-0cdb-467e-88dc-3f96d056312b tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:04:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-681af671-0cdb-467e-88dc-3f96d056312b tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:04:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-681af671-0cdb-467e-88dc-3f96d056312b tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-681af671-0cdb-467e-88dc-3f96d056312b tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:17 devstack sudo[105758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:04:17 devstack sudo[105758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:17 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-851046a4-b069-45b7-9f09-c91556b6ffc7 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Acquiring lock "cinder-44b4d981-f8d4-4943-af44-ace1269d12e2-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:17 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-851046a4-b069-45b7-9f09-c91556b6ffc7 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Lock "cinder-44b4d981-f8d4-4943-af44-ace1269d12e2-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:17 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-851046a4-b069-45b7-9f09-c91556b6ffc7 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Acquiring lock "cinder-quobyte-44b4d981-f8d4-4943-af44-ace1269d12e2" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:17 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-851046a4-b069-45b7-9f09-c91556b6ffc7 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Lock "cinder-quobyte-44b4d981-f8d4-4943-af44-ace1269d12e2" acquired by "delete_volume" :: waited 0.022s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:17 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:17 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0980af69-c45e-4576-9625-3438df1466b7]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:04:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-851046a4-b069-45b7-9f09-c91556b6ffc7 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-44b4d981-f8d4-4943-af44-ace1269d12e2 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-068910c6-bd3f-4a85-8886-6442a0056ef9 tempest-ProjectReaderTests-1299385716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-457d8c32-c45d-448c-9fc6-7b122e4b644c" returned: 0 in 0.497s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-068910c6-bd3f-4a85-8886-6442a0056ef9 tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-457d8c32-c45d-448c-9fc6-7b122e4b644c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-457d8c32-c45d-448c-9fc6-7b122e4b644c.6664c1ff-a66f-4e32-b799-43c1ae28bca0 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:17 devstack sudo[105764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-457d8c32-c45d-448c-9fc6-7b122e4b644c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-457d8c32-c45d-448c-9fc6-7b122e4b644c.6664c1ff-a66f-4e32-b799-43c1ae28bca0 1G Nov 06 18:04:17 devstack sudo[105764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:17 devstack sudo[105758]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-681af671-0cdb-467e-88dc-3f96d056312b tempest-CreateVolumesFromSourceVolumeTest-633862983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.387s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:17 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-681af671-0cdb-467e-88dc-3f96d056312b tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:04:17 devstack sudo[105763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-44b4d981-f8d4-4943-af44-ace1269d12e2 Nov 06 18:04:17 devstack sudo[105763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:17 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-681af671-0cdb-467e-88dc-3f96d056312b tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Deleted volume successfully. Nov 06 18:04:17 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-681af671-0cdb-467e-88dc-3f96d056312b tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Lock "cinder-6d8315c7-b78d-4369-90e9-7121fac7cbdd-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:17 devstack sudo[105763]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-851046a4-b069-45b7-9f09-c91556b6ffc7 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-44b4d981-f8d4-4943-af44-ace1269d12e2" returned: 0 in 0.414s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-851046a4-b069-45b7-9f09-c91556b6ffc7 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-44b4d981-f8d4-4943-af44-ace1269d12e2 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:17 devstack sudo[105775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-44b4d981-f8d4-4943-af44-ace1269d12e2 Nov 06 18:04:17 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:17 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c8e10b48-8523-4e7a-80f9-ecb9a4fe8518 tempest-ProjectMemberTests-819176810 None] Acquiring lock "cinder-cf903eb3-7c28-4e98-a11a-e982d3fd63b7-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:17 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c8e10b48-8523-4e7a-80f9-ecb9a4fe8518 tempest-ProjectMemberTests-819176810 None] Lock "cinder-cf903eb3-7c28-4e98-a11a-e982d3fd63b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:17 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c8e10b48-8523-4e7a-80f9-ecb9a4fe8518 tempest-ProjectMemberTests-819176810 None] Acquiring lock "cinder-quobyte-a16ec3f3-15f5-48fa-98dc-3e224221b69f" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:17 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c8e10b48-8523-4e7a-80f9-ecb9a4fe8518 tempest-ProjectMemberTests-819176810 None] Lock "cinder-quobyte-a16ec3f3-15f5-48fa-98dc-3e224221b69f" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:17 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c8e10b48-8523-4e7a-80f9-ecb9a4fe8518 tempest-ProjectMemberTests-819176810 None] Acquiring lock "cinder-quobyte-cf903eb3-7c28-4e98-a11a-e982d3fd63b7" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:17 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c8e10b48-8523-4e7a-80f9-ecb9a4fe8518 tempest-ProjectMemberTests-819176810 None] Lock "cinder-quobyte-cf903eb3-7c28-4e98-a11a-e982d3fd63b7" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-c8e10b48-8523-4e7a-80f9-ecb9a4fe8518 tempest-ProjectMemberTests-819176810 None] Deleting offline snapshot cf903eb3-7c28-4e98-a11a-e982d3fd63b7 of volume a16ec3f3-15f5-48fa-98dc-3e224221b69f {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:04:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-c8e10b48-8523-4e7a-80f9-ecb9a4fe8518 tempest-ProjectMemberTests-819176810 None] snapshot_file for this snap is: volume-a16ec3f3-15f5-48fa-98dc-3e224221b69f.cf903eb3-7c28-4e98-a11a-e982d3fd63b7 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:04:17 devstack sudo[105764]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:17 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85375f3-c907-46de-9467-86d05e0ae6b3]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:04:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c8e10b48-8523-4e7a-80f9-ecb9a4fe8518 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a16ec3f3-15f5-48fa-98dc-3e224221b69f.cf903eb3-7c28-4e98-a11a-e982d3fd63b7 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-068910c6-bd3f-4a85-8886-6442a0056ef9 tempest-ProjectReaderTests-1299385716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-457d8c32-c45d-448c-9fc6-7b122e4b644c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-457d8c32-c45d-448c-9fc6-7b122e4b644c.6664c1ff-a66f-4e32-b799-43c1ae28bca0 1G" returned: 0 in 0.583s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-068910c6-bd3f-4a85-8886-6442a0056ef9 tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-457d8c32-c45d-448c-9fc6-7b122e4b644c -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-457d8c32-c45d-448c-9fc6-7b122e4b644c.6664c1ff-a66f-4e32-b799-43c1ae28bca0 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:18 devstack sudo[105778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-457d8c32-c45d-448c-9fc6-7b122e4b644c -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-457d8c32-c45d-448c-9fc6-7b122e4b644c.6664c1ff-a66f-4e32-b799-43c1ae28bca0 Nov 06 18:04:18 devstack sudo[105778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:18 devstack sudo[105777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a16ec3f3-15f5-48fa-98dc-3e224221b69f.cf903eb3-7c28-4e98-a11a-e982d3fd63b7 Nov 06 18:04:18 devstack sudo[105777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:18 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-851046a4-b069-45b7-9f09-c91556b6ffc7 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-44b4d981-f8d4-4943-af44-ace1269d12e2" returned: 0 in 0.353s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:18 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-851046a4-b069-45b7-9f09-c91556b6ffc7 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Lock "cinder-quobyte-44b4d981-f8d4-4943-af44-ace1269d12e2" released by "delete_volume" :: held 0.820s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:18 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-851046a4-b069-45b7-9f09-c91556b6ffc7 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Created reservations ['bd4a1005-ea04-4ecf-89d2-c637452430e0', '2128cea2-11d7-4fec-978f-91818e163248', 'a366b13a-a2c8-4f87-8743-c33ec3b3c45c', 'ec93c7b1-31bb-4447-ae5b-b6c0afa4eae4'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:04:18 devstack sudo[105778]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-068910c6-bd3f-4a85-8886-6442a0056ef9 tempest-ProjectReaderTests-1299385716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-457d8c32-c45d-448c-9fc6-7b122e4b644c -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-457d8c32-c45d-448c-9fc6-7b122e4b644c.6664c1ff-a66f-4e32-b799-43c1ae28bca0" returned: 0 in 0.345s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:18 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-068910c6-bd3f-4a85-8886-6442a0056ef9 tempest-ProjectReaderTests-1299385716 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-457d8c32-c45d-448c-9fc6-7b122e4b644c.6664c1ff-a66f-4e32-b799-43c1ae28bca0 is being set with open permissions: ugo+rw Nov 06 18:04:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-068910c6-bd3f-4a85-8886-6442a0056ef9 tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-457d8c32-c45d-448c-9fc6-7b122e4b644c.6664c1ff-a66f-4e32-b799-43c1ae28bca0 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-851046a4-b069-45b7-9f09-c91556b6ffc7 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-851046a4-b069-45b7-9f09-c91556b6ffc7 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:18 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-851046a4-b069-45b7-9f09-c91556b6ffc7 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:04:18 devstack sudo[105787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-457d8c32-c45d-448c-9fc6-7b122e4b644c.6664c1ff-a66f-4e32-b799-43c1ae28bca0 Nov 06 18:04:18 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:18 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-851046a4-b069-45b7-9f09-c91556b6ffc7 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:04:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-851046a4-b069-45b7-9f09-c91556b6ffc7 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-851046a4-b069-45b7-9f09-c91556b6ffc7 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:18 devstack sudo[105789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:04:18 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:18 devstack sudo[105777]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:18 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ed220119-6947-487c-8b4a-e9d0b6736a94 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Acquiring lock "cinder-b2eea451-9a31-4298-9d88-12c1b446f426-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c8e10b48-8523-4e7a-80f9-ecb9a4fe8518 tempest-ProjectMemberTests-819176810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a16ec3f3-15f5-48fa-98dc-3e224221b69f.cf903eb3-7c28-4e98-a11a-e982d3fd63b7" returned: 0 in 0.514s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:18 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-c8e10b48-8523-4e7a-80f9-ecb9a4fe8518 tempest-ProjectMemberTests-819176810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a16ec3f3-15f5-48fa-98dc-3e224221b69f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:04:18 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ed220119-6947-487c-8b4a-e9d0b6736a94 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Lock "cinder-b2eea451-9a31-4298-9d88-12c1b446f426-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:18 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[76fb734c-b286-4408-9425-c30ffde40a01]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:04:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c8e10b48-8523-4e7a-80f9-ecb9a4fe8518 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a16ec3f3-15f5-48fa-98dc-3e224221b69f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:18 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ed220119-6947-487c-8b4a-e9d0b6736a94 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Acquiring lock "cinder-quobyte-b2eea451-9a31-4298-9d88-12c1b446f426" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:18 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ed220119-6947-487c-8b4a-e9d0b6736a94 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Lock "cinder-quobyte-b2eea451-9a31-4298-9d88-12c1b446f426" acquired by "delete_volume" :: waited 0.034s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:18 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[9639d424-0d23-4a60-90c4-ea8ff1bda1d2]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:04:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ed220119-6947-487c-8b4a-e9d0b6736a94 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b2eea451-9a31-4298-9d88-12c1b446f426 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:18 devstack sudo[105792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a16ec3f3-15f5-48fa-98dc-3e224221b69f Nov 06 18:04:18 devstack sudo[105792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:18 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-068910c6-bd3f-4a85-8886-6442a0056ef9 tempest-ProjectReaderTests-1299385716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-457d8c32-c45d-448c-9fc6-7b122e4b644c.6664c1ff-a66f-4e32-b799-43c1ae28bca0" returned: 0 in 0.379s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:18 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-851046a4-b069-45b7-9f09-c91556b6ffc7 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.345s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:18 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-851046a4-b069-45b7-9f09-c91556b6ffc7 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:04:18 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-851046a4-b069-45b7-9f09-c91556b6ffc7 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Deleted volume successfully. Nov 06 18:04:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-068910c6-bd3f-4a85-8886-6442a0056ef9 tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-457d8c32-c45d-448c-9fc6-7b122e4b644c.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:18 devstack sudo[105797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-457d8c32-c45d-448c-9fc6-7b122e4b644c.info Nov 06 18:04:18 devstack sudo[105797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:18 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-851046a4-b069-45b7-9f09-c91556b6ffc7 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Lock "cinder-44b4d981-f8d4-4943-af44-ace1269d12e2-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:18 devstack sudo[105795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b2eea451-9a31-4298-9d88-12c1b446f426 Nov 06 18:04:18 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:19 devstack sudo[105792]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c8e10b48-8523-4e7a-80f9-ecb9a4fe8518 tempest-ProjectMemberTests-819176810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a16ec3f3-15f5-48fa-98dc-3e224221b69f" returned: 0 in 0.503s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c8e10b48-8523-4e7a-80f9-ecb9a4fe8518 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a16ec3f3-15f5-48fa-98dc-3e224221b69f.cf903eb3-7c28-4e98-a11a-e982d3fd63b7 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:19 devstack sudo[105806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a16ec3f3-15f5-48fa-98dc-3e224221b69f.cf903eb3-7c28-4e98-a11a-e982d3fd63b7 Nov 06 18:04:19 devstack sudo[105806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:19 devstack sudo[105797]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-068910c6-bd3f-4a85-8886-6442a0056ef9 tempest-ProjectReaderTests-1299385716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-457d8c32-c45d-448c-9fc6-7b122e4b644c.info" returned: 0 in 0.350s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:19 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-068910c6-bd3f-4a85-8886-6442a0056ef9 tempest-ProjectReaderTests-1299385716 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-457d8c32-c45d-448c-9fc6-7b122e4b644c.info is being set with open permissions: ugo+rw Nov 06 18:04:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-068910c6-bd3f-4a85-8886-6442a0056ef9 tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-457d8c32-c45d-448c-9fc6-7b122e4b644c.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:19 devstack sudo[105810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-457d8c32-c45d-448c-9fc6-7b122e4b644c.info Nov 06 18:04:19 devstack sudo[105810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:19 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ed220119-6947-487c-8b4a-e9d0b6736a94 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b2eea451-9a31-4298-9d88-12c1b446f426" returned: 0 in 0.474s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ed220119-6947-487c-8b4a-e9d0b6736a94 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b2eea451-9a31-4298-9d88-12c1b446f426 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:19 devstack sudo[105812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b2eea451-9a31-4298-9d88-12c1b446f426 Nov 06 18:04:19 devstack sudo[105812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:19 devstack sudo[105810]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-068910c6-bd3f-4a85-8886-6442a0056ef9 tempest-ProjectReaderTests-1299385716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-457d8c32-c45d-448c-9fc6-7b122e4b644c.info" returned: 0 in 0.301s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-068910c6-bd3f-4a85-8886-6442a0056ef9 tempest-ProjectReaderTests-1299385716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.600s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:19 devstack sudo[105812]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ed220119-6947-487c-8b4a-e9d0b6736a94 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b2eea451-9a31-4298-9d88-12c1b446f426" returned: 0 in 0.304s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:19 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-068910c6-bd3f-4a85-8886-6442a0056ef9 tempest-ProjectReaderTests-1299385716 None] Create snapshot completed successfully Nov 06 18:04:19 devstack sudo[105806]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:19 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ed220119-6947-487c-8b4a-e9d0b6736a94 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Lock "cinder-quobyte-b2eea451-9a31-4298-9d88-12c1b446f426" released by "delete_volume" :: held 0.836s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c8e10b48-8523-4e7a-80f9-ecb9a4fe8518 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a16ec3f3-15f5-48fa-98dc-3e224221b69f.cf903eb3-7c28-4e98-a11a-e982d3fd63b7" returned: 0 in 0.431s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c8e10b48-8523-4e7a-80f9-ecb9a4fe8518 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a16ec3f3-15f5-48fa-98dc-3e224221b69f.cf903eb3-7c28-4e98-a11a-e982d3fd63b7 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:19 devstack sudo[105820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a16ec3f3-15f5-48fa-98dc-3e224221b69f.cf903eb3-7c28-4e98-a11a-e982d3fd63b7 Nov 06 18:04:19 devstack sudo[105820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:19 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-ed220119-6947-487c-8b4a-e9d0b6736a94 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Created reservations ['15586e0d-2645-4be7-b07d-fa4ab3c5481c', '6f4cdd7c-cdb4-4f58-975b-a65b71a8a25f', '5e5b2f38-108d-421e-80d4-5e3cdd525a02', 'c42d5fc3-2e23-4cfc-9f6a-e5b1f106593e'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:04:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ed220119-6947-487c-8b4a-e9d0b6736a94 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ed220119-6947-487c-8b4a-e9d0b6736a94 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:19 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ed220119-6947-487c-8b4a-e9d0b6736a94 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:04:19 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ed220119-6947-487c-8b4a-e9d0b6736a94 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:04:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ed220119-6947-487c-8b4a-e9d0b6736a94 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ed220119-6947-487c-8b4a-e9d0b6736a94 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:19 devstack sudo[105822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:04:19 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:19 devstack sudo[105820]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c8e10b48-8523-4e7a-80f9-ecb9a4fe8518 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a16ec3f3-15f5-48fa-98dc-3e224221b69f.cf903eb3-7c28-4e98-a11a-e982d3fd63b7" returned: 0 in 0.318s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:19 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c8e10b48-8523-4e7a-80f9-ecb9a4fe8518 tempest-ProjectMemberTests-819176810 None] Lock "cinder-quobyte-cf903eb3-7c28-4e98-a11a-e982d3fd63b7" released by "_delete_snapshot" :: held 1.936s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:19 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c8e10b48-8523-4e7a-80f9-ecb9a4fe8518 tempest-ProjectMemberTests-819176810 None] Lock "cinder-quobyte-a16ec3f3-15f5-48fa-98dc-3e224221b69f" released by "delete_snapshot" :: held 1.972s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:19 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-c8e10b48-8523-4e7a-80f9-ecb9a4fe8518 tempest-ProjectMemberTests-819176810 None] Created reservations ['33b88193-f27f-470b-b655-e24125bfbb86', 'e5b4d466-065f-4955-9631-d316ed595276', '83e3b799-1e01-47dc-9b83-c3752b79174e', '45073e8c-c35d-4d7d-b65c-0adb1c5fcb1d'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:04:19 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ed220119-6947-487c-8b4a-e9d0b6736a94 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.283s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:19 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-ed220119-6947-487c-8b4a-e9d0b6736a94 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:04:19 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-ed220119-6947-487c-8b4a-e9d0b6736a94 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Deleted volume successfully. Nov 06 18:04:19 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ed220119-6947-487c-8b4a-e9d0b6736a94 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Lock "cinder-b2eea451-9a31-4298-9d88-12c1b446f426-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:20 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-c8e10b48-8523-4e7a-80f9-ecb9a4fe8518 tempest-ProjectMemberTests-819176810 None] Delete snapshot completed successfully. Nov 06 18:04:20 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c8e10b48-8523-4e7a-80f9-ecb9a4fe8518 tempest-ProjectMemberTests-819176810 None] Lock "cinder-cf903eb3-7c28-4e98-a11a-e982d3fd63b7-delete_snapshot" released by "delete_snapshot" :: held 2.161s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:20 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-60f0a3ce-fd46-4146-bca9-b1276dcdfce0 tempest-ProjectReaderTests-1299385716 None] Acquiring lock "cinder-6664c1ff-a66f-4e32-b799-43c1ae28bca0-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:20 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-60f0a3ce-fd46-4146-bca9-b1276dcdfce0 tempest-ProjectReaderTests-1299385716 None] Lock "cinder-6664c1ff-a66f-4e32-b799-43c1ae28bca0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:20 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-60f0a3ce-fd46-4146-bca9-b1276dcdfce0 tempest-ProjectReaderTests-1299385716 None] Acquiring lock "cinder-quobyte-457d8c32-c45d-448c-9fc6-7b122e4b644c" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:20 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-60f0a3ce-fd46-4146-bca9-b1276dcdfce0 tempest-ProjectReaderTests-1299385716 None] Lock "cinder-quobyte-457d8c32-c45d-448c-9fc6-7b122e4b644c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:20 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-60f0a3ce-fd46-4146-bca9-b1276dcdfce0 tempest-ProjectReaderTests-1299385716 None] Acquiring lock "cinder-quobyte-6664c1ff-a66f-4e32-b799-43c1ae28bca0" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:20 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-60f0a3ce-fd46-4146-bca9-b1276dcdfce0 tempest-ProjectReaderTests-1299385716 None] Lock "cinder-quobyte-6664c1ff-a66f-4e32-b799-43c1ae28bca0" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-60f0a3ce-fd46-4146-bca9-b1276dcdfce0 tempest-ProjectReaderTests-1299385716 None] Deleting offline snapshot 6664c1ff-a66f-4e32-b799-43c1ae28bca0 of volume 457d8c32-c45d-448c-9fc6-7b122e4b644c {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:04:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-60f0a3ce-fd46-4146-bca9-b1276dcdfce0 tempest-ProjectReaderTests-1299385716 None] snapshot_file for this snap is: volume-457d8c32-c45d-448c-9fc6-7b122e4b644c.6664c1ff-a66f-4e32-b799-43c1ae28bca0 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:04:20 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f7da59-8fc5-44d2-8a56-0a5a1c53325e]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:04:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-60f0a3ce-fd46-4146-bca9-b1276dcdfce0 tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-457d8c32-c45d-448c-9fc6-7b122e4b644c.6664c1ff-a66f-4e32-b799-43c1ae28bca0 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:20 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-47cfe6c1-0a36-43e6-ac1a-88ec2804008f tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Acquiring lock "cinder-372b17fe-5474-4d98-b16d-77631ab03d9c-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:20 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-47cfe6c1-0a36-43e6-ac1a-88ec2804008f tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Lock "cinder-372b17fe-5474-4d98-b16d-77631ab03d9c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:20 devstack sudo[105826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-457d8c32-c45d-448c-9fc6-7b122e4b644c.6664c1ff-a66f-4e32-b799-43c1ae28bca0 Nov 06 18:04:20 devstack sudo[105826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:20 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-47cfe6c1-0a36-43e6-ac1a-88ec2804008f tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Acquiring lock "cinder-quobyte-372b17fe-5474-4d98-b16d-77631ab03d9c" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:20 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-47cfe6c1-0a36-43e6-ac1a-88ec2804008f tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Lock "cinder-quobyte-372b17fe-5474-4d98-b16d-77631ab03d9c" acquired by "delete_volume" :: waited 0.015s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:20 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aea016b-b702-4c5f-ba29-64f01d15b5a5]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:04:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-47cfe6c1-0a36-43e6-ac1a-88ec2804008f tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-372b17fe-5474-4d98-b16d-77631ab03d9c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:20 devstack sudo[105828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-372b17fe-5474-4d98-b16d-77631ab03d9c Nov 06 18:04:20 devstack sudo[105828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c136154b-a2b3-47a8-b411-591e1db3ace3 tempest-ProjectMemberTests-819176810 None] Acquiring lock "cinder-a16ec3f3-15f5-48fa-98dc-3e224221b69f-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c136154b-a2b3-47a8-b411-591e1db3ace3 tempest-ProjectMemberTests-819176810 None] Lock "cinder-a16ec3f3-15f5-48fa-98dc-3e224221b69f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:21 devstack sudo[105826]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-60f0a3ce-fd46-4146-bca9-b1276dcdfce0 tempest-ProjectReaderTests-1299385716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-457d8c32-c45d-448c-9fc6-7b122e4b644c.6664c1ff-a66f-4e32-b799-43c1ae28bca0" returned: 0 in 0.482s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:21 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-60f0a3ce-fd46-4146-bca9-b1276dcdfce0 tempest-ProjectReaderTests-1299385716 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-457d8c32-c45d-448c-9fc6-7b122e4b644c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:04:21 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce88a68-0277-4401-abf8-be8b2146021f]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:04:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-60f0a3ce-fd46-4146-bca9-b1276dcdfce0 tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-457d8c32-c45d-448c-9fc6-7b122e4b644c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c136154b-a2b3-47a8-b411-591e1db3ace3 tempest-ProjectMemberTests-819176810 None] Acquiring lock "cinder-quobyte-a16ec3f3-15f5-48fa-98dc-3e224221b69f" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c136154b-a2b3-47a8-b411-591e1db3ace3 tempest-ProjectMemberTests-819176810 None] Lock "cinder-quobyte-a16ec3f3-15f5-48fa-98dc-3e224221b69f" acquired by "delete_volume" :: waited 0.024s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:21 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b51a54-dbb3-4ba4-86fd-f859cfe482c2]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:04:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c136154b-a2b3-47a8-b411-591e1db3ace3 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a16ec3f3-15f5-48fa-98dc-3e224221b69f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:21 devstack sudo[105834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-457d8c32-c45d-448c-9fc6-7b122e4b644c Nov 06 18:04:21 devstack sudo[105834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:21 devstack sudo[105828]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-47cfe6c1-0a36-43e6-ac1a-88ec2804008f tempest-CreateVolumesFromSourceVolumeTest-633862983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-372b17fe-5474-4d98-b16d-77631ab03d9c" returned: 0 in 0.466s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-47cfe6c1-0a36-43e6-ac1a-88ec2804008f tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-372b17fe-5474-4d98-b16d-77631ab03d9c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:21 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-372b17fe-5474-4d98-b16d-77631ab03d9c Nov 06 18:04:21 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:21 devstack sudo[105838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a16ec3f3-15f5-48fa-98dc-3e224221b69f Nov 06 18:04:21 devstack sudo[105838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:21 devstack sudo[105834]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-60f0a3ce-fd46-4146-bca9-b1276dcdfce0 tempest-ProjectReaderTests-1299385716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-457d8c32-c45d-448c-9fc6-7b122e4b644c" returned: 0 in 0.424s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-60f0a3ce-fd46-4146-bca9-b1276dcdfce0 tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-457d8c32-c45d-448c-9fc6-7b122e4b644c.6664c1ff-a66f-4e32-b799-43c1ae28bca0 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:21 devstack sudo[105847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-457d8c32-c45d-448c-9fc6-7b122e4b644c.6664c1ff-a66f-4e32-b799-43c1ae28bca0 Nov 06 18:04:21 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:21 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-47cfe6c1-0a36-43e6-ac1a-88ec2804008f tempest-CreateVolumesFromSourceVolumeTest-633862983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-372b17fe-5474-4d98-b16d-77631ab03d9c" returned: 0 in 0.351s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-47cfe6c1-0a36-43e6-ac1a-88ec2804008f tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Lock "cinder-quobyte-372b17fe-5474-4d98-b16d-77631ab03d9c" released by "delete_volume" :: held 0.879s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:21 devstack sudo[105838]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c136154b-a2b3-47a8-b411-591e1db3ace3 tempest-ProjectMemberTests-819176810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a16ec3f3-15f5-48fa-98dc-3e224221b69f" returned: 0 in 0.476s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c136154b-a2b3-47a8-b411-591e1db3ace3 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a16ec3f3-15f5-48fa-98dc-3e224221b69f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:21 devstack sudo[105854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a16ec3f3-15f5-48fa-98dc-3e224221b69f Nov 06 18:04:21 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:21 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-47cfe6c1-0a36-43e6-ac1a-88ec2804008f tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Created reservations ['286da67d-ef8d-4cb1-baad-085e6e056b8b', 'd13415d0-2ee0-4396-90f9-c015705607bb', '37e5afbb-e527-446c-8e56-81cdac1d02c0', 'd0dfe46f-d576-42b6-9a2d-15b5ecb7f9f1'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:04:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-47cfe6c1-0a36-43e6-ac1a-88ec2804008f tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-47cfe6c1-0a36-43e6-ac1a-88ec2804008f tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:21 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-47cfe6c1-0a36-43e6-ac1a-88ec2804008f tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:04:21 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-47cfe6c1-0a36-43e6-ac1a-88ec2804008f tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:04:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-47cfe6c1-0a36-43e6-ac1a-88ec2804008f tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-47cfe6c1-0a36-43e6-ac1a-88ec2804008f tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:21 devstack sudo[105858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:04:21 devstack sudo[105858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4254b754-aa12-4fbf-a261-03f14e34c0c1 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Acquiring lock "cinder-257ead5d-838e-4942-8c6a-e9ff20960469-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:22 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4254b754-aa12-4fbf-a261-03f14e34c0c1 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Lock "cinder-257ead5d-838e-4942-8c6a-e9ff20960469-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:22 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4254b754-aa12-4fbf-a261-03f14e34c0c1 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Acquiring lock "cinder-quobyte-257ead5d-838e-4942-8c6a-e9ff20960469" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:22 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:22 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c136154b-a2b3-47a8-b411-591e1db3ace3 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a16ec3f3-15f5-48fa-98dc-3e224221b69f" returned: 0 in 0.392s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:22 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4254b754-aa12-4fbf-a261-03f14e34c0c1 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Lock "cinder-quobyte-257ead5d-838e-4942-8c6a-e9ff20960469" acquired by "delete_volume" :: waited 0.048s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-60f0a3ce-fd46-4146-bca9-b1276dcdfce0 tempest-ProjectReaderTests-1299385716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-457d8c32-c45d-448c-9fc6-7b122e4b644c.6664c1ff-a66f-4e32-b799-43c1ae28bca0" returned: 0 in 0.577s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-60f0a3ce-fd46-4146-bca9-b1276dcdfce0 tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-457d8c32-c45d-448c-9fc6-7b122e4b644c.6664c1ff-a66f-4e32-b799-43c1ae28bca0 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:22 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[accd0041-525c-4fb5-82aa-9ac8fce117a4]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:04:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4254b754-aa12-4fbf-a261-03f14e34c0c1 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-257ead5d-838e-4942-8c6a-e9ff20960469 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:22 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-457d8c32-c45d-448c-9fc6-7b122e4b644c.6664c1ff-a66f-4e32-b799-43c1ae28bca0 Nov 06 18:04:22 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:22 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c136154b-a2b3-47a8-b411-591e1db3ace3 tempest-ProjectMemberTests-819176810 None] Lock "cinder-quobyte-a16ec3f3-15f5-48fa-98dc-3e224221b69f" released by "delete_volume" :: held 1.021s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:22 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-c136154b-a2b3-47a8-b411-591e1db3ace3 tempest-ProjectMemberTests-819176810 None] Created reservations ['99c45e3c-023a-4e34-bda7-892202f2eea7', '952ace2e-f938-4b85-a9a4-b905fc103fd9', '13b7a8ff-0831-49ba-bf1e-a6fa3c6a0c17', 'f4e7fee1-0738-44b0-a43a-061e0008322b'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:04:22 devstack sudo[105858]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:22 devstack sudo[105865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-257ead5d-838e-4942-8c6a-e9ff20960469 Nov 06 18:04:22 devstack sudo[105865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-47cfe6c1-0a36-43e6-ac1a-88ec2804008f tempest-CreateVolumesFromSourceVolumeTest-633862983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.499s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:22 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-47cfe6c1-0a36-43e6-ac1a-88ec2804008f tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:04:22 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-47cfe6c1-0a36-43e6-ac1a-88ec2804008f tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Deleted volume successfully. Nov 06 18:04:22 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-47cfe6c1-0a36-43e6-ac1a-88ec2804008f tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Lock "cinder-372b17fe-5474-4d98-b16d-77631ab03d9c-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c136154b-a2b3-47a8-b411-591e1db3ace3 tempest-ProjectMemberTests-819176810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c136154b-a2b3-47a8-b411-591e1db3ace3 tempest-ProjectMemberTests-819176810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:22 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c136154b-a2b3-47a8-b411-591e1db3ace3 tempest-ProjectMemberTests-819176810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:04:22 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c136154b-a2b3-47a8-b411-591e1db3ace3 tempest-ProjectMemberTests-819176810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:04:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c136154b-a2b3-47a8-b411-591e1db3ace3 tempest-ProjectMemberTests-819176810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c136154b-a2b3-47a8-b411-591e1db3ace3 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:22 devstack sudo[105868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:04:22 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:22 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-60f0a3ce-fd46-4146-bca9-b1276dcdfce0 tempest-ProjectReaderTests-1299385716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-457d8c32-c45d-448c-9fc6-7b122e4b644c.6664c1ff-a66f-4e32-b799-43c1ae28bca0" returned: 0 in 0.400s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:22 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-60f0a3ce-fd46-4146-bca9-b1276dcdfce0 tempest-ProjectReaderTests-1299385716 None] Lock "cinder-quobyte-6664c1ff-a66f-4e32-b799-43c1ae28bca0" released by "_delete_snapshot" :: held 2.016s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:22 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-60f0a3ce-fd46-4146-bca9-b1276dcdfce0 tempest-ProjectReaderTests-1299385716 None] Lock "cinder-quobyte-457d8c32-c45d-448c-9fc6-7b122e4b644c" released by "delete_snapshot" :: held 2.044s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:22 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-60f0a3ce-fd46-4146-bca9-b1276dcdfce0 tempest-ProjectReaderTests-1299385716 None] Created reservations ['21638f65-ed68-4339-938c-15fb7f331b93', 'ad8470ab-9a59-46df-9008-5462705554df', '24f33d3e-1071-40ec-bced-e18ae6ba20f5', 'eb3bc619-1397-4546-8adf-9c0f6dbae510'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:04:22 devstack sudo[105865]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4254b754-aa12-4fbf-a261-03f14e34c0c1 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-257ead5d-838e-4942-8c6a-e9ff20960469" returned: 0 in 0.523s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4254b754-aa12-4fbf-a261-03f14e34c0c1 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-257ead5d-838e-4942-8c6a-e9ff20960469 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:22 devstack sudo[105876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-257ead5d-838e-4942-8c6a-e9ff20960469 Nov 06 18:04:22 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:22 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-60f0a3ce-fd46-4146-bca9-b1276dcdfce0 tempest-ProjectReaderTests-1299385716 None] Delete snapshot completed successfully. Nov 06 18:04:22 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-60f0a3ce-fd46-4146-bca9-b1276dcdfce0 tempest-ProjectReaderTests-1299385716 None] Lock "cinder-6664c1ff-a66f-4e32-b799-43c1ae28bca0-delete_snapshot" released by "delete_snapshot" :: held 2.231s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:22 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c136154b-a2b3-47a8-b411-591e1db3ace3 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.347s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:22 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-c136154b-a2b3-47a8-b411-591e1db3ace3 tempest-ProjectMemberTests-819176810 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:04:22 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-c136154b-a2b3-47a8-b411-591e1db3ace3 tempest-ProjectMemberTests-819176810 None] Deleted volume successfully. Nov 06 18:04:22 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c136154b-a2b3-47a8-b411-591e1db3ace3 tempest-ProjectMemberTests-819176810 None] Lock "cinder-a16ec3f3-15f5-48fa-98dc-3e224221b69f-delete_volume" released by "delete_volume" :: held 1.749s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:23 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4254b754-aa12-4fbf-a261-03f14e34c0c1 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-257ead5d-838e-4942-8c6a-e9ff20960469" returned: 0 in 0.295s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:23 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4254b754-aa12-4fbf-a261-03f14e34c0c1 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Lock "cinder-quobyte-257ead5d-838e-4942-8c6a-e9ff20960469" released by "delete_volume" :: held 0.888s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:23 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-4254b754-aa12-4fbf-a261-03f14e34c0c1 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Created reservations ['5435abd9-debe-4396-8493-5a1f6e4f396b', '61423a7c-6c4b-4eb6-8eea-40d397e5db16', '51e508dd-aecd-4139-bc87-40ee1685ff39', '0b3f7022-1f91-4982-a7f3-c8df5a9a4ea4'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:04:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4254b754-aa12-4fbf-a261-03f14e34c0c1 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4254b754-aa12-4fbf-a261-03f14e34c0c1 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:23 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4254b754-aa12-4fbf-a261-03f14e34c0c1 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:04:23 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4254b754-aa12-4fbf-a261-03f14e34c0c1 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:04:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4254b754-aa12-4fbf-a261-03f14e34c0c1 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4254b754-aa12-4fbf-a261-03f14e34c0c1 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:23 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:04:23 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:23 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4254b754-aa12-4fbf-a261-03f14e34c0c1 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.283s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:23 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-4254b754-aa12-4fbf-a261-03f14e34c0c1 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:04:23 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-4254b754-aa12-4fbf-a261-03f14e34c0c1 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Deleted volume successfully. Nov 06 18:04:23 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4254b754-aa12-4fbf-a261-03f14e34c0c1 tempest-CreateVolumesFromSourceVolumeTest-633862983 None] Lock "cinder-257ead5d-838e-4942-8c6a-e9ff20960469-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:23 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-18acdf60-89a3-4b50-a36f-18967bac0cdd tempest-ProjectReaderTests-1299385716 None] Acquiring lock "cinder-457d8c32-c45d-448c-9fc6-7b122e4b644c-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:23 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-18acdf60-89a3-4b50-a36f-18967bac0cdd tempest-ProjectReaderTests-1299385716 None] Lock "cinder-457d8c32-c45d-448c-9fc6-7b122e4b644c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:23 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-18acdf60-89a3-4b50-a36f-18967bac0cdd tempest-ProjectReaderTests-1299385716 None] Acquiring lock "cinder-quobyte-457d8c32-c45d-448c-9fc6-7b122e4b644c" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:23 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-18acdf60-89a3-4b50-a36f-18967bac0cdd tempest-ProjectReaderTests-1299385716 None] Lock "cinder-quobyte-457d8c32-c45d-448c-9fc6-7b122e4b644c" acquired by "delete_volume" :: waited 0.017s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:23 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[502b4832-f193-489d-a750-86508e3509de]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:04:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-18acdf60-89a3-4b50-a36f-18967bac0cdd tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-457d8c32-c45d-448c-9fc6-7b122e4b644c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:24 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-95ddc0a4-b781-4d3f-a412-d3c8cfa20e9d tempest-ProjectMemberTests-819176810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:04:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-95ddc0a4-b781-4d3f-a412-d3c8cfa20e9d tempest-ProjectMemberTests-819176810 None] Flow 'volume_create_manager' (cf0b1f9b-3e90-4230-80f6-cb1030a636e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:04:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-95ddc0a4-b781-4d3f-a412-d3c8cfa20e9d tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ba13888-2b3e-4047-9e83-2ca486339990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:24 devstack sudo[105883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-457d8c32-c45d-448c-9fc6-7b122e4b644c Nov 06 18:04:24 devstack sudo[105883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-95ddc0a4-b781-4d3f-a412-d3c8cfa20e9d tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ba13888-2b3e-4047-9e83-2ca486339990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:04:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2090539486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6fe61d4-745d-4d07-8ef6-e3afce103739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b97cd7ef94764995a9e8c62cda23171f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:04:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:04:24Z,use_quota=True,user_id='a34e6465a98c4c289547d49a900a6bde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-95ddc0a4-b781-4d3f-a412-d3c8cfa20e9d tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4809e964-a083-458c-816f-99988db62da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-95ddc0a4-b781-4d3f-a412-d3c8cfa20e9d tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4809e964-a083-458c-816f-99988db62da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-95ddc0a4-b781-4d3f-a412-d3c8cfa20e9d tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b64a0468-3863-4ecb-9251-ef21700b5034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-95ddc0a4-b781-4d3f-a412-d3c8cfa20e9d tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b64a0468-3863-4ecb-9251-ef21700b5034) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6fe61d4-745d-4d07-8ef6-e3afce103739', 'volume_name': 'volume-f6fe61d4-745d-4d07-8ef6-e3afce103739', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-95ddc0a4-b781-4d3f-a412-d3c8cfa20e9d tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc1695a9-7e1e-4497-a62d-61642397a563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-95ddc0a4-b781-4d3f-a412-d3c8cfa20e9d tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc1695a9-7e1e-4497-a62d-61642397a563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-95ddc0a4-b781-4d3f-a412-d3c8cfa20e9d tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f980b1c5-ee86-47f8-812f-d4a6dfb41c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:24 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-95ddc0a4-b781-4d3f-a412-d3c8cfa20e9d tempest-ProjectMemberTests-819176810 None] Volume f6fe61d4-745d-4d07-8ef6-e3afce103739: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6fe61d4-745d-4d07-8ef6-e3afce103739', 'volume_size': 1} Nov 06 18:04:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-95ddc0a4-b781-4d3f-a412-d3c8cfa20e9d tempest-ProjectMemberTests-819176810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-95ddc0a4-b781-4d3f-a412-d3c8cfa20e9d tempest-ProjectMemberTests-819176810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:24 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-95ddc0a4-b781-4d3f-a412-d3c8cfa20e9d tempest-ProjectMemberTests-819176810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:04:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2090539486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6fe61d4-745d-4d07-8ef6-e3afce103739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b97cd7ef94764995a9e8c62cda23171f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:04:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:04:24Z,use_quota=True,user_id='a34e6465a98c4c289547d49a900a6bde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:04:24 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-95ddc0a4-b781-4d3f-a412-d3c8cfa20e9d tempest-ProjectMemberTests-819176810 None] Creating volume f6fe61d4-745d-4d07-8ef6-e3afce103739 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:04:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-95ddc0a4-b781-4d3f-a412-d3c8cfa20e9d tempest-ProjectMemberTests-819176810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-95ddc0a4-b781-4d3f-a412-d3c8cfa20e9d tempest-ProjectMemberTests-819176810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:24 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-95ddc0a4-b781-4d3f-a412-d3c8cfa20e9d tempest-ProjectMemberTests-819176810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:04:24 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-95ddc0a4-b781-4d3f-a412-d3c8cfa20e9d tempest-ProjectMemberTests-819176810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:04:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-95ddc0a4-b781-4d3f-a412-d3c8cfa20e9d tempest-ProjectMemberTests-819176810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:24 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-95ddc0a4-b781-4d3f-a412-d3c8cfa20e9d tempest-ProjectMemberTests-819176810 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:04:24 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-95ddc0a4-b781-4d3f-a412-d3c8cfa20e9d tempest-ProjectMemberTests-819176810 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:04:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-95ddc0a4-b781-4d3f-a412-d3c8cfa20e9d tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f6fe61d4-745d-4d07-8ef6-e3afce103739 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:24 devstack sudo[105885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f6fe61d4-745d-4d07-8ef6-e3afce103739 1073741824 Nov 06 18:04:24 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:24 devstack sudo[105883]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-18acdf60-89a3-4b50-a36f-18967bac0cdd tempest-ProjectReaderTests-1299385716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-457d8c32-c45d-448c-9fc6-7b122e4b644c" returned: 0 in 0.509s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-18acdf60-89a3-4b50-a36f-18967bac0cdd tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-457d8c32-c45d-448c-9fc6-7b122e4b644c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:24 devstack sudo[105892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-457d8c32-c45d-448c-9fc6-7b122e4b644c Nov 06 18:04:24 devstack sudo[105892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:24 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-95ddc0a4-b781-4d3f-a412-d3c8cfa20e9d tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f6fe61d4-745d-4d07-8ef6-e3afce103739 1073741824" returned: 0 in 0.582s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:24 devstack sudo[105892]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-18acdf60-89a3-4b50-a36f-18967bac0cdd tempest-ProjectReaderTests-1299385716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-457d8c32-c45d-448c-9fc6-7b122e4b644c" returned: 0 in 0.305s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:24 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-18acdf60-89a3-4b50-a36f-18967bac0cdd tempest-ProjectReaderTests-1299385716 None] Lock "cinder-quobyte-457d8c32-c45d-448c-9fc6-7b122e4b644c" released by "delete_volume" :: held 0.922s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-95ddc0a4-b781-4d3f-a412-d3c8cfa20e9d tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f6fe61d4-745d-4d07-8ef6-e3afce103739 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:24 devstack sudo[105898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f6fe61d4-745d-4d07-8ef6-e3afce103739 Nov 06 18:04:24 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:24 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-18acdf60-89a3-4b50-a36f-18967bac0cdd tempest-ProjectReaderTests-1299385716 None] Created reservations ['e2cc1d3e-e4cd-4473-8380-be5d8a2653cd', '3f1899a0-79dc-4475-8ed0-ea6cd60c337f', '07bd1029-e09b-4ebe-b7e8-107b9e21b909', 'c0d46e21-efc9-4f59-9898-5a6407f2a6ac'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:04:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-18acdf60-89a3-4b50-a36f-18967bac0cdd tempest-ProjectReaderTests-1299385716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-18acdf60-89a3-4b50-a36f-18967bac0cdd tempest-ProjectReaderTests-1299385716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:25 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-18acdf60-89a3-4b50-a36f-18967bac0cdd tempest-ProjectReaderTests-1299385716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:04:25 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-18acdf60-89a3-4b50-a36f-18967bac0cdd tempest-ProjectReaderTests-1299385716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:04:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-18acdf60-89a3-4b50-a36f-18967bac0cdd tempest-ProjectReaderTests-1299385716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-18acdf60-89a3-4b50-a36f-18967bac0cdd tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:25 devstack sudo[105900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:04:25 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:25 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-95ddc0a4-b781-4d3f-a412-d3c8cfa20e9d tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f6fe61d4-745d-4d07-8ef6-e3afce103739" returned: 0 in 0.375s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:25 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-95ddc0a4-b781-4d3f-a412-d3c8cfa20e9d tempest-ProjectMemberTests-819176810 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:04:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-95ddc0a4-b781-4d3f-a412-d3c8cfa20e9d tempest-ProjectMemberTests-819176810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-95ddc0a4-b781-4d3f-a412-d3c8cfa20e9d tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f980b1c5-ee86-47f8-812f-d4a6dfb41c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6fe61d4-745d-4d07-8ef6-e3afce103739', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-95ddc0a4-b781-4d3f-a412-d3c8cfa20e9d tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f873b4fc-7b2d-47fa-94b4-dd80c498c95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:25 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-95ddc0a4-b781-4d3f-a412-d3c8cfa20e9d tempest-ProjectMemberTests-819176810 None] Volume volume-f6fe61d4-745d-4d07-8ef6-e3afce103739 (f6fe61d4-745d-4d07-8ef6-e3afce103739): created successfully Nov 06 18:04:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-95ddc0a4-b781-4d3f-a412-d3c8cfa20e9d tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f873b4fc-7b2d-47fa-94b4-dd80c498c95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-95ddc0a4-b781-4d3f-a412-d3c8cfa20e9d tempest-ProjectMemberTests-819176810 None] Flow 'volume_create_manager' (cf0b1f9b-3e90-4230-80f6-cb1030a636e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:04:25 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-95ddc0a4-b781-4d3f-a412-d3c8cfa20e9d tempest-ProjectMemberTests-819176810 None] Created volume successfully. Nov 06 18:04:25 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-18acdf60-89a3-4b50-a36f-18967bac0cdd tempest-ProjectReaderTests-1299385716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.272s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:25 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-18acdf60-89a3-4b50-a36f-18967bac0cdd tempest-ProjectReaderTests-1299385716 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:04:25 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-18acdf60-89a3-4b50-a36f-18967bac0cdd tempest-ProjectReaderTests-1299385716 None] Deleted volume successfully. Nov 06 18:04:25 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-18acdf60-89a3-4b50-a36f-18967bac0cdd tempest-ProjectReaderTests-1299385716 None] Lock "cinder-457d8c32-c45d-448c-9fc6-7b122e4b644c-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-84799dc6-9c80-4d69-8e82-2f37d60d93b1 tempest-ProjectMemberTests-819176810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-84799dc6-9c80-4d69-8e82-2f37d60d93b1 tempest-ProjectMemberTests-819176810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:26 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-84799dc6-9c80-4d69-8e82-2f37d60d93b1 tempest-ProjectMemberTests-819176810 None] Creating offline snapshot ee3f516f-b090-4761-b861-08c2b46fdba7 of volume f6fe61d4-745d-4d07-8ef6-e3afce103739 {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:04:26 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5642e86-26c5-4529-ae4c-3ceeabe112ff]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:04:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-84799dc6-9c80-4d69-8e82-2f37d60d93b1 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f6fe61d4-745d-4d07-8ef6-e3afce103739 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:26 devstack sudo[105904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f6fe61d4-745d-4d07-8ef6-e3afce103739 Nov 06 18:04:26 devstack sudo[105904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:26 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-665f5641-b1d5-46c0-b7fd-6eaad55433a5 tempest-ProjectReaderTests-1299385716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:04:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-665f5641-b1d5-46c0-b7fd-6eaad55433a5 tempest-ProjectReaderTests-1299385716 None] Flow 'volume_create_manager' (ba6a505b-7c8f-437d-93c2-ad645b3999a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:04:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-665f5641-b1d5-46c0-b7fd-6eaad55433a5 tempest-ProjectReaderTests-1299385716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c2e983f-86ae-4ce4-b6b0-55653158d00c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-665f5641-b1d5-46c0-b7fd-6eaad55433a5 tempest-ProjectReaderTests-1299385716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c2e983f-86ae-4ce4-b6b0-55653158d00c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:04:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-241228711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17248a46-07d8-49d4-9866-8be9c51f3a1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c5284ac37ff4d179815435f871ca0fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:04:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:04:27Z,use_quota=True,user_id='caa4f376bb65466cba7edd807cf24033',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-665f5641-b1d5-46c0-b7fd-6eaad55433a5 tempest-ProjectReaderTests-1299385716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52a70408-9521-45f0-b0f2-b652b3fcf186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-665f5641-b1d5-46c0-b7fd-6eaad55433a5 tempest-ProjectReaderTests-1299385716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52a70408-9521-45f0-b0f2-b652b3fcf186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-665f5641-b1d5-46c0-b7fd-6eaad55433a5 tempest-ProjectReaderTests-1299385716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b48ae33d-1f36-4b4d-b300-9cbfad202136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-665f5641-b1d5-46c0-b7fd-6eaad55433a5 tempest-ProjectReaderTests-1299385716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b48ae33d-1f36-4b4d-b300-9cbfad202136) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17248a46-07d8-49d4-9866-8be9c51f3a1b', 'volume_name': 'volume-17248a46-07d8-49d4-9866-8be9c51f3a1b', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-665f5641-b1d5-46c0-b7fd-6eaad55433a5 tempest-ProjectReaderTests-1299385716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c416d53-96c8-4890-b953-45a607d52437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-665f5641-b1d5-46c0-b7fd-6eaad55433a5 tempest-ProjectReaderTests-1299385716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c416d53-96c8-4890-b953-45a607d52437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-665f5641-b1d5-46c0-b7fd-6eaad55433a5 tempest-ProjectReaderTests-1299385716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf343817-d0b7-42ae-8fee-2c0530647bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:26 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-665f5641-b1d5-46c0-b7fd-6eaad55433a5 tempest-ProjectReaderTests-1299385716 None] Volume 17248a46-07d8-49d4-9866-8be9c51f3a1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17248a46-07d8-49d4-9866-8be9c51f3a1b', 'volume_size': 1} Nov 06 18:04:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-665f5641-b1d5-46c0-b7fd-6eaad55433a5 tempest-ProjectReaderTests-1299385716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:26 devstack sudo[105904]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-84799dc6-9c80-4d69-8e82-2f37d60d93b1 tempest-ProjectMemberTests-819176810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f6fe61d4-745d-4d07-8ef6-e3afce103739" returned: 0 in 0.516s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-84799dc6-9c80-4d69-8e82-2f37d60d93b1 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f6fe61d4-745d-4d07-8ef6-e3afce103739,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f6fe61d4-745d-4d07-8ef6-e3afce103739.ee3f516f-b090-4761-b861-08c2b46fdba7 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:27 devstack sudo[105909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f6fe61d4-745d-4d07-8ef6-e3afce103739,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f6fe61d4-745d-4d07-8ef6-e3afce103739.ee3f516f-b090-4761-b861-08c2b46fdba7 1G Nov 06 18:04:27 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:27 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-742ac3a7-a37c-41c8-abb8-6844aafc2672 tempest-CinderUnicodeTest-1465938524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:04:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-742ac3a7-a37c-41c8-abb8-6844aafc2672 tempest-CinderUnicodeTest-1465938524 None] Flow 'volume_create_manager' (8e1f739e-4688-495d-a5da-002852609386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:04:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-742ac3a7-a37c-41c8-abb8-6844aafc2672 tempest-CinderUnicodeTest-1465938524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcd088b3-3ffa-447d-b41b-c44ad63fb4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-742ac3a7-a37c-41c8-abb8-6844aafc2672 tempest-CinderUnicodeTest-1465938524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcd088b3-3ffa-447d-b41b-c44ad63fb4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:04:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59978153-84d8-44ee-a003-1430734edb46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35e6527f7c994dbd801a2dae3f063817',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:04:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:04:27Z,use_quota=True,user_id='b6f42ae27516423fae35994351dc2a47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-742ac3a7-a37c-41c8-abb8-6844aafc2672 tempest-CinderUnicodeTest-1465938524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8be3b01-9b51-4b2b-b15a-2f8e07da2ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-742ac3a7-a37c-41c8-abb8-6844aafc2672 tempest-CinderUnicodeTest-1465938524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8be3b01-9b51-4b2b-b15a-2f8e07da2ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-742ac3a7-a37c-41c8-abb8-6844aafc2672 tempest-CinderUnicodeTest-1465938524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5e4953f-a18b-4225-bc43-ae15d2b75011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-742ac3a7-a37c-41c8-abb8-6844aafc2672 tempest-CinderUnicodeTest-1465938524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5e4953f-a18b-4225-bc43-ae15d2b75011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59978153-84d8-44ee-a003-1430734edb46', 'volume_name': 'volume-59978153-84d8-44ee-a003-1430734edb46', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-742ac3a7-a37c-41c8-abb8-6844aafc2672 tempest-CinderUnicodeTest-1465938524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77f2fbb5-90fe-447a-88f5-18f8cab66df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-742ac3a7-a37c-41c8-abb8-6844aafc2672 tempest-CinderUnicodeTest-1465938524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77f2fbb5-90fe-447a-88f5-18f8cab66df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-742ac3a7-a37c-41c8-abb8-6844aafc2672 tempest-CinderUnicodeTest-1465938524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8944ee33-5897-4d7a-a544-d499fb4e52e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:27 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-742ac3a7-a37c-41c8-abb8-6844aafc2672 tempest-CinderUnicodeTest-1465938524 None] Volume 59978153-84d8-44ee-a003-1430734edb46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59978153-84d8-44ee-a003-1430734edb46', 'volume_size': 1} Nov 06 18:04:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-742ac3a7-a37c-41c8-abb8-6844aafc2672 tempest-CinderUnicodeTest-1465938524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:27 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-84799dc6-9c80-4d69-8e82-2f37d60d93b1 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f6fe61d4-745d-4d07-8ef6-e3afce103739,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f6fe61d4-745d-4d07-8ef6-e3afce103739.ee3f516f-b090-4761-b861-08c2b46fdba7 1G" returned: 0 in 0.497s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-84799dc6-9c80-4d69-8e82-2f37d60d93b1 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6fe61d4-745d-4d07-8ef6-e3afce103739 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f6fe61d4-745d-4d07-8ef6-e3afce103739.ee3f516f-b090-4761-b861-08c2b46fdba7 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:27 devstack sudo[105916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6fe61d4-745d-4d07-8ef6-e3afce103739 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f6fe61d4-745d-4d07-8ef6-e3afce103739.ee3f516f-b090-4761-b861-08c2b46fdba7 Nov 06 18:04:27 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:27 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-84799dc6-9c80-4d69-8e82-2f37d60d93b1 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6fe61d4-745d-4d07-8ef6-e3afce103739 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f6fe61d4-745d-4d07-8ef6-e3afce103739.ee3f516f-b090-4761-b861-08c2b46fdba7" returned: 0 in 0.321s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:27 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-84799dc6-9c80-4d69-8e82-2f37d60d93b1 tempest-ProjectMemberTests-819176810 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f6fe61d4-745d-4d07-8ef6-e3afce103739.ee3f516f-b090-4761-b861-08c2b46fdba7 is being set with open permissions: ugo+rw Nov 06 18:04:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-84799dc6-9c80-4d69-8e82-2f37d60d93b1 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f6fe61d4-745d-4d07-8ef6-e3afce103739.ee3f516f-b090-4761-b861-08c2b46fdba7 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:27 devstack sudo[105921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f6fe61d4-745d-4d07-8ef6-e3afce103739.ee3f516f-b090-4761-b861-08c2b46fdba7 Nov 06 18:04:27 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:28 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-84799dc6-9c80-4d69-8e82-2f37d60d93b1 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f6fe61d4-745d-4d07-8ef6-e3afce103739.ee3f516f-b090-4761-b861-08c2b46fdba7" returned: 0 in 0.260s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-84799dc6-9c80-4d69-8e82-2f37d60d93b1 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f6fe61d4-745d-4d07-8ef6-e3afce103739.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:28 devstack sudo[105924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f6fe61d4-745d-4d07-8ef6-e3afce103739.info Nov 06 18:04:28 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:28 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-84799dc6-9c80-4d69-8e82-2f37d60d93b1 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f6fe61d4-745d-4d07-8ef6-e3afce103739.info" returned: 0 in 0.278s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:28 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-84799dc6-9c80-4d69-8e82-2f37d60d93b1 tempest-ProjectMemberTests-819176810 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f6fe61d4-745d-4d07-8ef6-e3afce103739.info is being set with open permissions: ugo+rw Nov 06 18:04:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-84799dc6-9c80-4d69-8e82-2f37d60d93b1 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f6fe61d4-745d-4d07-8ef6-e3afce103739.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:28 devstack sudo[105927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f6fe61d4-745d-4d07-8ef6-e3afce103739.info Nov 06 18:04:28 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:28 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-84799dc6-9c80-4d69-8e82-2f37d60d93b1 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f6fe61d4-745d-4d07-8ef6-e3afce103739.info" returned: 0 in 0.302s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-84799dc6-9c80-4d69-8e82-2f37d60d93b1 tempest-ProjectMemberTests-819176810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.280s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-665f5641-b1d5-46c0-b7fd-6eaad55433a5 tempest-ProjectReaderTests-1299385716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.773s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-665f5641-b1d5-46c0-b7fd-6eaad55433a5 tempest-ProjectReaderTests-1299385716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:04:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-241228711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17248a46-07d8-49d4-9866-8be9c51f3a1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c5284ac37ff4d179815435f871ca0fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:04:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:04:27Z,use_quota=True,user_id='caa4f376bb65466cba7edd807cf24033',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:04:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-665f5641-b1d5-46c0-b7fd-6eaad55433a5 tempest-ProjectReaderTests-1299385716 None] Creating volume 17248a46-07d8-49d4-9866-8be9c51f3a1b {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:04:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-665f5641-b1d5-46c0-b7fd-6eaad55433a5 tempest-ProjectReaderTests-1299385716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-665f5641-b1d5-46c0-b7fd-6eaad55433a5 tempest-ProjectReaderTests-1299385716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-665f5641-b1d5-46c0-b7fd-6eaad55433a5 tempest-ProjectReaderTests-1299385716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:04:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-665f5641-b1d5-46c0-b7fd-6eaad55433a5 tempest-ProjectReaderTests-1299385716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:04:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-665f5641-b1d5-46c0-b7fd-6eaad55433a5 tempest-ProjectReaderTests-1299385716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-665f5641-b1d5-46c0-b7fd-6eaad55433a5 tempest-ProjectReaderTests-1299385716 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:04:28 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-665f5641-b1d5-46c0-b7fd-6eaad55433a5 tempest-ProjectReaderTests-1299385716 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:04:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-665f5641-b1d5-46c0-b7fd-6eaad55433a5 tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-17248a46-07d8-49d4-9866-8be9c51f3a1b 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:28 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-17248a46-07d8-49d4-9866-8be9c51f3a1b 1073741824 Nov 06 18:04:28 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:28 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-84799dc6-9c80-4d69-8e82-2f37d60d93b1 tempest-ProjectMemberTests-819176810 None] Create snapshot completed successfully Nov 06 18:04:29 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-665f5641-b1d5-46c0-b7fd-6eaad55433a5 tempest-ProjectReaderTests-1299385716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-17248a46-07d8-49d4-9866-8be9c51f3a1b 1073741824" returned: 0 in 0.453s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-665f5641-b1d5-46c0-b7fd-6eaad55433a5 tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-17248a46-07d8-49d4-9866-8be9c51f3a1b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:29 devstack sudo[105936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-17248a46-07d8-49d4-9866-8be9c51f3a1b Nov 06 18:04:29 devstack sudo[105936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:29 devstack sudo[105936]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-665f5641-b1d5-46c0-b7fd-6eaad55433a5 tempest-ProjectReaderTests-1299385716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-17248a46-07d8-49d4-9866-8be9c51f3a1b" returned: 0 in 0.280s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:29 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-665f5641-b1d5-46c0-b7fd-6eaad55433a5 tempest-ProjectReaderTests-1299385716 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:04:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-665f5641-b1d5-46c0-b7fd-6eaad55433a5 tempest-ProjectReaderTests-1299385716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-742ac3a7-a37c-41c8-abb8-6844aafc2672 tempest-CinderUnicodeTest-1465938524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.125s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:29 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-742ac3a7-a37c-41c8-abb8-6844aafc2672 tempest-CinderUnicodeTest-1465938524 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:04:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59978153-84d8-44ee-a003-1430734edb46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35e6527f7c994dbd801a2dae3f063817',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:04:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:04:27Z,use_quota=True,user_id='b6f42ae27516423fae35994351dc2a47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:04:29 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-742ac3a7-a37c-41c8-abb8-6844aafc2672 tempest-CinderUnicodeTest-1465938524 None] Creating volume 59978153-84d8-44ee-a003-1430734edb46 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:04:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-742ac3a7-a37c-41c8-abb8-6844aafc2672 tempest-CinderUnicodeTest-1465938524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-742ac3a7-a37c-41c8-abb8-6844aafc2672 tempest-CinderUnicodeTest-1465938524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:29 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-742ac3a7-a37c-41c8-abb8-6844aafc2672 tempest-CinderUnicodeTest-1465938524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:04:29 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-742ac3a7-a37c-41c8-abb8-6844aafc2672 tempest-CinderUnicodeTest-1465938524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:04:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-742ac3a7-a37c-41c8-abb8-6844aafc2672 tempest-CinderUnicodeTest-1465938524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:29 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-742ac3a7-a37c-41c8-abb8-6844aafc2672 tempest-CinderUnicodeTest-1465938524 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:04:29 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-742ac3a7-a37c-41c8-abb8-6844aafc2672 tempest-CinderUnicodeTest-1465938524 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:04:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-742ac3a7-a37c-41c8-abb8-6844aafc2672 tempest-CinderUnicodeTest-1465938524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-59978153-84d8-44ee-a003-1430734edb46 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:29 devstack sudo[105939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-59978153-84d8-44ee-a003-1430734edb46 1073741824 Nov 06 18:04:29 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-665f5641-b1d5-46c0-b7fd-6eaad55433a5 tempest-ProjectReaderTests-1299385716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf343817-d0b7-42ae-8fee-2c0530647bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17248a46-07d8-49d4-9866-8be9c51f3a1b', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-665f5641-b1d5-46c0-b7fd-6eaad55433a5 tempest-ProjectReaderTests-1299385716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c147bd22-148c-401e-a4ff-d346d7914bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:29 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-665f5641-b1d5-46c0-b7fd-6eaad55433a5 tempest-ProjectReaderTests-1299385716 None] Volume volume-17248a46-07d8-49d4-9866-8be9c51f3a1b (17248a46-07d8-49d4-9866-8be9c51f3a1b): created successfully Nov 06 18:04:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-665f5641-b1d5-46c0-b7fd-6eaad55433a5 tempest-ProjectReaderTests-1299385716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c147bd22-148c-401e-a4ff-d346d7914bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-665f5641-b1d5-46c0-b7fd-6eaad55433a5 tempest-ProjectReaderTests-1299385716 None] Flow 'volume_create_manager' (ba6a505b-7c8f-437d-93c2-ad645b3999a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:04:29 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-665f5641-b1d5-46c0-b7fd-6eaad55433a5 tempest-ProjectReaderTests-1299385716 None] Created volume successfully. Nov 06 18:04:29 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ba43dcad-c38c-4711-8651-8014cbc4be16 tempest-ProjectMemberTests-819176810 None] Acquiring lock "cinder-ee3f516f-b090-4761-b861-08c2b46fdba7-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:29 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ba43dcad-c38c-4711-8651-8014cbc4be16 tempest-ProjectMemberTests-819176810 None] Lock "cinder-ee3f516f-b090-4761-b861-08c2b46fdba7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:29 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ba43dcad-c38c-4711-8651-8014cbc4be16 tempest-ProjectMemberTests-819176810 None] Acquiring lock "cinder-quobyte-f6fe61d4-745d-4d07-8ef6-e3afce103739" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:29 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ba43dcad-c38c-4711-8651-8014cbc4be16 tempest-ProjectMemberTests-819176810 None] Lock "cinder-quobyte-f6fe61d4-745d-4d07-8ef6-e3afce103739" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:29 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ba43dcad-c38c-4711-8651-8014cbc4be16 tempest-ProjectMemberTests-819176810 None] Acquiring lock "cinder-quobyte-ee3f516f-b090-4761-b861-08c2b46fdba7" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:29 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ba43dcad-c38c-4711-8651-8014cbc4be16 tempest-ProjectMemberTests-819176810 None] Lock "cinder-quobyte-ee3f516f-b090-4761-b861-08c2b46fdba7" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:29 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-ba43dcad-c38c-4711-8651-8014cbc4be16 tempest-ProjectMemberTests-819176810 None] Deleting offline snapshot ee3f516f-b090-4761-b861-08c2b46fdba7 of volume f6fe61d4-745d-4d07-8ef6-e3afce103739 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:04:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-ba43dcad-c38c-4711-8651-8014cbc4be16 tempest-ProjectMemberTests-819176810 None] snapshot_file for this snap is: volume-f6fe61d4-745d-4d07-8ef6-e3afce103739.ee3f516f-b090-4761-b861-08c2b46fdba7 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:04:30 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[823e6c89-b797-4ff7-8ab9-8b393ad9c2a3]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:04:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ba43dcad-c38c-4711-8651-8014cbc4be16 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f6fe61d4-745d-4d07-8ef6-e3afce103739.ee3f516f-b090-4761-b861-08c2b46fdba7 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:30 devstack sudo[105944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f6fe61d4-745d-4d07-8ef6-e3afce103739.ee3f516f-b090-4761-b861-08c2b46fdba7 Nov 06 18:04:30 devstack sudo[105944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-436c1761-758b-40e7-95d6-3c371c357bb4 tempest-ProjectReaderTests-1299385716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:30 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-742ac3a7-a37c-41c8-abb8-6844aafc2672 tempest-CinderUnicodeTest-1465938524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-59978153-84d8-44ee-a003-1430734edb46 1073741824" returned: 0 in 0.769s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-742ac3a7-a37c-41c8-abb8-6844aafc2672 tempest-CinderUnicodeTest-1465938524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-59978153-84d8-44ee-a003-1430734edb46 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:30 devstack sudo[105947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-59978153-84d8-44ee-a003-1430734edb46 Nov 06 18:04:30 devstack sudo[105947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:30 devstack sudo[105944]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ba43dcad-c38c-4711-8651-8014cbc4be16 tempest-ProjectMemberTests-819176810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f6fe61d4-745d-4d07-8ef6-e3afce103739.ee3f516f-b090-4761-b861-08c2b46fdba7" returned: 0 in 0.476s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-ba43dcad-c38c-4711-8651-8014cbc4be16 tempest-ProjectMemberTests-819176810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6fe61d4-745d-4d07-8ef6-e3afce103739(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:04:30 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8dc4ec-761e-46c3-8354-2a47f74cc920]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:04:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ba43dcad-c38c-4711-8651-8014cbc4be16 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f6fe61d4-745d-4d07-8ef6-e3afce103739 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:30 devstack sudo[105947]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-742ac3a7-a37c-41c8-abb8-6844aafc2672 tempest-CinderUnicodeTest-1465938524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-59978153-84d8-44ee-a003-1430734edb46" returned: 0 in 0.301s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-742ac3a7-a37c-41c8-abb8-6844aafc2672 tempest-CinderUnicodeTest-1465938524 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:04:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-742ac3a7-a37c-41c8-abb8-6844aafc2672 tempest-CinderUnicodeTest-1465938524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-436c1761-758b-40e7-95d6-3c371c357bb4 tempest-ProjectReaderTests-1299385716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.380s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-436c1761-758b-40e7-95d6-3c371c357bb4 tempest-ProjectReaderTests-1299385716 None] Creating offline snapshot e475081e-a272-4e02-9e21-233000da1a46 of volume 17248a46-07d8-49d4-9866-8be9c51f3a1b {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:04:30 devstack sudo[105953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f6fe61d4-745d-4d07-8ef6-e3afce103739 Nov 06 18:04:30 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-742ac3a7-a37c-41c8-abb8-6844aafc2672 tempest-CinderUnicodeTest-1465938524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8944ee33-5897-4d7a-a544-d499fb4e52e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59978153-84d8-44ee-a003-1430734edb46', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-742ac3a7-a37c-41c8-abb8-6844aafc2672 tempest-CinderUnicodeTest-1465938524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bfa778a-6a9e-4ccb-98c6-f276cbee4e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:30 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e2f141-b1d0-4392-bf65-c35d762b55d6]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:04:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-436c1761-758b-40e7-95d6-3c371c357bb4 tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-17248a46-07d8-49d4-9866-8be9c51f3a1b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:30 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-742ac3a7-a37c-41c8-abb8-6844aafc2672 tempest-CinderUnicodeTest-1465938524 None] Volume volume-59978153-84d8-44ee-a003-1430734edb46 (59978153-84d8-44ee-a003-1430734edb46): created successfully Nov 06 18:04:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-742ac3a7-a37c-41c8-abb8-6844aafc2672 tempest-CinderUnicodeTest-1465938524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bfa778a-6a9e-4ccb-98c6-f276cbee4e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-742ac3a7-a37c-41c8-abb8-6844aafc2672 tempest-CinderUnicodeTest-1465938524 None] Flow 'volume_create_manager' (8e1f739e-4688-495d-a5da-002852609386) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:04:30 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-742ac3a7-a37c-41c8-abb8-6844aafc2672 tempest-CinderUnicodeTest-1465938524 None] Created volume successfully. Nov 06 18:04:30 devstack sudo[105956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-17248a46-07d8-49d4-9866-8be9c51f3a1b Nov 06 18:04:30 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:31 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ba43dcad-c38c-4711-8651-8014cbc4be16 tempest-ProjectMemberTests-819176810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f6fe61d4-745d-4d07-8ef6-e3afce103739" returned: 0 in 0.493s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ba43dcad-c38c-4711-8651-8014cbc4be16 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f6fe61d4-745d-4d07-8ef6-e3afce103739.ee3f516f-b090-4761-b861-08c2b46fdba7 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:31 devstack sudo[105961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f6fe61d4-745d-4d07-8ef6-e3afce103739.ee3f516f-b090-4761-b861-08c2b46fdba7 Nov 06 18:04:31 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:31 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-436c1761-758b-40e7-95d6-3c371c357bb4 tempest-ProjectReaderTests-1299385716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-17248a46-07d8-49d4-9866-8be9c51f3a1b" returned: 0 in 0.458s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-436c1761-758b-40e7-95d6-3c371c357bb4 tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-17248a46-07d8-49d4-9866-8be9c51f3a1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-17248a46-07d8-49d4-9866-8be9c51f3a1b.e475081e-a272-4e02-9e21-233000da1a46 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:31 devstack sudo[105967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-17248a46-07d8-49d4-9866-8be9c51f3a1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-17248a46-07d8-49d4-9866-8be9c51f3a1b.e475081e-a272-4e02-9e21-233000da1a46 1G Nov 06 18:04:31 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:31 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ba43dcad-c38c-4711-8651-8014cbc4be16 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f6fe61d4-745d-4d07-8ef6-e3afce103739.ee3f516f-b090-4761-b861-08c2b46fdba7" returned: 0 in 0.437s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ba43dcad-c38c-4711-8651-8014cbc4be16 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f6fe61d4-745d-4d07-8ef6-e3afce103739.ee3f516f-b090-4761-b861-08c2b46fdba7 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:31 devstack sudo[105976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f6fe61d4-745d-4d07-8ef6-e3afce103739.ee3f516f-b090-4761-b861-08c2b46fdba7 Nov 06 18:04:31 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:31 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-436c1761-758b-40e7-95d6-3c371c357bb4 tempest-ProjectReaderTests-1299385716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-17248a46-07d8-49d4-9866-8be9c51f3a1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-17248a46-07d8-49d4-9866-8be9c51f3a1b.e475081e-a272-4e02-9e21-233000da1a46 1G" returned: 0 in 0.546s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-436c1761-758b-40e7-95d6-3c371c357bb4 tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17248a46-07d8-49d4-9866-8be9c51f3a1b -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-17248a46-07d8-49d4-9866-8be9c51f3a1b.e475081e-a272-4e02-9e21-233000da1a46 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:31 devstack sudo[105978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17248a46-07d8-49d4-9866-8be9c51f3a1b -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-17248a46-07d8-49d4-9866-8be9c51f3a1b.e475081e-a272-4e02-9e21-233000da1a46 Nov 06 18:04:31 devstack sudo[105978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:31 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ba43dcad-c38c-4711-8651-8014cbc4be16 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f6fe61d4-745d-4d07-8ef6-e3afce103739.ee3f516f-b090-4761-b861-08c2b46fdba7" returned: 0 in 0.352s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:31 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ba43dcad-c38c-4711-8651-8014cbc4be16 tempest-ProjectMemberTests-819176810 None] Lock "cinder-quobyte-ee3f516f-b090-4761-b861-08c2b46fdba7" released by "_delete_snapshot" :: held 1.944s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:31 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ba43dcad-c38c-4711-8651-8014cbc4be16 tempest-ProjectMemberTests-819176810 None] Lock "cinder-quobyte-f6fe61d4-745d-4d07-8ef6-e3afce103739" released by "delete_snapshot" :: held 1.995s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:32 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-ba43dcad-c38c-4711-8651-8014cbc4be16 tempest-ProjectMemberTests-819176810 None] Created reservations ['a52f512c-878d-4088-abad-ef000663da4e', 'f399ab86-7aa5-4587-88be-86b1e7ca0dbd', '0e6aca0c-a664-432a-a2e5-9e94cd0d7f47', '926f31ee-e981-4a39-8dd9-827b983c7e74'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:04:32 devstack sudo[105978]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-436c1761-758b-40e7-95d6-3c371c357bb4 tempest-ProjectReaderTests-1299385716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17248a46-07d8-49d4-9866-8be9c51f3a1b -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-17248a46-07d8-49d4-9866-8be9c51f3a1b.e475081e-a272-4e02-9e21-233000da1a46" returned: 0 in 0.442s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:32 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-436c1761-758b-40e7-95d6-3c371c357bb4 tempest-ProjectReaderTests-1299385716 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-17248a46-07d8-49d4-9866-8be9c51f3a1b.e475081e-a272-4e02-9e21-233000da1a46 is being set with open permissions: ugo+rw Nov 06 18:04:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-436c1761-758b-40e7-95d6-3c371c357bb4 tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-17248a46-07d8-49d4-9866-8be9c51f3a1b.e475081e-a272-4e02-9e21-233000da1a46 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:32 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-ba43dcad-c38c-4711-8651-8014cbc4be16 tempest-ProjectMemberTests-819176810 None] Delete snapshot completed successfully. Nov 06 18:04:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ba43dcad-c38c-4711-8651-8014cbc4be16 tempest-ProjectMemberTests-819176810 None] Lock "cinder-ee3f516f-b090-4761-b861-08c2b46fdba7-delete_snapshot" released by "delete_snapshot" :: held 2.299s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:32 devstack sudo[105984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-17248a46-07d8-49d4-9866-8be9c51f3a1b.e475081e-a272-4e02-9e21-233000da1a46 Nov 06 18:04:32 devstack sudo[105984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:32 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8629253-132c-4ac8-994e-264a216a16a9 tempest-CinderUnicodeTest-1465938524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:04:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e8629253-132c-4ac8-994e-264a216a16a9 tempest-CinderUnicodeTest-1465938524 None] Flow 'volume_create_manager' (b45f03d6-dacb-4edb-8eb9-5c2e326bd401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:04:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e8629253-132c-4ac8-994e-264a216a16a9 tempest-CinderUnicodeTest-1465938524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9b397b3-dc36-4553-a96b-6e3ced4a2df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e8629253-132c-4ac8-994e-264a216a16a9 tempest-CinderUnicodeTest-1465938524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9b397b3-dc36-4553-a96b-6e3ced4a2df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:04:32Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2090690420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b06f8b8d-74b7-4351-9953-50112995774d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35e6527f7c994dbd801a2dae3f063817',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:04:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:04:32Z,use_quota=True,user_id='b6f42ae27516423fae35994351dc2a47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e8629253-132c-4ac8-994e-264a216a16a9 tempest-CinderUnicodeTest-1465938524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (830c6c7c-8544-4807-8515-64f2c7a11a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e8629253-132c-4ac8-994e-264a216a16a9 tempest-CinderUnicodeTest-1465938524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (830c6c7c-8544-4807-8515-64f2c7a11a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e8629253-132c-4ac8-994e-264a216a16a9 tempest-CinderUnicodeTest-1465938524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49651d10-e7cb-4d0b-a57c-6234c22b28bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e8629253-132c-4ac8-994e-264a216a16a9 tempest-CinderUnicodeTest-1465938524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49651d10-e7cb-4d0b-a57c-6234c22b28bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b06f8b8d-74b7-4351-9953-50112995774d', 'volume_name': 'volume-b06f8b8d-74b7-4351-9953-50112995774d', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e8629253-132c-4ac8-994e-264a216a16a9 tempest-CinderUnicodeTest-1465938524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d478264-ae81-4633-aa4f-9002acd7739e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e8629253-132c-4ac8-994e-264a216a16a9 tempest-CinderUnicodeTest-1465938524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d478264-ae81-4633-aa4f-9002acd7739e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e8629253-132c-4ac8-994e-264a216a16a9 tempest-CinderUnicodeTest-1465938524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bc9a71c-c57c-43f3-b12d-286ce9bfc8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:32 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-e8629253-132c-4ac8-994e-264a216a16a9 tempest-CinderUnicodeTest-1465938524 None] Volume b06f8b8d-74b7-4351-9953-50112995774d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b06f8b8d-74b7-4351-9953-50112995774d', 'volume_size': 1} Nov 06 18:04:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e8629253-132c-4ac8-994e-264a216a16a9 tempest-CinderUnicodeTest-1465938524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:32 devstack sudo[105984]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-436c1761-758b-40e7-95d6-3c371c357bb4 tempest-ProjectReaderTests-1299385716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-17248a46-07d8-49d4-9866-8be9c51f3a1b.e475081e-a272-4e02-9e21-233000da1a46" returned: 0 in 0.311s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-436c1761-758b-40e7-95d6-3c371c357bb4 tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-17248a46-07d8-49d4-9866-8be9c51f3a1b.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:32 devstack sudo[105987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-17248a46-07d8-49d4-9866-8be9c51f3a1b.info Nov 06 18:04:32 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:32 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-436c1761-758b-40e7-95d6-3c371c357bb4 tempest-ProjectReaderTests-1299385716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-17248a46-07d8-49d4-9866-8be9c51f3a1b.info" returned: 0 in 0.273s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:32 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-436c1761-758b-40e7-95d6-3c371c357bb4 tempest-ProjectReaderTests-1299385716 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-17248a46-07d8-49d4-9866-8be9c51f3a1b.info is being set with open permissions: ugo+rw Nov 06 18:04:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-436c1761-758b-40e7-95d6-3c371c357bb4 tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-17248a46-07d8-49d4-9866-8be9c51f3a1b.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:32 devstack sudo[105990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-17248a46-07d8-49d4-9866-8be9c51f3a1b.info Nov 06 18:04:32 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:33 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-436c1761-758b-40e7-95d6-3c371c357bb4 tempest-ProjectReaderTests-1299385716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-17248a46-07d8-49d4-9866-8be9c51f3a1b.info" returned: 0 in 0.280s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-436c1761-758b-40e7-95d6-3c371c357bb4 tempest-ProjectReaderTests-1299385716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.450s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e8629253-132c-4ac8-994e-264a216a16a9 tempest-CinderUnicodeTest-1465938524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.757s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:33 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e8629253-132c-4ac8-994e-264a216a16a9 tempest-CinderUnicodeTest-1465938524 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:04:32Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2090690420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b06f8b8d-74b7-4351-9953-50112995774d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35e6527f7c994dbd801a2dae3f063817',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:04:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:04:32Z,use_quota=True,user_id='b6f42ae27516423fae35994351dc2a47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:04:33 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-e8629253-132c-4ac8-994e-264a216a16a9 tempest-CinderUnicodeTest-1465938524 None] Creating volume b06f8b8d-74b7-4351-9953-50112995774d {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:04:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e8629253-132c-4ac8-994e-264a216a16a9 tempest-CinderUnicodeTest-1465938524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e8629253-132c-4ac8-994e-264a216a16a9 tempest-CinderUnicodeTest-1465938524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:33 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e8629253-132c-4ac8-994e-264a216a16a9 tempest-CinderUnicodeTest-1465938524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:04:33 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e8629253-132c-4ac8-994e-264a216a16a9 tempest-CinderUnicodeTest-1465938524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:04:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e8629253-132c-4ac8-994e-264a216a16a9 tempest-CinderUnicodeTest-1465938524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:33 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e8629253-132c-4ac8-994e-264a216a16a9 tempest-CinderUnicodeTest-1465938524 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:04:33 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-e8629253-132c-4ac8-994e-264a216a16a9 tempest-CinderUnicodeTest-1465938524 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:04:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e8629253-132c-4ac8-994e-264a216a16a9 tempest-CinderUnicodeTest-1465938524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b06f8b8d-74b7-4351-9953-50112995774d 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:33 devstack sudo[105993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b06f8b8d-74b7-4351-9953-50112995774d 1073741824 Nov 06 18:04:33 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:33 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-436c1761-758b-40e7-95d6-3c371c357bb4 tempest-ProjectReaderTests-1299385716 None] Create snapshot completed successfully Nov 06 18:04:33 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d5ba1686-25a0-46de-ad84-98143924bc87 tempest-ProjectMemberTests-819176810 None] Acquiring lock "cinder-f6fe61d4-745d-4d07-8ef6-e3afce103739-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:33 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d5ba1686-25a0-46de-ad84-98143924bc87 tempest-ProjectMemberTests-819176810 None] Lock "cinder-f6fe61d4-745d-4d07-8ef6-e3afce103739-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:33 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d5ba1686-25a0-46de-ad84-98143924bc87 tempest-ProjectMemberTests-819176810 None] Acquiring lock "cinder-quobyte-f6fe61d4-745d-4d07-8ef6-e3afce103739" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:33 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d5ba1686-25a0-46de-ad84-98143924bc87 tempest-ProjectMemberTests-819176810 None] Lock "cinder-quobyte-f6fe61d4-745d-4d07-8ef6-e3afce103739" acquired by "delete_volume" :: waited 0.016s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:33 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f088c0f-0985-4545-b74a-91d432a5ab28]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:04:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d5ba1686-25a0-46de-ad84-98143924bc87 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f6fe61d4-745d-4d07-8ef6-e3afce103739 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:33 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-33803302-44bd-4993-831e-c5ce4650567c tempest-ProjectReaderTests-1299385716 None] Acquiring lock "cinder-e475081e-a272-4e02-9e21-233000da1a46-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:33 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-33803302-44bd-4993-831e-c5ce4650567c tempest-ProjectReaderTests-1299385716 None] Lock "cinder-e475081e-a272-4e02-9e21-233000da1a46-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:33 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-33803302-44bd-4993-831e-c5ce4650567c tempest-ProjectReaderTests-1299385716 None] Acquiring lock "cinder-quobyte-17248a46-07d8-49d4-9866-8be9c51f3a1b" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:33 devstack sudo[105995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f6fe61d4-745d-4d07-8ef6-e3afce103739 Nov 06 18:04:33 devstack sudo[105995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:33 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-33803302-44bd-4993-831e-c5ce4650567c tempest-ProjectReaderTests-1299385716 None] Lock "cinder-quobyte-17248a46-07d8-49d4-9866-8be9c51f3a1b" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:33 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-33803302-44bd-4993-831e-c5ce4650567c tempest-ProjectReaderTests-1299385716 None] Acquiring lock "cinder-quobyte-e475081e-a272-4e02-9e21-233000da1a46" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:33 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-33803302-44bd-4993-831e-c5ce4650567c tempest-ProjectReaderTests-1299385716 None] Lock "cinder-quobyte-e475081e-a272-4e02-9e21-233000da1a46" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:33 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-33803302-44bd-4993-831e-c5ce4650567c tempest-ProjectReaderTests-1299385716 None] Deleting offline snapshot e475081e-a272-4e02-9e21-233000da1a46 of volume 17248a46-07d8-49d4-9866-8be9c51f3a1b {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:04:33 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-33803302-44bd-4993-831e-c5ce4650567c tempest-ProjectReaderTests-1299385716 None] snapshot_file for this snap is: volume-17248a46-07d8-49d4-9866-8be9c51f3a1b.e475081e-a272-4e02-9e21-233000da1a46 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:04:33 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[312e6965-5d98-481c-944a-54aa4600cb64]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:04:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-33803302-44bd-4993-831e-c5ce4650567c tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-17248a46-07d8-49d4-9866-8be9c51f3a1b.e475081e-a272-4e02-9e21-233000da1a46 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:33 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e8629253-132c-4ac8-994e-264a216a16a9 tempest-CinderUnicodeTest-1465938524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b06f8b8d-74b7-4351-9953-50112995774d 1073741824" returned: 0 in 0.641s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:33 devstack sudo[106001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-17248a46-07d8-49d4-9866-8be9c51f3a1b.e475081e-a272-4e02-9e21-233000da1a46 Nov 06 18:04:33 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e8629253-132c-4ac8-994e-264a216a16a9 tempest-CinderUnicodeTest-1465938524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b06f8b8d-74b7-4351-9953-50112995774d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:33 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b06f8b8d-74b7-4351-9953-50112995774d Nov 06 18:04:33 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:33 devstack sudo[105995]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d5ba1686-25a0-46de-ad84-98143924bc87 tempest-ProjectMemberTests-819176810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f6fe61d4-745d-4d07-8ef6-e3afce103739" returned: 0 in 0.510s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d5ba1686-25a0-46de-ad84-98143924bc87 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f6fe61d4-745d-4d07-8ef6-e3afce103739 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:33 devstack sudo[106008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f6fe61d4-745d-4d07-8ef6-e3afce103739 Nov 06 18:04:33 devstack sudo[106008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:34 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e8629253-132c-4ac8-994e-264a216a16a9 tempest-CinderUnicodeTest-1465938524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b06f8b8d-74b7-4351-9953-50112995774d" returned: 0 in 0.296s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e8629253-132c-4ac8-994e-264a216a16a9 tempest-CinderUnicodeTest-1465938524 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:04:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e8629253-132c-4ac8-994e-264a216a16a9 tempest-CinderUnicodeTest-1465938524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:34 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-33803302-44bd-4993-831e-c5ce4650567c tempest-ProjectReaderTests-1299385716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-17248a46-07d8-49d4-9866-8be9c51f3a1b.e475081e-a272-4e02-9e21-233000da1a46" returned: 0 in 0.510s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-33803302-44bd-4993-831e-c5ce4650567c tempest-ProjectReaderTests-1299385716 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17248a46-07d8-49d4-9866-8be9c51f3a1b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:04:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e8629253-132c-4ac8-994e-264a216a16a9 tempest-CinderUnicodeTest-1465938524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bc9a71c-c57c-43f3-b12d-286ce9bfc8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b06f8b8d-74b7-4351-9953-50112995774d', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e8629253-132c-4ac8-994e-264a216a16a9 tempest-CinderUnicodeTest-1465938524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adeeed72-8cc8-4272-82c5-7ca04544ac46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:34 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e69ce7b-0fbe-42f8-a6cb-3e15ba4aa967]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:04:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-33803302-44bd-4993-831e-c5ce4650567c tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-17248a46-07d8-49d4-9866-8be9c51f3a1b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:34 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-e8629253-132c-4ac8-994e-264a216a16a9 tempest-CinderUnicodeTest-1465938524 None] Volume volume-b06f8b8d-74b7-4351-9953-50112995774d (b06f8b8d-74b7-4351-9953-50112995774d): created successfully Nov 06 18:04:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e8629253-132c-4ac8-994e-264a216a16a9 tempest-CinderUnicodeTest-1465938524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adeeed72-8cc8-4272-82c5-7ca04544ac46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e8629253-132c-4ac8-994e-264a216a16a9 tempest-CinderUnicodeTest-1465938524 None] Flow 'volume_create_manager' (b45f03d6-dacb-4edb-8eb9-5c2e326bd401) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:04:34 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-e8629253-132c-4ac8-994e-264a216a16a9 tempest-CinderUnicodeTest-1465938524 None] Created volume successfully. Nov 06 18:04:34 devstack sudo[106008]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d5ba1686-25a0-46de-ad84-98143924bc87 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-f6fe61d4-745d-4d07-8ef6-e3afce103739" returned: 0 in 0.383s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d5ba1686-25a0-46de-ad84-98143924bc87 tempest-ProjectMemberTests-819176810 None] Lock "cinder-quobyte-f6fe61d4-745d-4d07-8ef6-e3afce103739" released by "delete_volume" :: held 0.987s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:34 devstack sudo[106015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-17248a46-07d8-49d4-9866-8be9c51f3a1b Nov 06 18:04:34 devstack sudo[106015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:34 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-d5ba1686-25a0-46de-ad84-98143924bc87 tempest-ProjectMemberTests-819176810 None] Created reservations ['c1a43b7d-1bf8-4a85-878d-941cf3e01136', 'd23d73ab-6a90-4e85-9978-a6e45ca3152f', '6ae63c85-412d-4c96-9010-37f865503744', 'f5a35459-9980-4b2d-b814-94eb46fc6212'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:04:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d5ba1686-25a0-46de-ad84-98143924bc87 tempest-ProjectMemberTests-819176810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d5ba1686-25a0-46de-ad84-98143924bc87 tempest-ProjectMemberTests-819176810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d5ba1686-25a0-46de-ad84-98143924bc87 tempest-ProjectMemberTests-819176810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:04:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d5ba1686-25a0-46de-ad84-98143924bc87 tempest-ProjectMemberTests-819176810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:04:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d5ba1686-25a0-46de-ad84-98143924bc87 tempest-ProjectMemberTests-819176810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d5ba1686-25a0-46de-ad84-98143924bc87 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:34 devstack sudo[106018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:04:34 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:34 devstack sudo[106015]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-33803302-44bd-4993-831e-c5ce4650567c tempest-ProjectReaderTests-1299385716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-17248a46-07d8-49d4-9866-8be9c51f3a1b" returned: 0 in 0.556s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-33803302-44bd-4993-831e-c5ce4650567c tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-17248a46-07d8-49d4-9866-8be9c51f3a1b.e475081e-a272-4e02-9e21-233000da1a46 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:34 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-17248a46-07d8-49d4-9866-8be9c51f3a1b.e475081e-a272-4e02-9e21-233000da1a46 Nov 06 18:04:34 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-465ce6cb-e4d2-4cbb-8e61-5244217121b8 tempest-CinderUnicodeTest-1465938524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-465ce6cb-e4d2-4cbb-8e61-5244217121b8 tempest-CinderUnicodeTest-1465938524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-465ce6cb-e4d2-4cbb-8e61-5244217121b8 tempest-CinderUnicodeTest-1465938524 None] Creating offline snapshot c7630600-94f0-4f55-9604-53eff82a68ec of volume b06f8b8d-74b7-4351-9953-50112995774d {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:04:34 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75d792f-aca3-4468-aed1-2086de7c9995]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:04:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-465ce6cb-e4d2-4cbb-8e61-5244217121b8 tempest-CinderUnicodeTest-1465938524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b06f8b8d-74b7-4351-9953-50112995774d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:34 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d5ba1686-25a0-46de-ad84-98143924bc87 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.404s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:34 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-d5ba1686-25a0-46de-ad84-98143924bc87 tempest-ProjectMemberTests-819176810 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:04:34 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-d5ba1686-25a0-46de-ad84-98143924bc87 tempest-ProjectMemberTests-819176810 None] Deleted volume successfully. Nov 06 18:04:34 devstack sudo[106026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b06f8b8d-74b7-4351-9953-50112995774d Nov 06 18:04:34 devstack sudo[106026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d5ba1686-25a0-46de-ad84-98143924bc87 tempest-ProjectMemberTests-819176810 None] Lock "cinder-f6fe61d4-745d-4d07-8ef6-e3afce103739-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:35 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-33803302-44bd-4993-831e-c5ce4650567c tempest-ProjectReaderTests-1299385716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-17248a46-07d8-49d4-9866-8be9c51f3a1b.e475081e-a272-4e02-9e21-233000da1a46" returned: 0 in 0.466s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-33803302-44bd-4993-831e-c5ce4650567c tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-17248a46-07d8-49d4-9866-8be9c51f3a1b.e475081e-a272-4e02-9e21-233000da1a46 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:35 devstack sudo[106034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-17248a46-07d8-49d4-9866-8be9c51f3a1b.e475081e-a272-4e02-9e21-233000da1a46 Nov 06 18:04:35 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:35 devstack sudo[106026]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-465ce6cb-e4d2-4cbb-8e61-5244217121b8 tempest-CinderUnicodeTest-1465938524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b06f8b8d-74b7-4351-9953-50112995774d" returned: 0 in 0.463s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-465ce6cb-e4d2-4cbb-8e61-5244217121b8 tempest-CinderUnicodeTest-1465938524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b06f8b8d-74b7-4351-9953-50112995774d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b06f8b8d-74b7-4351-9953-50112995774d.c7630600-94f0-4f55-9604-53eff82a68ec 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:35 devstack sudo[106039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b06f8b8d-74b7-4351-9953-50112995774d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b06f8b8d-74b7-4351-9953-50112995774d.c7630600-94f0-4f55-9604-53eff82a68ec 1G Nov 06 18:04:35 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:35 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-33803302-44bd-4993-831e-c5ce4650567c tempest-ProjectReaderTests-1299385716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-17248a46-07d8-49d4-9866-8be9c51f3a1b.e475081e-a272-4e02-9e21-233000da1a46" returned: 0 in 0.355s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-33803302-44bd-4993-831e-c5ce4650567c tempest-ProjectReaderTests-1299385716 None] Lock "cinder-quobyte-e475081e-a272-4e02-9e21-233000da1a46" released by "_delete_snapshot" :: held 2.039s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-33803302-44bd-4993-831e-c5ce4650567c tempest-ProjectReaderTests-1299385716 None] Lock "cinder-quobyte-17248a46-07d8-49d4-9866-8be9c51f3a1b" released by "delete_snapshot" :: held 2.085s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:35 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-33803302-44bd-4993-831e-c5ce4650567c tempest-ProjectReaderTests-1299385716 None] Created reservations ['8e0f5ff6-4b6d-4eba-95c4-bb7315f52473', 'c20f30ce-27b3-4300-bdc2-bdc0403dc8bc', 'f6d1c8fe-0053-4cca-87e1-4a58fd3c7ef1', '142500dc-a2cb-4c4e-b8fc-4554f57dc937'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:04:35 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-33803302-44bd-4993-831e-c5ce4650567c tempest-ProjectReaderTests-1299385716 None] Delete snapshot completed successfully. Nov 06 18:04:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-33803302-44bd-4993-831e-c5ce4650567c tempest-ProjectReaderTests-1299385716 None] Lock "cinder-e475081e-a272-4e02-9e21-233000da1a46-delete_snapshot" released by "delete_snapshot" :: held 2.388s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:36 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-465ce6cb-e4d2-4cbb-8e61-5244217121b8 tempest-CinderUnicodeTest-1465938524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b06f8b8d-74b7-4351-9953-50112995774d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b06f8b8d-74b7-4351-9953-50112995774d.c7630600-94f0-4f55-9604-53eff82a68ec 1G" returned: 0 in 0.787s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-465ce6cb-e4d2-4cbb-8e61-5244217121b8 tempest-CinderUnicodeTest-1465938524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b06f8b8d-74b7-4351-9953-50112995774d -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b06f8b8d-74b7-4351-9953-50112995774d.c7630600-94f0-4f55-9604-53eff82a68ec {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:36 devstack sudo[106046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b06f8b8d-74b7-4351-9953-50112995774d -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b06f8b8d-74b7-4351-9953-50112995774d.c7630600-94f0-4f55-9604-53eff82a68ec Nov 06 18:04:36 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:36 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-72fc8160-9627-43ae-850e-046d08c04828 tempest-ProjectMemberTests-819176810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:04:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-72fc8160-9627-43ae-850e-046d08c04828 tempest-ProjectMemberTests-819176810 None] Flow 'volume_create_manager' (4cec81c7-10c6-4610-9d55-1a5d44c5e67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:04:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-72fc8160-9627-43ae-850e-046d08c04828 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3bf2cec-d5fd-428e-9b5c-b26dc6b40c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-72fc8160-9627-43ae-850e-046d08c04828 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3bf2cec-d5fd-428e-9b5c-b26dc6b40c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-131987051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a72ffcd0-60b5-40a5-8339-5caa6533d168,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b97cd7ef94764995a9e8c62cda23171f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:04:36Z,use_quota=True,user_id='a34e6465a98c4c289547d49a900a6bde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-72fc8160-9627-43ae-850e-046d08c04828 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1834f9af-204e-4d49-af65-45fc02aab58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-72fc8160-9627-43ae-850e-046d08c04828 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1834f9af-204e-4d49-af65-45fc02aab58f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-72fc8160-9627-43ae-850e-046d08c04828 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3db4436c-7b10-4d98-9863-570b8aeb9ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-72fc8160-9627-43ae-850e-046d08c04828 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3db4436c-7b10-4d98-9863-570b8aeb9ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a72ffcd0-60b5-40a5-8339-5caa6533d168', 'volume_name': 'volume-a72ffcd0-60b5-40a5-8339-5caa6533d168', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-72fc8160-9627-43ae-850e-046d08c04828 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c2a002f-2542-4b2d-a312-30dc07d7ac8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-72fc8160-9627-43ae-850e-046d08c04828 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c2a002f-2542-4b2d-a312-30dc07d7ac8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-72fc8160-9627-43ae-850e-046d08c04828 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f05bc85e-8c10-4279-b715-25f65481609f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:36 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-72fc8160-9627-43ae-850e-046d08c04828 tempest-ProjectMemberTests-819176810 None] Volume a72ffcd0-60b5-40a5-8339-5caa6533d168: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a72ffcd0-60b5-40a5-8339-5caa6533d168', 'volume_size': 1} Nov 06 18:04:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-72fc8160-9627-43ae-850e-046d08c04828 tempest-ProjectMemberTests-819176810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:36 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-465ce6cb-e4d2-4cbb-8e61-5244217121b8 tempest-CinderUnicodeTest-1465938524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b06f8b8d-74b7-4351-9953-50112995774d -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b06f8b8d-74b7-4351-9953-50112995774d.c7630600-94f0-4f55-9604-53eff82a68ec" returned: 0 in 0.361s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:36 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-465ce6cb-e4d2-4cbb-8e61-5244217121b8 tempest-CinderUnicodeTest-1465938524 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b06f8b8d-74b7-4351-9953-50112995774d.c7630600-94f0-4f55-9604-53eff82a68ec is being set with open permissions: ugo+rw Nov 06 18:04:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-465ce6cb-e4d2-4cbb-8e61-5244217121b8 tempest-CinderUnicodeTest-1465938524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b06f8b8d-74b7-4351-9953-50112995774d.c7630600-94f0-4f55-9604-53eff82a68ec {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:36 devstack sudo[106054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b06f8b8d-74b7-4351-9953-50112995774d.c7630600-94f0-4f55-9604-53eff82a68ec Nov 06 18:04:36 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:36 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-465ce6cb-e4d2-4cbb-8e61-5244217121b8 tempest-CinderUnicodeTest-1465938524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b06f8b8d-74b7-4351-9953-50112995774d.c7630600-94f0-4f55-9604-53eff82a68ec" returned: 0 in 0.265s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a6ebd4aa-e1d7-4fe4-a362-6febc61d1dc1 tempest-ProjectReaderTests-1299385716 None] Acquiring lock "cinder-17248a46-07d8-49d4-9866-8be9c51f3a1b-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a6ebd4aa-e1d7-4fe4-a362-6febc61d1dc1 tempest-ProjectReaderTests-1299385716 None] Lock "cinder-17248a46-07d8-49d4-9866-8be9c51f3a1b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-465ce6cb-e4d2-4cbb-8e61-5244217121b8 tempest-CinderUnicodeTest-1465938524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b06f8b8d-74b7-4351-9953-50112995774d.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:36 devstack sudo[106057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b06f8b8d-74b7-4351-9953-50112995774d.info Nov 06 18:04:36 devstack sudo[106057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a6ebd4aa-e1d7-4fe4-a362-6febc61d1dc1 tempest-ProjectReaderTests-1299385716 None] Acquiring lock "cinder-quobyte-17248a46-07d8-49d4-9866-8be9c51f3a1b" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a6ebd4aa-e1d7-4fe4-a362-6febc61d1dc1 tempest-ProjectReaderTests-1299385716 None] Lock "cinder-quobyte-17248a46-07d8-49d4-9866-8be9c51f3a1b" acquired by "delete_volume" :: waited 0.016s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:36 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ff57fb-472b-42f6-92d9-2bbaa12ee59c]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:04:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a6ebd4aa-e1d7-4fe4-a362-6febc61d1dc1 tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-17248a46-07d8-49d4-9866-8be9c51f3a1b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:37 devstack sudo[106059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-17248a46-07d8-49d4-9866-8be9c51f3a1b Nov 06 18:04:37 devstack sudo[106059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:37 devstack sudo[106057]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-465ce6cb-e4d2-4cbb-8e61-5244217121b8 tempest-CinderUnicodeTest-1465938524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b06f8b8d-74b7-4351-9953-50112995774d.info" returned: 0 in 0.289s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:37 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-465ce6cb-e4d2-4cbb-8e61-5244217121b8 tempest-CinderUnicodeTest-1465938524 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b06f8b8d-74b7-4351-9953-50112995774d.info is being set with open permissions: ugo+rw Nov 06 18:04:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-465ce6cb-e4d2-4cbb-8e61-5244217121b8 tempest-CinderUnicodeTest-1465938524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b06f8b8d-74b7-4351-9953-50112995774d.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:37 devstack sudo[106062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b06f8b8d-74b7-4351-9953-50112995774d.info Nov 06 18:04:37 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:37 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-465ce6cb-e4d2-4cbb-8e61-5244217121b8 tempest-CinderUnicodeTest-1465938524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b06f8b8d-74b7-4351-9953-50112995774d.info" returned: 0 in 0.255s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:37 devstack sudo[106059]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-465ce6cb-e4d2-4cbb-8e61-5244217121b8 tempest-CinderUnicodeTest-1465938524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.578s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-72fc8160-9627-43ae-850e-046d08c04828 tempest-ProjectMemberTests-819176810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.027s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:37 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-72fc8160-9627-43ae-850e-046d08c04828 tempest-ProjectMemberTests-819176810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-131987051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a72ffcd0-60b5-40a5-8339-5caa6533d168,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b97cd7ef94764995a9e8c62cda23171f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:04:36Z,use_quota=True,user_id='a34e6465a98c4c289547d49a900a6bde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:04:37 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-72fc8160-9627-43ae-850e-046d08c04828 tempest-ProjectMemberTests-819176810 None] Creating volume a72ffcd0-60b5-40a5-8339-5caa6533d168 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:04:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-72fc8160-9627-43ae-850e-046d08c04828 tempest-ProjectMemberTests-819176810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-72fc8160-9627-43ae-850e-046d08c04828 tempest-ProjectMemberTests-819176810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:37 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-72fc8160-9627-43ae-850e-046d08c04828 tempest-ProjectMemberTests-819176810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:04:37 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-72fc8160-9627-43ae-850e-046d08c04828 tempest-ProjectMemberTests-819176810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:04:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-72fc8160-9627-43ae-850e-046d08c04828 tempest-ProjectMemberTests-819176810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:37 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-72fc8160-9627-43ae-850e-046d08c04828 tempest-ProjectMemberTests-819176810 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:04:37 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-72fc8160-9627-43ae-850e-046d08c04828 tempest-ProjectMemberTests-819176810 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:04:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-72fc8160-9627-43ae-850e-046d08c04828 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a72ffcd0-60b5-40a5-8339-5caa6533d168 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a6ebd4aa-e1d7-4fe4-a362-6febc61d1dc1 tempest-ProjectReaderTests-1299385716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-17248a46-07d8-49d4-9866-8be9c51f3a1b" returned: 0 in 0.509s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a6ebd4aa-e1d7-4fe4-a362-6febc61d1dc1 tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-17248a46-07d8-49d4-9866-8be9c51f3a1b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:37 devstack sudo[106068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a72ffcd0-60b5-40a5-8339-5caa6533d168 1073741824 Nov 06 18:04:37 devstack sudo[106068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:37 devstack sudo[106069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-17248a46-07d8-49d4-9866-8be9c51f3a1b Nov 06 18:04:37 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:37 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-465ce6cb-e4d2-4cbb-8e61-5244217121b8 tempest-CinderUnicodeTest-1465938524 None] Create snapshot completed successfully Nov 06 18:04:37 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a6ebd4aa-e1d7-4fe4-a362-6febc61d1dc1 tempest-ProjectReaderTests-1299385716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-17248a46-07d8-49d4-9866-8be9c51f3a1b" returned: 0 in 0.279s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a6ebd4aa-e1d7-4fe4-a362-6febc61d1dc1 tempest-ProjectReaderTests-1299385716 None] Lock "cinder-quobyte-17248a46-07d8-49d4-9866-8be9c51f3a1b" released by "delete_volume" :: held 0.865s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:37 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-a6ebd4aa-e1d7-4fe4-a362-6febc61d1dc1 tempest-ProjectReaderTests-1299385716 None] Created reservations ['5519e33d-f8f6-4fc4-ac21-3fb720149733', '9b910eca-063e-4ccd-ba22-5a0e5c1316b5', '0626e9d9-47c2-4880-af5b-70d47894ea47', '1616f9eb-3453-4207-9a68-22ffa6459ac3'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:04:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a6ebd4aa-e1d7-4fe4-a362-6febc61d1dc1 tempest-ProjectReaderTests-1299385716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a6ebd4aa-e1d7-4fe4-a362-6febc61d1dc1 tempest-ProjectReaderTests-1299385716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:37 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a6ebd4aa-e1d7-4fe4-a362-6febc61d1dc1 tempest-ProjectReaderTests-1299385716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:04:37 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a6ebd4aa-e1d7-4fe4-a362-6febc61d1dc1 tempest-ProjectReaderTests-1299385716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:04:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a6ebd4aa-e1d7-4fe4-a362-6febc61d1dc1 tempest-ProjectReaderTests-1299385716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a6ebd4aa-e1d7-4fe4-a362-6febc61d1dc1 tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:37 devstack sudo[106077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:04:37 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:38 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-76fb5c78-3b8f-4365-a153-fca225a285fe tempest-CinderUnicodeTest-1465938524 None] Acquiring lock "cinder-c7630600-94f0-4f55-9604-53eff82a68ec-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:38 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-76fb5c78-3b8f-4365-a153-fca225a285fe tempest-CinderUnicodeTest-1465938524 None] Lock "cinder-c7630600-94f0-4f55-9604-53eff82a68ec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:38 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-76fb5c78-3b8f-4365-a153-fca225a285fe tempest-CinderUnicodeTest-1465938524 None] Acquiring lock "cinder-quobyte-b06f8b8d-74b7-4351-9953-50112995774d" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:38 devstack sudo[106068]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-72fc8160-9627-43ae-850e-046d08c04828 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a72ffcd0-60b5-40a5-8339-5caa6533d168 1073741824" returned: 0 in 0.688s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:38 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-76fb5c78-3b8f-4365-a153-fca225a285fe tempest-CinderUnicodeTest-1465938524 None] Lock "cinder-quobyte-b06f8b8d-74b7-4351-9953-50112995774d" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:38 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-76fb5c78-3b8f-4365-a153-fca225a285fe tempest-CinderUnicodeTest-1465938524 None] Acquiring lock "cinder-quobyte-c7630600-94f0-4f55-9604-53eff82a68ec" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:38 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-76fb5c78-3b8f-4365-a153-fca225a285fe tempest-CinderUnicodeTest-1465938524 None] Lock "cinder-quobyte-c7630600-94f0-4f55-9604-53eff82a68ec" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-76fb5c78-3b8f-4365-a153-fca225a285fe tempest-CinderUnicodeTest-1465938524 None] Deleting offline snapshot c7630600-94f0-4f55-9604-53eff82a68ec of volume b06f8b8d-74b7-4351-9953-50112995774d {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:04:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-76fb5c78-3b8f-4365-a153-fca225a285fe tempest-CinderUnicodeTest-1465938524 None] snapshot_file for this snap is: volume-b06f8b8d-74b7-4351-9953-50112995774d.c7630600-94f0-4f55-9604-53eff82a68ec {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:04:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-72fc8160-9627-43ae-850e-046d08c04828 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a72ffcd0-60b5-40a5-8339-5caa6533d168 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:38 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c85273-d5de-4a09-a3a5-e6ae62b60e22]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:04:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-76fb5c78-3b8f-4365-a153-fca225a285fe tempest-CinderUnicodeTest-1465938524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b06f8b8d-74b7-4351-9953-50112995774d.c7630600-94f0-4f55-9604-53eff82a68ec {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:38 devstack sudo[106079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a72ffcd0-60b5-40a5-8339-5caa6533d168 Nov 06 18:04:38 devstack sudo[106079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:38 devstack sudo[106080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b06f8b8d-74b7-4351-9953-50112995774d.c7630600-94f0-4f55-9604-53eff82a68ec Nov 06 18:04:38 devstack sudo[106080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:38 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a6ebd4aa-e1d7-4fe4-a362-6febc61d1dc1 tempest-ProjectReaderTests-1299385716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.490s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:38 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-a6ebd4aa-e1d7-4fe4-a362-6febc61d1dc1 tempest-ProjectReaderTests-1299385716 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:04:38 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-a6ebd4aa-e1d7-4fe4-a362-6febc61d1dc1 tempest-ProjectReaderTests-1299385716 None] Deleted volume successfully. Nov 06 18:04:38 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a6ebd4aa-e1d7-4fe4-a362-6febc61d1dc1 tempest-ProjectReaderTests-1299385716 None] Lock "cinder-17248a46-07d8-49d4-9866-8be9c51f3a1b-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:38 devstack sudo[106079]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-72fc8160-9627-43ae-850e-046d08c04828 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a72ffcd0-60b5-40a5-8339-5caa6533d168" returned: 0 in 0.393s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-72fc8160-9627-43ae-850e-046d08c04828 tempest-ProjectMemberTests-819176810 None] <== create_volume: return (1222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:04:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-72fc8160-9627-43ae-850e-046d08c04828 tempest-ProjectMemberTests-819176810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.225s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-72fc8160-9627-43ae-850e-046d08c04828 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f05bc85e-8c10-4279-b715-25f65481609f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a72ffcd0-60b5-40a5-8339-5caa6533d168', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-72fc8160-9627-43ae-850e-046d08c04828 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6b80242-10c1-496d-a1ca-2339c32b91b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:38 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-72fc8160-9627-43ae-850e-046d08c04828 tempest-ProjectMemberTests-819176810 None] Volume volume-a72ffcd0-60b5-40a5-8339-5caa6533d168 (a72ffcd0-60b5-40a5-8339-5caa6533d168): created successfully Nov 06 18:04:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-72fc8160-9627-43ae-850e-046d08c04828 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6b80242-10c1-496d-a1ca-2339c32b91b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-72fc8160-9627-43ae-850e-046d08c04828 tempest-ProjectMemberTests-819176810 None] Flow 'volume_create_manager' (4cec81c7-10c6-4610-9d55-1a5d44c5e67b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:04:38 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-72fc8160-9627-43ae-850e-046d08c04828 tempest-ProjectMemberTests-819176810 None] Created volume successfully. Nov 06 18:04:38 devstack sudo[106080]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-76fb5c78-3b8f-4365-a153-fca225a285fe tempest-CinderUnicodeTest-1465938524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b06f8b8d-74b7-4351-9953-50112995774d.c7630600-94f0-4f55-9604-53eff82a68ec" returned: 0 in 0.561s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-76fb5c78-3b8f-4365-a153-fca225a285fe tempest-CinderUnicodeTest-1465938524 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b06f8b8d-74b7-4351-9953-50112995774d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:04:38 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e35555-b381-4171-9a96-9ecb2238fc4e]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:04:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-76fb5c78-3b8f-4365-a153-fca225a285fe tempest-CinderUnicodeTest-1465938524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b06f8b8d-74b7-4351-9953-50112995774d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:38 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-407cb2a2-23d8-4054-870e-cb1badd34495 tempest-ProjectReaderTests-1299385716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:04:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-407cb2a2-23d8-4054-870e-cb1badd34495 tempest-ProjectReaderTests-1299385716 None] Flow 'volume_create_manager' (dd209bdf-81d9-49ba-9e5c-e76e55cc123b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:04:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-407cb2a2-23d8-4054-870e-cb1badd34495 tempest-ProjectReaderTests-1299385716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8460aa2a-1f60-432a-8c30-95521affe95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-407cb2a2-23d8-4054-870e-cb1badd34495 tempest-ProjectReaderTests-1299385716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8460aa2a-1f60-432a-8c30-95521affe95d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:04:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-543355776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76e29c5d-a8a0-462f-b71c-51a327930602,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c5284ac37ff4d179815435f871ca0fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:04:39Z,use_quota=True,user_id='caa4f376bb65466cba7edd807cf24033',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-407cb2a2-23d8-4054-870e-cb1badd34495 tempest-ProjectReaderTests-1299385716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c9eeba9-85a3-4a50-a5d2-34d2de1f11cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-407cb2a2-23d8-4054-870e-cb1badd34495 tempest-ProjectReaderTests-1299385716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c9eeba9-85a3-4a50-a5d2-34d2de1f11cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:38 devstack sudo[106089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b06f8b8d-74b7-4351-9953-50112995774d Nov 06 18:04:38 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-407cb2a2-23d8-4054-870e-cb1badd34495 tempest-ProjectReaderTests-1299385716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf934f1c-33ea-4ceb-aeee-2ef27b039bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-407cb2a2-23d8-4054-870e-cb1badd34495 tempest-ProjectReaderTests-1299385716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf934f1c-33ea-4ceb-aeee-2ef27b039bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76e29c5d-a8a0-462f-b71c-51a327930602', 'volume_name': 'volume-76e29c5d-a8a0-462f-b71c-51a327930602', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:39 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-407cb2a2-23d8-4054-870e-cb1badd34495 tempest-ProjectReaderTests-1299385716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (918c11a6-d04a-43e6-80b3-5ef810a29de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:39 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-407cb2a2-23d8-4054-870e-cb1badd34495 tempest-ProjectReaderTests-1299385716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (918c11a6-d04a-43e6-80b3-5ef810a29de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:39 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-407cb2a2-23d8-4054-870e-cb1badd34495 tempest-ProjectReaderTests-1299385716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de29eb5b-e41d-470c-afd4-03c6d4a78de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:39 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-407cb2a2-23d8-4054-870e-cb1badd34495 tempest-ProjectReaderTests-1299385716 None] Volume 76e29c5d-a8a0-462f-b71c-51a327930602: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76e29c5d-a8a0-462f-b71c-51a327930602', 'volume_size': 1} Nov 06 18:04:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-407cb2a2-23d8-4054-870e-cb1badd34495 tempest-ProjectReaderTests-1299385716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-407cb2a2-23d8-4054-870e-cb1badd34495 tempest-ProjectReaderTests-1299385716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:39 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-407cb2a2-23d8-4054-870e-cb1badd34495 tempest-ProjectReaderTests-1299385716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:04:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-543355776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76e29c5d-a8a0-462f-b71c-51a327930602,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c5284ac37ff4d179815435f871ca0fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:04:39Z,use_quota=True,user_id='caa4f376bb65466cba7edd807cf24033',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:04:39 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-407cb2a2-23d8-4054-870e-cb1badd34495 tempest-ProjectReaderTests-1299385716 None] Creating volume 76e29c5d-a8a0-462f-b71c-51a327930602 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:04:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-407cb2a2-23d8-4054-870e-cb1badd34495 tempest-ProjectReaderTests-1299385716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-407cb2a2-23d8-4054-870e-cb1badd34495 tempest-ProjectReaderTests-1299385716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:39 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-407cb2a2-23d8-4054-870e-cb1badd34495 tempest-ProjectReaderTests-1299385716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:04:39 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-407cb2a2-23d8-4054-870e-cb1badd34495 tempest-ProjectReaderTests-1299385716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:04:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-407cb2a2-23d8-4054-870e-cb1badd34495 tempest-ProjectReaderTests-1299385716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:39 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-407cb2a2-23d8-4054-870e-cb1badd34495 tempest-ProjectReaderTests-1299385716 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:04:39 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-407cb2a2-23d8-4054-870e-cb1badd34495 tempest-ProjectReaderTests-1299385716 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:04:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-407cb2a2-23d8-4054-870e-cb1badd34495 tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-76e29c5d-a8a0-462f-b71c-51a327930602 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:39 devstack sudo[106091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-76e29c5d-a8a0-462f-b71c-51a327930602 1073741824 Nov 06 18:04:39 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:39 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-76fb5c78-3b8f-4365-a153-fca225a285fe tempest-CinderUnicodeTest-1465938524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b06f8b8d-74b7-4351-9953-50112995774d" returned: 0 in 0.501s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-76fb5c78-3b8f-4365-a153-fca225a285fe tempest-CinderUnicodeTest-1465938524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b06f8b8d-74b7-4351-9953-50112995774d.c7630600-94f0-4f55-9604-53eff82a68ec {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:39 devstack sudo[106099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b06f8b8d-74b7-4351-9953-50112995774d.c7630600-94f0-4f55-9604-53eff82a68ec Nov 06 18:04:39 devstack sudo[106099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-408a61dd-50e3-4eae-93ae-4b7577443c44 tempest-ProjectMemberTests-819176810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:39 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-407cb2a2-23d8-4054-870e-cb1badd34495 tempest-ProjectReaderTests-1299385716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-76e29c5d-a8a0-462f-b71c-51a327930602 1073741824" returned: 0 in 0.602s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-407cb2a2-23d8-4054-870e-cb1badd34495 tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-76e29c5d-a8a0-462f-b71c-51a327930602 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:39 devstack sudo[106105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-76e29c5d-a8a0-462f-b71c-51a327930602 Nov 06 18:04:39 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:39 devstack sudo[106099]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-76fb5c78-3b8f-4365-a153-fca225a285fe tempest-CinderUnicodeTest-1465938524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b06f8b8d-74b7-4351-9953-50112995774d.c7630600-94f0-4f55-9604-53eff82a68ec" returned: 0 in 0.426s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-76fb5c78-3b8f-4365-a153-fca225a285fe tempest-CinderUnicodeTest-1465938524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b06f8b8d-74b7-4351-9953-50112995774d.c7630600-94f0-4f55-9604-53eff82a68ec {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:39 devstack sudo[106107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b06f8b8d-74b7-4351-9953-50112995774d.c7630600-94f0-4f55-9604-53eff82a68ec Nov 06 18:04:39 devstack sudo[106107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:39 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-407cb2a2-23d8-4054-870e-cb1badd34495 tempest-ProjectReaderTests-1299385716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-76e29c5d-a8a0-462f-b71c-51a327930602" returned: 0 in 0.286s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:39 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-407cb2a2-23d8-4054-870e-cb1badd34495 tempest-ProjectReaderTests-1299385716 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:04:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-407cb2a2-23d8-4054-870e-cb1badd34495 tempest-ProjectReaderTests-1299385716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-408a61dd-50e3-4eae-93ae-4b7577443c44 tempest-ProjectMemberTests-819176810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.369s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:39 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-408a61dd-50e3-4eae-93ae-4b7577443c44 tempest-ProjectMemberTests-819176810 None] Creating offline snapshot f45d19ff-0521-4749-a374-cf3952735b22 of volume a72ffcd0-60b5-40a5-8339-5caa6533d168 {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:04:40 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-407cb2a2-23d8-4054-870e-cb1badd34495 tempest-ProjectReaderTests-1299385716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de29eb5b-e41d-470c-afd4-03c6d4a78de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76e29c5d-a8a0-462f-b71c-51a327930602', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:40 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-407cb2a2-23d8-4054-870e-cb1badd34495 tempest-ProjectReaderTests-1299385716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (265d2c0c-6276-43c3-ac47-212196cd1e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:40 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ea2548-9c0a-485a-a253-39ff40d1d157]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:04:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-408a61dd-50e3-4eae-93ae-4b7577443c44 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a72ffcd0-60b5-40a5-8339-5caa6533d168 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:40 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-407cb2a2-23d8-4054-870e-cb1badd34495 tempest-ProjectReaderTests-1299385716 None] Volume volume-76e29c5d-a8a0-462f-b71c-51a327930602 (76e29c5d-a8a0-462f-b71c-51a327930602): created successfully Nov 06 18:04:40 devstack sudo[106107]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:40 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-407cb2a2-23d8-4054-870e-cb1badd34495 tempest-ProjectReaderTests-1299385716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (265d2c0c-6276-43c3-ac47-212196cd1e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:40 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-407cb2a2-23d8-4054-870e-cb1badd34495 tempest-ProjectReaderTests-1299385716 None] Flow 'volume_create_manager' (dd209bdf-81d9-49ba-9e5c-e76e55cc123b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:04:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-76fb5c78-3b8f-4365-a153-fca225a285fe tempest-CinderUnicodeTest-1465938524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b06f8b8d-74b7-4351-9953-50112995774d.c7630600-94f0-4f55-9604-53eff82a68ec" returned: 0 in 0.307s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:40 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-407cb2a2-23d8-4054-870e-cb1badd34495 tempest-ProjectReaderTests-1299385716 None] Created volume successfully. Nov 06 18:04:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-76fb5c78-3b8f-4365-a153-fca225a285fe tempest-CinderUnicodeTest-1465938524 None] Lock "cinder-quobyte-c7630600-94f0-4f55-9604-53eff82a68ec" released by "_delete_snapshot" :: held 1.980s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-76fb5c78-3b8f-4365-a153-fca225a285fe tempest-CinderUnicodeTest-1465938524 None] Lock "cinder-quobyte-b06f8b8d-74b7-4351-9953-50112995774d" released by "delete_snapshot" :: held 2.019s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:40 devstack sudo[106111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a72ffcd0-60b5-40a5-8339-5caa6533d168 Nov 06 18:04:40 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:40 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-76fb5c78-3b8f-4365-a153-fca225a285fe tempest-CinderUnicodeTest-1465938524 None] Created reservations ['22921e3d-c8de-4dda-93a9-988c2a0e9574', '34b41fcc-04fa-43eb-89dd-b14a65642278', 'b7270649-425e-4706-9d96-dd334f6a66a5', '020d8b74-ca14-400c-851f-f294319db670'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:04:40 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-76fb5c78-3b8f-4365-a153-fca225a285fe tempest-CinderUnicodeTest-1465938524 None] Delete snapshot completed successfully. Nov 06 18:04:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-76fb5c78-3b8f-4365-a153-fca225a285fe tempest-CinderUnicodeTest-1465938524 None] Lock "cinder-c7630600-94f0-4f55-9604-53eff82a68ec-delete_snapshot" released by "delete_snapshot" :: held 2.224s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-94be93cd-aebc-4153-b320-75f8a0bcdbdc tempest-CinderUnicodeTest-1465938524 None] Acquiring lock "cinder-b06f8b8d-74b7-4351-9953-50112995774d-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-94be93cd-aebc-4153-b320-75f8a0bcdbdc tempest-CinderUnicodeTest-1465938524 None] Lock "cinder-b06f8b8d-74b7-4351-9953-50112995774d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-94be93cd-aebc-4153-b320-75f8a0bcdbdc tempest-CinderUnicodeTest-1465938524 None] Acquiring lock "cinder-quobyte-b06f8b8d-74b7-4351-9953-50112995774d" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-94be93cd-aebc-4153-b320-75f8a0bcdbdc tempest-CinderUnicodeTest-1465938524 None] Lock "cinder-quobyte-b06f8b8d-74b7-4351-9953-50112995774d" acquired by "delete_volume" :: waited 0.028s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:40 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-408a61dd-50e3-4eae-93ae-4b7577443c44 tempest-ProjectMemberTests-819176810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a72ffcd0-60b5-40a5-8339-5caa6533d168" returned: 0 in 0.475s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-408a61dd-50e3-4eae-93ae-4b7577443c44 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a72ffcd0-60b5-40a5-8339-5caa6533d168,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a72ffcd0-60b5-40a5-8339-5caa6533d168.f45d19ff-0521-4749-a374-cf3952735b22 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:40 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb4cac8-e43c-4df3-b374-0351ee5d770c]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:04:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-94be93cd-aebc-4153-b320-75f8a0bcdbdc tempest-CinderUnicodeTest-1465938524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b06f8b8d-74b7-4351-9953-50112995774d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:40 devstack sudo[106116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a72ffcd0-60b5-40a5-8339-5caa6533d168,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a72ffcd0-60b5-40a5-8339-5caa6533d168.f45d19ff-0521-4749-a374-cf3952735b22 1G Nov 06 18:04:40 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:40 devstack sudo[106117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b06f8b8d-74b7-4351-9953-50112995774d Nov 06 18:04:40 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:40 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-94be93cd-aebc-4153-b320-75f8a0bcdbdc tempest-CinderUnicodeTest-1465938524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b06f8b8d-74b7-4351-9953-50112995774d" returned: 0 in 0.427s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-94be93cd-aebc-4153-b320-75f8a0bcdbdc tempest-CinderUnicodeTest-1465938524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b06f8b8d-74b7-4351-9953-50112995774d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:41 devstack sudo[106127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b06f8b8d-74b7-4351-9953-50112995774d Nov 06 18:04:41 devstack sudo[106127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:41 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-408a61dd-50e3-4eae-93ae-4b7577443c44 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a72ffcd0-60b5-40a5-8339-5caa6533d168,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a72ffcd0-60b5-40a5-8339-5caa6533d168.f45d19ff-0521-4749-a374-cf3952735b22 1G" returned: 0 in 0.533s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-408a61dd-50e3-4eae-93ae-4b7577443c44 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a72ffcd0-60b5-40a5-8339-5caa6533d168 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a72ffcd0-60b5-40a5-8339-5caa6533d168.f45d19ff-0521-4749-a374-cf3952735b22 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:41 devstack sudo[106129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a72ffcd0-60b5-40a5-8339-5caa6533d168 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a72ffcd0-60b5-40a5-8339-5caa6533d168.f45d19ff-0521-4749-a374-cf3952735b22 Nov 06 18:04:41 devstack sudo[106129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7cb3fee7-a27d-4138-93f4-2ea255074744 tempest-ProjectReaderTests-1299385716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:41 devstack sudo[106127]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-94be93cd-aebc-4153-b320-75f8a0bcdbdc tempest-CinderUnicodeTest-1465938524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-b06f8b8d-74b7-4351-9953-50112995774d" returned: 0 in 0.304s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:41 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-94be93cd-aebc-4153-b320-75f8a0bcdbdc tempest-CinderUnicodeTest-1465938524 None] Lock "cinder-quobyte-b06f8b8d-74b7-4351-9953-50112995774d" released by "delete_volume" :: held 0.831s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:41 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-94be93cd-aebc-4153-b320-75f8a0bcdbdc tempest-CinderUnicodeTest-1465938524 None] Created reservations ['28eea423-862c-4439-9aa7-3e287ddc819a', 'c7b991e6-22a5-42f2-b05d-a752aca3cf9d', '29761c37-c81c-49ac-aee6-eaf800b9eb49', '2a84e37d-de55-4244-88a9-d66db5536e8c'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:04:41 devstack sudo[106129]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-408a61dd-50e3-4eae-93ae-4b7577443c44 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a72ffcd0-60b5-40a5-8339-5caa6533d168 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a72ffcd0-60b5-40a5-8339-5caa6533d168.f45d19ff-0521-4749-a374-cf3952735b22" returned: 0 in 0.406s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:41 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-408a61dd-50e3-4eae-93ae-4b7577443c44 tempest-ProjectMemberTests-819176810 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a72ffcd0-60b5-40a5-8339-5caa6533d168.f45d19ff-0521-4749-a374-cf3952735b22 is being set with open permissions: ugo+rw Nov 06 18:04:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-408a61dd-50e3-4eae-93ae-4b7577443c44 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a72ffcd0-60b5-40a5-8339-5caa6533d168.f45d19ff-0521-4749-a374-cf3952735b22 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:41 devstack sudo[106137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a72ffcd0-60b5-40a5-8339-5caa6533d168.f45d19ff-0521-4749-a374-cf3952735b22 Nov 06 18:04:41 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-94be93cd-aebc-4153-b320-75f8a0bcdbdc tempest-CinderUnicodeTest-1465938524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-94be93cd-aebc-4153-b320-75f8a0bcdbdc tempest-CinderUnicodeTest-1465938524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:41 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-94be93cd-aebc-4153-b320-75f8a0bcdbdc tempest-CinderUnicodeTest-1465938524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:04:41 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-94be93cd-aebc-4153-b320-75f8a0bcdbdc tempest-CinderUnicodeTest-1465938524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:04:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-94be93cd-aebc-4153-b320-75f8a0bcdbdc tempest-CinderUnicodeTest-1465938524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-94be93cd-aebc-4153-b320-75f8a0bcdbdc tempest-CinderUnicodeTest-1465938524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:41 devstack sudo[106139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:04:41 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:41 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9d10d6a1-891f-4d26-a0e6-a0b1da509172 tempest-CinderUnicodeTest-1465938524 None] Acquiring lock "cinder-59978153-84d8-44ee-a003-1430734edb46-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:41 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9d10d6a1-891f-4d26-a0e6-a0b1da509172 tempest-CinderUnicodeTest-1465938524 None] Lock "cinder-59978153-84d8-44ee-a003-1430734edb46-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:41 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9d10d6a1-891f-4d26-a0e6-a0b1da509172 tempest-CinderUnicodeTest-1465938524 None] Acquiring lock "cinder-quobyte-59978153-84d8-44ee-a003-1430734edb46" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:41 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9d10d6a1-891f-4d26-a0e6-a0b1da509172 tempest-CinderUnicodeTest-1465938524 None] Lock "cinder-quobyte-59978153-84d8-44ee-a003-1430734edb46" acquired by "delete_volume" :: waited 0.018s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:41 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14910e3-723f-4db0-a012-9f79a8c53a88]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:04:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9d10d6a1-891f-4d26-a0e6-a0b1da509172 tempest-CinderUnicodeTest-1465938524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-59978153-84d8-44ee-a003-1430734edb46 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:41 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-408a61dd-50e3-4eae-93ae-4b7577443c44 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a72ffcd0-60b5-40a5-8339-5caa6533d168.f45d19ff-0521-4749-a374-cf3952735b22" returned: 0 in 0.373s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-408a61dd-50e3-4eae-93ae-4b7577443c44 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a72ffcd0-60b5-40a5-8339-5caa6533d168.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:41 devstack sudo[106144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a72ffcd0-60b5-40a5-8339-5caa6533d168.info Nov 06 18:04:41 devstack sudo[106144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:41 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-94be93cd-aebc-4153-b320-75f8a0bcdbdc tempest-CinderUnicodeTest-1465938524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.364s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:41 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-94be93cd-aebc-4153-b320-75f8a0bcdbdc tempest-CinderUnicodeTest-1465938524 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:04:41 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-94be93cd-aebc-4153-b320-75f8a0bcdbdc tempest-CinderUnicodeTest-1465938524 None] Deleted volume successfully. Nov 06 18:04:41 devstack sudo[106142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-59978153-84d8-44ee-a003-1430734edb46 Nov 06 18:04:41 devstack sudo[106142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:41 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-94be93cd-aebc-4153-b320-75f8a0bcdbdc tempest-CinderUnicodeTest-1465938524 None] Lock "cinder-b06f8b8d-74b7-4351-9953-50112995774d-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:42 devstack sudo[106144]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-408a61dd-50e3-4eae-93ae-4b7577443c44 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a72ffcd0-60b5-40a5-8339-5caa6533d168.info" returned: 0 in 0.324s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:42 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-408a61dd-50e3-4eae-93ae-4b7577443c44 tempest-ProjectMemberTests-819176810 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a72ffcd0-60b5-40a5-8339-5caa6533d168.info is being set with open permissions: ugo+rw Nov 06 18:04:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-408a61dd-50e3-4eae-93ae-4b7577443c44 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a72ffcd0-60b5-40a5-8339-5caa6533d168.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:42 devstack sudo[106142]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:42 devstack sudo[106151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a72ffcd0-60b5-40a5-8339-5caa6533d168.info Nov 06 18:04:42 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9d10d6a1-891f-4d26-a0e6-a0b1da509172 tempest-CinderUnicodeTest-1465938524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-59978153-84d8-44ee-a003-1430734edb46" returned: 0 in 0.435s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9d10d6a1-891f-4d26-a0e6-a0b1da509172 tempest-CinderUnicodeTest-1465938524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-59978153-84d8-44ee-a003-1430734edb46 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:42 devstack sudo[106153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-59978153-84d8-44ee-a003-1430734edb46 Nov 06 18:04:42 devstack sudo[106153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:42 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-408a61dd-50e3-4eae-93ae-4b7577443c44 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a72ffcd0-60b5-40a5-8339-5caa6533d168.info" returned: 0 in 0.260s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-408a61dd-50e3-4eae-93ae-4b7577443c44 tempest-ProjectMemberTests-819176810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.503s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7cb3fee7-a27d-4138-93f4-2ea255074744 tempest-ProjectReaderTests-1299385716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.250s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:42 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-7cb3fee7-a27d-4138-93f4-2ea255074744 tempest-ProjectReaderTests-1299385716 None] Creating offline snapshot 3752e7d7-cfe2-4712-90b1-5909c38fca65 of volume 76e29c5d-a8a0-462f-b71c-51a327930602 {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:04:42 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-408a61dd-50e3-4eae-93ae-4b7577443c44 tempest-ProjectMemberTests-819176810 None] Create snapshot completed successfully Nov 06 18:04:42 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8ceb5d-5b9c-4a33-b7ad-87f5f2dec33d]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:04:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7cb3fee7-a27d-4138-93f4-2ea255074744 tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-76e29c5d-a8a0-462f-b71c-51a327930602 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:42 devstack sudo[106153]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9d10d6a1-891f-4d26-a0e6-a0b1da509172 tempest-CinderUnicodeTest-1465938524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-59978153-84d8-44ee-a003-1430734edb46" returned: 0 in 0.319s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:42 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9d10d6a1-891f-4d26-a0e6-a0b1da509172 tempest-CinderUnicodeTest-1465938524 None] Lock "cinder-quobyte-59978153-84d8-44ee-a003-1430734edb46" released by "delete_volume" :: held 0.814s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:42 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-9d10d6a1-891f-4d26-a0e6-a0b1da509172 tempest-CinderUnicodeTest-1465938524 None] Created reservations ['3e02cf41-51e2-46f4-8fe7-904e6da30031', '9d0131ef-a4a7-400c-a34d-bae931cba8f2', 'f711d1e7-93c0-44d0-ba07-bd45edd59f65', '95cd930b-c9c8-480a-88cf-23a619212faf'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:04:42 devstack sudo[106157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-76e29c5d-a8a0-462f-b71c-51a327930602 Nov 06 18:04:42 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9d10d6a1-891f-4d26-a0e6-a0b1da509172 tempest-CinderUnicodeTest-1465938524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9d10d6a1-891f-4d26-a0e6-a0b1da509172 tempest-CinderUnicodeTest-1465938524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:42 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9d10d6a1-891f-4d26-a0e6-a0b1da509172 tempest-CinderUnicodeTest-1465938524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:04:42 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9d10d6a1-891f-4d26-a0e6-a0b1da509172 tempest-CinderUnicodeTest-1465938524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:04:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9d10d6a1-891f-4d26-a0e6-a0b1da509172 tempest-CinderUnicodeTest-1465938524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9d10d6a1-891f-4d26-a0e6-a0b1da509172 tempest-CinderUnicodeTest-1465938524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:42 devstack sudo[106159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:04:42 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:42 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8a8269d6-f0f9-4244-a0f2-be902e353e8f tempest-ProjectMemberTests-819176810 None] Acquiring lock "cinder-f45d19ff-0521-4749-a374-cf3952735b22-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:42 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8a8269d6-f0f9-4244-a0f2-be902e353e8f tempest-ProjectMemberTests-819176810 None] Lock "cinder-f45d19ff-0521-4749-a374-cf3952735b22-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:42 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8a8269d6-f0f9-4244-a0f2-be902e353e8f tempest-ProjectMemberTests-819176810 None] Acquiring lock "cinder-quobyte-a72ffcd0-60b5-40a5-8339-5caa6533d168" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:42 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8a8269d6-f0f9-4244-a0f2-be902e353e8f tempest-ProjectMemberTests-819176810 None] Lock "cinder-quobyte-a72ffcd0-60b5-40a5-8339-5caa6533d168" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:42 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8a8269d6-f0f9-4244-a0f2-be902e353e8f tempest-ProjectMemberTests-819176810 None] Acquiring lock "cinder-quobyte-f45d19ff-0521-4749-a374-cf3952735b22" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:42 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8a8269d6-f0f9-4244-a0f2-be902e353e8f tempest-ProjectMemberTests-819176810 None] Lock "cinder-quobyte-f45d19ff-0521-4749-a374-cf3952735b22" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:42 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-8a8269d6-f0f9-4244-a0f2-be902e353e8f tempest-ProjectMemberTests-819176810 None] Deleting offline snapshot f45d19ff-0521-4749-a374-cf3952735b22 of volume a72ffcd0-60b5-40a5-8339-5caa6533d168 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:04:42 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-8a8269d6-f0f9-4244-a0f2-be902e353e8f tempest-ProjectMemberTests-819176810 None] snapshot_file for this snap is: volume-a72ffcd0-60b5-40a5-8339-5caa6533d168.f45d19ff-0521-4749-a374-cf3952735b22 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:04:42 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c795e93-a09d-4f5e-9cac-cbde20f0484e]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:04:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8a8269d6-f0f9-4244-a0f2-be902e353e8f tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a72ffcd0-60b5-40a5-8339-5caa6533d168.f45d19ff-0521-4749-a374-cf3952735b22 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:43 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7cb3fee7-a27d-4138-93f4-2ea255074744 tempest-ProjectReaderTests-1299385716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-76e29c5d-a8a0-462f-b71c-51a327930602" returned: 0 in 0.464s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7cb3fee7-a27d-4138-93f4-2ea255074744 tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-76e29c5d-a8a0-462f-b71c-51a327930602,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-76e29c5d-a8a0-462f-b71c-51a327930602.3752e7d7-cfe2-4712-90b1-5909c38fca65 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:43 devstack sudo[106166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-76e29c5d-a8a0-462f-b71c-51a327930602,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-76e29c5d-a8a0-462f-b71c-51a327930602.3752e7d7-cfe2-4712-90b1-5909c38fca65 1G Nov 06 18:04:43 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:43 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9d10d6a1-891f-4d26-a0e6-a0b1da509172 tempest-CinderUnicodeTest-1465938524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.384s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:43 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-9d10d6a1-891f-4d26-a0e6-a0b1da509172 tempest-CinderUnicodeTest-1465938524 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:04:43 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-9d10d6a1-891f-4d26-a0e6-a0b1da509172 tempest-CinderUnicodeTest-1465938524 None] Deleted volume successfully. Nov 06 18:04:43 devstack sudo[106165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a72ffcd0-60b5-40a5-8339-5caa6533d168.f45d19ff-0521-4749-a374-cf3952735b22 Nov 06 18:04:43 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:43 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9d10d6a1-891f-4d26-a0e6-a0b1da509172 tempest-CinderUnicodeTest-1465938524 None] Lock "cinder-59978153-84d8-44ee-a003-1430734edb46-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:43 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8a8269d6-f0f9-4244-a0f2-be902e353e8f tempest-ProjectMemberTests-819176810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a72ffcd0-60b5-40a5-8339-5caa6533d168.f45d19ff-0521-4749-a374-cf3952735b22" returned: 0 in 0.494s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-8a8269d6-f0f9-4244-a0f2-be902e353e8f tempest-ProjectMemberTests-819176810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a72ffcd0-60b5-40a5-8339-5caa6533d168(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:04:43 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74c09aa-a615-4dff-b0ab-3adab5021e91]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:04:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8a8269d6-f0f9-4244-a0f2-be902e353e8f tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a72ffcd0-60b5-40a5-8339-5caa6533d168 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:43 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7cb3fee7-a27d-4138-93f4-2ea255074744 tempest-ProjectReaderTests-1299385716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-76e29c5d-a8a0-462f-b71c-51a327930602,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-76e29c5d-a8a0-462f-b71c-51a327930602.3752e7d7-cfe2-4712-90b1-5909c38fca65 1G" returned: 0 in 0.616s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7cb3fee7-a27d-4138-93f4-2ea255074744 tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76e29c5d-a8a0-462f-b71c-51a327930602 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-76e29c5d-a8a0-462f-b71c-51a327930602.3752e7d7-cfe2-4712-90b1-5909c38fca65 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:43 devstack sudo[106178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76e29c5d-a8a0-462f-b71c-51a327930602 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-76e29c5d-a8a0-462f-b71c-51a327930602.3752e7d7-cfe2-4712-90b1-5909c38fca65 Nov 06 18:04:43 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:43 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a72ffcd0-60b5-40a5-8339-5caa6533d168 Nov 06 18:04:43 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:44 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7cb3fee7-a27d-4138-93f4-2ea255074744 tempest-ProjectReaderTests-1299385716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76e29c5d-a8a0-462f-b71c-51a327930602 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-76e29c5d-a8a0-462f-b71c-51a327930602.3752e7d7-cfe2-4712-90b1-5909c38fca65" returned: 0 in 0.427s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:44 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-7cb3fee7-a27d-4138-93f4-2ea255074744 tempest-ProjectReaderTests-1299385716 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-76e29c5d-a8a0-462f-b71c-51a327930602.3752e7d7-cfe2-4712-90b1-5909c38fca65 is being set with open permissions: ugo+rw Nov 06 18:04:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7cb3fee7-a27d-4138-93f4-2ea255074744 tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-76e29c5d-a8a0-462f-b71c-51a327930602.3752e7d7-cfe2-4712-90b1-5909c38fca65 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:44 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:44 devstack sudo[106188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-76e29c5d-a8a0-462f-b71c-51a327930602.3752e7d7-cfe2-4712-90b1-5909c38fca65 Nov 06 18:04:44 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8a8269d6-f0f9-4244-a0f2-be902e353e8f tempest-ProjectMemberTests-819176810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a72ffcd0-60b5-40a5-8339-5caa6533d168" returned: 0 in 0.608s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8a8269d6-f0f9-4244-a0f2-be902e353e8f tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a72ffcd0-60b5-40a5-8339-5caa6533d168.f45d19ff-0521-4749-a374-cf3952735b22 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:44 devstack sudo[106190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a72ffcd0-60b5-40a5-8339-5caa6533d168.f45d19ff-0521-4749-a374-cf3952735b22 Nov 06 18:04:44 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:44 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7cb3fee7-a27d-4138-93f4-2ea255074744 tempest-ProjectReaderTests-1299385716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-76e29c5d-a8a0-462f-b71c-51a327930602.3752e7d7-cfe2-4712-90b1-5909c38fca65" returned: 0 in 0.431s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7cb3fee7-a27d-4138-93f4-2ea255074744 tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-76e29c5d-a8a0-462f-b71c-51a327930602.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:44 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8a8269d6-f0f9-4244-a0f2-be902e353e8f tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a72ffcd0-60b5-40a5-8339-5caa6533d168.f45d19ff-0521-4749-a374-cf3952735b22" returned: 0 in 0.459s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8a8269d6-f0f9-4244-a0f2-be902e353e8f tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a72ffcd0-60b5-40a5-8339-5caa6533d168.f45d19ff-0521-4749-a374-cf3952735b22 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:44 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-76e29c5d-a8a0-462f-b71c-51a327930602.info Nov 06 18:04:44 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:44 devstack sudo[106199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a72ffcd0-60b5-40a5-8339-5caa6533d168.f45d19ff-0521-4749-a374-cf3952735b22 Nov 06 18:04:44 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:44 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8a8269d6-f0f9-4244-a0f2-be902e353e8f tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a72ffcd0-60b5-40a5-8339-5caa6533d168.f45d19ff-0521-4749-a374-cf3952735b22" returned: 0 in 0.331s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:44 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7cb3fee7-a27d-4138-93f4-2ea255074744 tempest-ProjectReaderTests-1299385716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-76e29c5d-a8a0-462f-b71c-51a327930602.info" returned: 0 in 0.410s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:44 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-7cb3fee7-a27d-4138-93f4-2ea255074744 tempest-ProjectReaderTests-1299385716 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-76e29c5d-a8a0-462f-b71c-51a327930602.info is being set with open permissions: ugo+rw Nov 06 18:04:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7cb3fee7-a27d-4138-93f4-2ea255074744 tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-76e29c5d-a8a0-462f-b71c-51a327930602.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:44 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8a8269d6-f0f9-4244-a0f2-be902e353e8f tempest-ProjectMemberTests-819176810 None] Lock "cinder-quobyte-f45d19ff-0521-4749-a374-cf3952735b22" released by "_delete_snapshot" :: held 2.064s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:44 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8a8269d6-f0f9-4244-a0f2-be902e353e8f tempest-ProjectMemberTests-819176810 None] Lock "cinder-quobyte-a72ffcd0-60b5-40a5-8339-5caa6533d168" released by "delete_snapshot" :: held 2.101s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:44 devstack sudo[106203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-76e29c5d-a8a0-462f-b71c-51a327930602.info Nov 06 18:04:44 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:45 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-8a8269d6-f0f9-4244-a0f2-be902e353e8f tempest-ProjectMemberTests-819176810 None] Created reservations ['d5e5cf14-7840-4ef4-a97a-ea16485432a4', '51afd3f4-9f6e-4f26-8b78-6dd77c3a3760', 'd97006a6-543d-48a9-bde4-429ec721a39f', '637329ab-8f2a-4072-b0fd-c2afa26d7096'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:04:45 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-8a8269d6-f0f9-4244-a0f2-be902e353e8f tempest-ProjectMemberTests-819176810 None] Delete snapshot completed successfully. Nov 06 18:04:45 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8a8269d6-f0f9-4244-a0f2-be902e353e8f tempest-ProjectMemberTests-819176810 None] Lock "cinder-f45d19ff-0521-4749-a374-cf3952735b22-delete_snapshot" released by "delete_snapshot" :: held 2.314s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:45 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7cb3fee7-a27d-4138-93f4-2ea255074744 tempest-ProjectReaderTests-1299385716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-76e29c5d-a8a0-462f-b71c-51a327930602.info" returned: 0 in 0.376s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7cb3fee7-a27d-4138-93f4-2ea255074744 tempest-ProjectReaderTests-1299385716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.874s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:45 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-7cb3fee7-a27d-4138-93f4-2ea255074744 tempest-ProjectReaderTests-1299385716 None] Create snapshot completed successfully Nov 06 18:04:46 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-df88015b-b3cd-42f5-b373-ad91f31cc90e tempest-ProjectMemberTests-819176810 None] Acquiring lock "cinder-a72ffcd0-60b5-40a5-8339-5caa6533d168-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:46 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-df88015b-b3cd-42f5-b373-ad91f31cc90e tempest-ProjectMemberTests-819176810 None] Lock "cinder-a72ffcd0-60b5-40a5-8339-5caa6533d168-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:46 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-df88015b-b3cd-42f5-b373-ad91f31cc90e tempest-ProjectMemberTests-819176810 None] Acquiring lock "cinder-quobyte-a72ffcd0-60b5-40a5-8339-5caa6533d168" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:46 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-df88015b-b3cd-42f5-b373-ad91f31cc90e tempest-ProjectMemberTests-819176810 None] Lock "cinder-quobyte-a72ffcd0-60b5-40a5-8339-5caa6533d168" acquired by "delete_volume" :: waited 0.019s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:46 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f46b840-eaa2-4c3f-b460-b09b621fa55d]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:04:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-df88015b-b3cd-42f5-b373-ad91f31cc90e tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a72ffcd0-60b5-40a5-8339-5caa6533d168 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:46 devstack sudo[106206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a72ffcd0-60b5-40a5-8339-5caa6533d168 Nov 06 18:04:46 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:46 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ca05e228-3b33-4ac5-9800-b2dcc9080e38 tempest-ProjectReaderTests-1299385716 None] Acquiring lock "cinder-3752e7d7-cfe2-4712-90b1-5909c38fca65-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:46 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ca05e228-3b33-4ac5-9800-b2dcc9080e38 tempest-ProjectReaderTests-1299385716 None] Lock "cinder-3752e7d7-cfe2-4712-90b1-5909c38fca65-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:46 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ca05e228-3b33-4ac5-9800-b2dcc9080e38 tempest-ProjectReaderTests-1299385716 None] Acquiring lock "cinder-quobyte-76e29c5d-a8a0-462f-b71c-51a327930602" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:46 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ca05e228-3b33-4ac5-9800-b2dcc9080e38 tempest-ProjectReaderTests-1299385716 None] Lock "cinder-quobyte-76e29c5d-a8a0-462f-b71c-51a327930602" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:46 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ca05e228-3b33-4ac5-9800-b2dcc9080e38 tempest-ProjectReaderTests-1299385716 None] Acquiring lock "cinder-quobyte-3752e7d7-cfe2-4712-90b1-5909c38fca65" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:46 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ca05e228-3b33-4ac5-9800-b2dcc9080e38 tempest-ProjectReaderTests-1299385716 None] Lock "cinder-quobyte-3752e7d7-cfe2-4712-90b1-5909c38fca65" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:46 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-ca05e228-3b33-4ac5-9800-b2dcc9080e38 tempest-ProjectReaderTests-1299385716 None] Deleting offline snapshot 3752e7d7-cfe2-4712-90b1-5909c38fca65 of volume 76e29c5d-a8a0-462f-b71c-51a327930602 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:04:46 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-ca05e228-3b33-4ac5-9800-b2dcc9080e38 tempest-ProjectReaderTests-1299385716 None] snapshot_file for this snap is: volume-76e29c5d-a8a0-462f-b71c-51a327930602.3752e7d7-cfe2-4712-90b1-5909c38fca65 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:04:46 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[9159bb1b-2f84-4ed1-a1b6-eac0ba1e7c91]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:04:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ca05e228-3b33-4ac5-9800-b2dcc9080e38 tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-76e29c5d-a8a0-462f-b71c-51a327930602.3752e7d7-cfe2-4712-90b1-5909c38fca65 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:46 devstack sudo[106208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-76e29c5d-a8a0-462f-b71c-51a327930602.3752e7d7-cfe2-4712-90b1-5909c38fca65 Nov 06 18:04:46 devstack sudo[106208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:46 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-df88015b-b3cd-42f5-b373-ad91f31cc90e tempest-ProjectMemberTests-819176810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a72ffcd0-60b5-40a5-8339-5caa6533d168" returned: 0 in 0.604s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-df88015b-b3cd-42f5-b373-ad91f31cc90e tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a72ffcd0-60b5-40a5-8339-5caa6533d168 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:46 devstack sudo[106213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a72ffcd0-60b5-40a5-8339-5caa6533d168 Nov 06 18:04:46 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:47 devstack sudo[106208]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ca05e228-3b33-4ac5-9800-b2dcc9080e38 tempest-ProjectReaderTests-1299385716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-76e29c5d-a8a0-462f-b71c-51a327930602.3752e7d7-cfe2-4712-90b1-5909c38fca65" returned: 0 in 0.485s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-ca05e228-3b33-4ac5-9800-b2dcc9080e38 tempest-ProjectReaderTests-1299385716 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76e29c5d-a8a0-462f-b71c-51a327930602(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:04:47 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e291d3e0-35ae-4e0d-abbe-42b2e9e89df6]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:04:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ca05e228-3b33-4ac5-9800-b2dcc9080e38 tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-76e29c5d-a8a0-462f-b71c-51a327930602 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:47 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-df88015b-b3cd-42f5-b373-ad91f31cc90e tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a72ffcd0-60b5-40a5-8339-5caa6533d168" returned: 0 in 0.344s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-df88015b-b3cd-42f5-b373-ad91f31cc90e tempest-ProjectMemberTests-819176810 None] Lock "cinder-quobyte-a72ffcd0-60b5-40a5-8339-5caa6533d168" released by "delete_volume" :: held 1.057s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9317a752-1b64-4fcc-bdbd-9b8855c26426 tempest-ProjectAdminTests-290132400 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8181610107422, 'free_capacity_gb': 1773.8181610107422, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87068) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 06 18:04:47 devstack sudo[106219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-76e29c5d-a8a0-462f-b71c-51a327930602 Nov 06 18:04:47 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:47 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-df88015b-b3cd-42f5-b373-ad91f31cc90e tempest-ProjectMemberTests-819176810 None] Created reservations ['082f827c-ec74-4c13-a671-d42be2fd70ce', '4979a17b-1b51-4c21-8dfc-ba1afa0d889e', '1b78d8c8-f0d0-4129-aafe-088b9419a7b6', '4b5271a4-b027-4ba3-9865-81c99432d983'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:04:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-df88015b-b3cd-42f5-b373-ad91f31cc90e tempest-ProjectMemberTests-819176810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-df88015b-b3cd-42f5-b373-ad91f31cc90e tempest-ProjectMemberTests-819176810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-df88015b-b3cd-42f5-b373-ad91f31cc90e tempest-ProjectMemberTests-819176810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:04:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-df88015b-b3cd-42f5-b373-ad91f31cc90e tempest-ProjectMemberTests-819176810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:04:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-df88015b-b3cd-42f5-b373-ad91f31cc90e tempest-ProjectMemberTests-819176810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-df88015b-b3cd-42f5-b373-ad91f31cc90e tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:47 devstack sudo[106221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:04:47 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:47 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ca05e228-3b33-4ac5-9800-b2dcc9080e38 tempest-ProjectReaderTests-1299385716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-76e29c5d-a8a0-462f-b71c-51a327930602" returned: 0 in 0.442s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ca05e228-3b33-4ac5-9800-b2dcc9080e38 tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-76e29c5d-a8a0-462f-b71c-51a327930602.3752e7d7-cfe2-4712-90b1-5909c38fca65 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:47 devstack sudo[106227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-76e29c5d-a8a0-462f-b71c-51a327930602.3752e7d7-cfe2-4712-90b1-5909c38fca65 Nov 06 18:04:47 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:47 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-df88015b-b3cd-42f5-b373-ad91f31cc90e tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.351s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:47 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-df88015b-b3cd-42f5-b373-ad91f31cc90e tempest-ProjectMemberTests-819176810 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:04:47 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-df88015b-b3cd-42f5-b373-ad91f31cc90e tempest-ProjectMemberTests-819176810 None] Deleted volume successfully. Nov 06 18:04:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-df88015b-b3cd-42f5-b373-ad91f31cc90e tempest-ProjectMemberTests-819176810 None] Lock "cinder-a72ffcd0-60b5-40a5-8339-5caa6533d168-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:48 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ca05e228-3b33-4ac5-9800-b2dcc9080e38 tempest-ProjectReaderTests-1299385716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-76e29c5d-a8a0-462f-b71c-51a327930602.3752e7d7-cfe2-4712-90b1-5909c38fca65" returned: 0 in 0.432s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ca05e228-3b33-4ac5-9800-b2dcc9080e38 tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-76e29c5d-a8a0-462f-b71c-51a327930602.3752e7d7-cfe2-4712-90b1-5909c38fca65 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:48 devstack sudo[106234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-76e29c5d-a8a0-462f-b71c-51a327930602.3752e7d7-cfe2-4712-90b1-5909c38fca65 Nov 06 18:04:48 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:48 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ca05e228-3b33-4ac5-9800-b2dcc9080e38 tempest-ProjectReaderTests-1299385716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-76e29c5d-a8a0-462f-b71c-51a327930602.3752e7d7-cfe2-4712-90b1-5909c38fca65" returned: 0 in 0.261s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:48 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ca05e228-3b33-4ac5-9800-b2dcc9080e38 tempest-ProjectReaderTests-1299385716 None] Lock "cinder-quobyte-3752e7d7-cfe2-4712-90b1-5909c38fca65" released by "_delete_snapshot" :: held 1.837s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:48 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ca05e228-3b33-4ac5-9800-b2dcc9080e38 tempest-ProjectReaderTests-1299385716 None] Lock "cinder-quobyte-76e29c5d-a8a0-462f-b71c-51a327930602" released by "delete_snapshot" :: held 1.884s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:48 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-ca05e228-3b33-4ac5-9800-b2dcc9080e38 tempest-ProjectReaderTests-1299385716 None] Created reservations ['cd81524f-89be-4c5d-a2a9-32e30d47eb02', '6e8e7045-f55b-4ea4-b522-b9e258b5f990', 'af43c324-1a41-4be5-9542-6cfb78540a86', 'f3b6b801-b7ae-4411-b6a5-eaeaa39ae35f'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:04:48 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-ca05e228-3b33-4ac5-9800-b2dcc9080e38 tempest-ProjectReaderTests-1299385716 None] Delete snapshot completed successfully. Nov 06 18:04:48 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ca05e228-3b33-4ac5-9800-b2dcc9080e38 tempest-ProjectReaderTests-1299385716 None] Lock "cinder-3752e7d7-cfe2-4712-90b1-5909c38fca65-delete_snapshot" released by "delete_snapshot" :: held 2.113s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:48 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a6ae0b13-11c2-45e4-83bc-7c2550931e23 tempest-ProjectReaderTests-1299385716 None] Acquiring lock "cinder-76e29c5d-a8a0-462f-b71c-51a327930602-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:48 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a6ae0b13-11c2-45e4-83bc-7c2550931e23 tempest-ProjectReaderTests-1299385716 None] Lock "cinder-76e29c5d-a8a0-462f-b71c-51a327930602-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:48 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a6ae0b13-11c2-45e4-83bc-7c2550931e23 tempest-ProjectReaderTests-1299385716 None] Acquiring lock "cinder-quobyte-76e29c5d-a8a0-462f-b71c-51a327930602" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:49 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a6ae0b13-11c2-45e4-83bc-7c2550931e23 tempest-ProjectReaderTests-1299385716 None] Lock "cinder-quobyte-76e29c5d-a8a0-462f-b71c-51a327930602" acquired by "delete_volume" :: waited 0.027s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:49 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e543883f-a541-4552-828f-a8fc1ae45456]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:04:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a6ae0b13-11c2-45e4-83bc-7c2550931e23 tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-76e29c5d-a8a0-462f-b71c-51a327930602 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:49 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-76e29c5d-a8a0-462f-b71c-51a327930602 Nov 06 18:04:49 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:49 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb426ce3-76d4-4505-a6ad-ccfb31bd57c3 tempest-ProjectMemberTests-819176810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:04:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cb426ce3-76d4-4505-a6ad-ccfb31bd57c3 tempest-ProjectMemberTests-819176810 None] Flow 'volume_create_manager' (bdfbed74-6bdd-4987-b9e3-e822fe4687ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:04:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cb426ce3-76d4-4505-a6ad-ccfb31bd57c3 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c82dc76-9428-4341-8c8f-fa098e603e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cb426ce3-76d4-4505-a6ad-ccfb31bd57c3 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c82dc76-9428-4341-8c8f-fa098e603e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-330225627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdcbd29b-d6ad-421a-ad37-23501b3b69b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b97cd7ef94764995a9e8c62cda23171f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:04:49Z,use_quota=True,user_id='a34e6465a98c4c289547d49a900a6bde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cb426ce3-76d4-4505-a6ad-ccfb31bd57c3 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (691e9c78-9988-4556-9c34-28c7e723045d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cb426ce3-76d4-4505-a6ad-ccfb31bd57c3 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (691e9c78-9988-4556-9c34-28c7e723045d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cb426ce3-76d4-4505-a6ad-ccfb31bd57c3 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (719274c8-b5da-447a-8c83-6d866011f5e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cb426ce3-76d4-4505-a6ad-ccfb31bd57c3 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (719274c8-b5da-447a-8c83-6d866011f5e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdcbd29b-d6ad-421a-ad37-23501b3b69b6', 'volume_name': 'volume-fdcbd29b-d6ad-421a-ad37-23501b3b69b6', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cb426ce3-76d4-4505-a6ad-ccfb31bd57c3 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f3e18a3-a18a-4a4d-bfc5-2c175856bd0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cb426ce3-76d4-4505-a6ad-ccfb31bd57c3 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f3e18a3-a18a-4a4d-bfc5-2c175856bd0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cb426ce3-76d4-4505-a6ad-ccfb31bd57c3 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (396bbee5-1723-4025-a028-9e0bed5fb41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:49 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-cb426ce3-76d4-4505-a6ad-ccfb31bd57c3 tempest-ProjectMemberTests-819176810 None] Volume fdcbd29b-d6ad-421a-ad37-23501b3b69b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdcbd29b-d6ad-421a-ad37-23501b3b69b6', 'volume_size': 1} Nov 06 18:04:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cb426ce3-76d4-4505-a6ad-ccfb31bd57c3 tempest-ProjectMemberTests-819176810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cb426ce3-76d4-4505-a6ad-ccfb31bd57c3 tempest-ProjectMemberTests-819176810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-cb426ce3-76d4-4505-a6ad-ccfb31bd57c3 tempest-ProjectMemberTests-819176810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-330225627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdcbd29b-d6ad-421a-ad37-23501b3b69b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b97cd7ef94764995a9e8c62cda23171f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:04:49Z,use_quota=True,user_id='a34e6465a98c4c289547d49a900a6bde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:04:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-cb426ce3-76d4-4505-a6ad-ccfb31bd57c3 tempest-ProjectMemberTests-819176810 None] Creating volume fdcbd29b-d6ad-421a-ad37-23501b3b69b6 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:04:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cb426ce3-76d4-4505-a6ad-ccfb31bd57c3 tempest-ProjectMemberTests-819176810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cb426ce3-76d4-4505-a6ad-ccfb31bd57c3 tempest-ProjectMemberTests-819176810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-cb426ce3-76d4-4505-a6ad-ccfb31bd57c3 tempest-ProjectMemberTests-819176810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:04:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-cb426ce3-76d4-4505-a6ad-ccfb31bd57c3 tempest-ProjectMemberTests-819176810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:04:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cb426ce3-76d4-4505-a6ad-ccfb31bd57c3 tempest-ProjectMemberTests-819176810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-cb426ce3-76d4-4505-a6ad-ccfb31bd57c3 tempest-ProjectMemberTests-819176810 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:04:49 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-cb426ce3-76d4-4505-a6ad-ccfb31bd57c3 tempest-ProjectMemberTests-819176810 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:04:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cb426ce3-76d4-4505-a6ad-ccfb31bd57c3 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdcbd29b-d6ad-421a-ad37-23501b3b69b6 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:49 devstack sudo[106239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdcbd29b-d6ad-421a-ad37-23501b3b69b6 1073741824 Nov 06 18:04:49 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:49 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a6ae0b13-11c2-45e4-83bc-7c2550931e23 tempest-ProjectReaderTests-1299385716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-76e29c5d-a8a0-462f-b71c-51a327930602" returned: 0 in 0.553s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a6ae0b13-11c2-45e4-83bc-7c2550931e23 tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-76e29c5d-a8a0-462f-b71c-51a327930602 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:49 devstack sudo[106244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-76e29c5d-a8a0-462f-b71c-51a327930602 Nov 06 18:04:49 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:50 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a6ae0b13-11c2-45e4-83bc-7c2550931e23 tempest-ProjectReaderTests-1299385716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-76e29c5d-a8a0-462f-b71c-51a327930602" returned: 0 in 0.361s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:50 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a6ae0b13-11c2-45e4-83bc-7c2550931e23 tempest-ProjectReaderTests-1299385716 None] Lock "cinder-quobyte-76e29c5d-a8a0-462f-b71c-51a327930602" released by "delete_volume" :: held 1.074s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:50 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cb426ce3-76d4-4505-a6ad-ccfb31bd57c3 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdcbd29b-d6ad-421a-ad37-23501b3b69b6 1073741824" returned: 0 in 0.703s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cb426ce3-76d4-4505-a6ad-ccfb31bd57c3 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdcbd29b-d6ad-421a-ad37-23501b3b69b6 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:50 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdcbd29b-d6ad-421a-ad37-23501b3b69b6 Nov 06 18:04:50 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:50 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-a6ae0b13-11c2-45e4-83bc-7c2550931e23 tempest-ProjectReaderTests-1299385716 None] Created reservations ['b2c16ba6-b4f6-477a-a0d3-333db10f4ad5', '7513b4eb-2d55-42b5-baac-df01c652f7da', '6a2ea3ca-051d-4f65-8ef2-4ae05578726f', 'b5719d19-03db-4fcb-9dcd-eb8bd6ab14c2'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:04:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a6ae0b13-11c2-45e4-83bc-7c2550931e23 tempest-ProjectReaderTests-1299385716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a6ae0b13-11c2-45e4-83bc-7c2550931e23 tempest-ProjectReaderTests-1299385716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:50 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a6ae0b13-11c2-45e4-83bc-7c2550931e23 tempest-ProjectReaderTests-1299385716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:04:50 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a6ae0b13-11c2-45e4-83bc-7c2550931e23 tempest-ProjectReaderTests-1299385716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:04:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a6ae0b13-11c2-45e4-83bc-7c2550931e23 tempest-ProjectReaderTests-1299385716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a6ae0b13-11c2-45e4-83bc-7c2550931e23 tempest-ProjectReaderTests-1299385716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:50 devstack sudo[106253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:04:50 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:50 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cb426ce3-76d4-4505-a6ad-ccfb31bd57c3 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdcbd29b-d6ad-421a-ad37-23501b3b69b6" returned: 0 in 0.321s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:50 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-cb426ce3-76d4-4505-a6ad-ccfb31bd57c3 tempest-ProjectMemberTests-819176810 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:04:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cb426ce3-76d4-4505-a6ad-ccfb31bd57c3 tempest-ProjectMemberTests-819176810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cb426ce3-76d4-4505-a6ad-ccfb31bd57c3 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (396bbee5-1723-4025-a028-9e0bed5fb41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdcbd29b-d6ad-421a-ad37-23501b3b69b6', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cb426ce3-76d4-4505-a6ad-ccfb31bd57c3 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c5389a1-ca20-435c-b64e-c908b8247eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:50 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-cb426ce3-76d4-4505-a6ad-ccfb31bd57c3 tempest-ProjectMemberTests-819176810 None] Volume volume-fdcbd29b-d6ad-421a-ad37-23501b3b69b6 (fdcbd29b-d6ad-421a-ad37-23501b3b69b6): created successfully Nov 06 18:04:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cb426ce3-76d4-4505-a6ad-ccfb31bd57c3 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c5389a1-ca20-435c-b64e-c908b8247eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cb426ce3-76d4-4505-a6ad-ccfb31bd57c3 tempest-ProjectMemberTests-819176810 None] Flow 'volume_create_manager' (bdfbed74-6bdd-4987-b9e3-e822fe4687ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:04:50 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-cb426ce3-76d4-4505-a6ad-ccfb31bd57c3 tempest-ProjectMemberTests-819176810 None] Created volume successfully. Nov 06 18:04:50 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a6ae0b13-11c2-45e4-83bc-7c2550931e23 tempest-ProjectReaderTests-1299385716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.364s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:50 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-a6ae0b13-11c2-45e4-83bc-7c2550931e23 tempest-ProjectReaderTests-1299385716 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:04:50 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-a6ae0b13-11c2-45e4-83bc-7c2550931e23 tempest-ProjectReaderTests-1299385716 None] Deleted volume successfully. Nov 06 18:04:50 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a6ae0b13-11c2-45e4-83bc-7c2550931e23 tempest-ProjectReaderTests-1299385716 None] Lock "cinder-76e29c5d-a8a0-462f-b71c-51a327930602-delete_volume" released by "delete_volume" :: held 1.813s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b8cde749-9241-4c95-8829-aabde2c1201a tempest-ProjectMemberTests-819176810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b8cde749-9241-4c95-8829-aabde2c1201a tempest-ProjectMemberTests-819176810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:51 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-b8cde749-9241-4c95-8829-aabde2c1201a tempest-ProjectMemberTests-819176810 None] Creating offline snapshot 10463a18-4cd3-4628-b2b4-ce571d1ce0e2 of volume fdcbd29b-d6ad-421a-ad37-23501b3b69b6 {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:04:51 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5557add2-5191-4385-979f-3ae0a75b6f14]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:04:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b8cde749-9241-4c95-8829-aabde2c1201a tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdcbd29b-d6ad-421a-ad37-23501b3b69b6 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:51 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdcbd29b-d6ad-421a-ad37-23501b3b69b6 Nov 06 18:04:51 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:52 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b8cde749-9241-4c95-8829-aabde2c1201a tempest-ProjectMemberTests-819176810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdcbd29b-d6ad-421a-ad37-23501b3b69b6" returned: 0 in 0.568s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b8cde749-9241-4c95-8829-aabde2c1201a tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdcbd29b-d6ad-421a-ad37-23501b3b69b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdcbd29b-d6ad-421a-ad37-23501b3b69b6.10463a18-4cd3-4628-b2b4-ce571d1ce0e2 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:52 devstack sudo[106267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdcbd29b-d6ad-421a-ad37-23501b3b69b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdcbd29b-d6ad-421a-ad37-23501b3b69b6.10463a18-4cd3-4628-b2b4-ce571d1ce0e2 1G Nov 06 18:04:52 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:52 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b8cde749-9241-4c95-8829-aabde2c1201a tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdcbd29b-d6ad-421a-ad37-23501b3b69b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdcbd29b-d6ad-421a-ad37-23501b3b69b6.10463a18-4cd3-4628-b2b4-ce571d1ce0e2 1G" returned: 0 in 0.521s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b8cde749-9241-4c95-8829-aabde2c1201a tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdcbd29b-d6ad-421a-ad37-23501b3b69b6 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdcbd29b-d6ad-421a-ad37-23501b3b69b6.10463a18-4cd3-4628-b2b4-ce571d1ce0e2 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:52 devstack sudo[106273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdcbd29b-d6ad-421a-ad37-23501b3b69b6 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdcbd29b-d6ad-421a-ad37-23501b3b69b6.10463a18-4cd3-4628-b2b4-ce571d1ce0e2 Nov 06 18:04:52 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:53 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b8cde749-9241-4c95-8829-aabde2c1201a tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdcbd29b-d6ad-421a-ad37-23501b3b69b6 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdcbd29b-d6ad-421a-ad37-23501b3b69b6.10463a18-4cd3-4628-b2b4-ce571d1ce0e2" returned: 0 in 0.471s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:53 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-b8cde749-9241-4c95-8829-aabde2c1201a tempest-ProjectMemberTests-819176810 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdcbd29b-d6ad-421a-ad37-23501b3b69b6.10463a18-4cd3-4628-b2b4-ce571d1ce0e2 is being set with open permissions: ugo+rw Nov 06 18:04:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b8cde749-9241-4c95-8829-aabde2c1201a tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdcbd29b-d6ad-421a-ad37-23501b3b69b6.10463a18-4cd3-4628-b2b4-ce571d1ce0e2 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:53 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-7da0c98b-2bee-410c-a77e-3a62c68a3ac6 tempest-SnapshotDependencyTests-1605975403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:04:53 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdcbd29b-d6ad-421a-ad37-23501b3b69b6.10463a18-4cd3-4628-b2b4-ce571d1ce0e2 Nov 06 18:04:53 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:53 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7da0c98b-2bee-410c-a77e-3a62c68a3ac6 tempest-SnapshotDependencyTests-1605975403 None] Flow 'volume_create_manager' (856801c4-4832-4a12-b0b8-0e0bf3add080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:04:53 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7da0c98b-2bee-410c-a77e-3a62c68a3ac6 tempest-SnapshotDependencyTests-1605975403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08cf89fd-0026-427f-bcd4-71074c34395a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:53 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7da0c98b-2bee-410c-a77e-3a62c68a3ac6 tempest-SnapshotDependencyTests-1605975403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08cf89fd-0026-427f-bcd4-71074c34395a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:04:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2072678252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aba856dc-4c62-468a-a23e-16c1598ab9d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d95b815e6cf4bccb582690693404ace',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:04:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:04:53Z,use_quota=True,user_id='9f34540cb7234e97ae70b9a68247dc45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:53 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7da0c98b-2bee-410c-a77e-3a62c68a3ac6 tempest-SnapshotDependencyTests-1605975403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5959787-759e-4d39-877d-2022f70c1d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:53 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7da0c98b-2bee-410c-a77e-3a62c68a3ac6 tempest-SnapshotDependencyTests-1605975403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5959787-759e-4d39-877d-2022f70c1d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:53 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7da0c98b-2bee-410c-a77e-3a62c68a3ac6 tempest-SnapshotDependencyTests-1605975403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81bfe1a4-7556-4f16-8025-1edf9c0db877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:53 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7da0c98b-2bee-410c-a77e-3a62c68a3ac6 tempest-SnapshotDependencyTests-1605975403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81bfe1a4-7556-4f16-8025-1edf9c0db877) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aba856dc-4c62-468a-a23e-16c1598ab9d3', 'volume_name': 'volume-aba856dc-4c62-468a-a23e-16c1598ab9d3', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:53 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7da0c98b-2bee-410c-a77e-3a62c68a3ac6 tempest-SnapshotDependencyTests-1605975403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (986c2d9b-df4b-4125-baf3-76d674951a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:53 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7da0c98b-2bee-410c-a77e-3a62c68a3ac6 tempest-SnapshotDependencyTests-1605975403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (986c2d9b-df4b-4125-baf3-76d674951a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:53 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7da0c98b-2bee-410c-a77e-3a62c68a3ac6 tempest-SnapshotDependencyTests-1605975403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eebcee6-d1d3-4487-aa5b-83d7fa4a17a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:53 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-7da0c98b-2bee-410c-a77e-3a62c68a3ac6 tempest-SnapshotDependencyTests-1605975403 None] Volume aba856dc-4c62-468a-a23e-16c1598ab9d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aba856dc-4c62-468a-a23e-16c1598ab9d3', 'volume_size': 1} Nov 06 18:04:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7da0c98b-2bee-410c-a77e-3a62c68a3ac6 tempest-SnapshotDependencyTests-1605975403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:53 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b8cde749-9241-4c95-8829-aabde2c1201a tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdcbd29b-d6ad-421a-ad37-23501b3b69b6.10463a18-4cd3-4628-b2b4-ce571d1ce0e2" returned: 0 in 0.293s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b8cde749-9241-4c95-8829-aabde2c1201a tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdcbd29b-d6ad-421a-ad37-23501b3b69b6.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:53 devstack sudo[106287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdcbd29b-d6ad-421a-ad37-23501b3b69b6.info Nov 06 18:04:53 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:53 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b8cde749-9241-4c95-8829-aabde2c1201a tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdcbd29b-d6ad-421a-ad37-23501b3b69b6.info" returned: 0 in 0.290s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:53 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-b8cde749-9241-4c95-8829-aabde2c1201a tempest-ProjectMemberTests-819176810 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdcbd29b-d6ad-421a-ad37-23501b3b69b6.info is being set with open permissions: ugo+rw Nov 06 18:04:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b8cde749-9241-4c95-8829-aabde2c1201a tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdcbd29b-d6ad-421a-ad37-23501b3b69b6.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:53 devstack sudo[106290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdcbd29b-d6ad-421a-ad37-23501b3b69b6.info Nov 06 18:04:53 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:54 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b8cde749-9241-4c95-8829-aabde2c1201a tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdcbd29b-d6ad-421a-ad37-23501b3b69b6.info" returned: 0 in 0.282s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b8cde749-9241-4c95-8829-aabde2c1201a tempest-ProjectMemberTests-819176810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.546s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7da0c98b-2bee-410c-a77e-3a62c68a3ac6 tempest-SnapshotDependencyTests-1605975403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.791s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7da0c98b-2bee-410c-a77e-3a62c68a3ac6 tempest-SnapshotDependencyTests-1605975403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:04:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2072678252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aba856dc-4c62-468a-a23e-16c1598ab9d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d95b815e6cf4bccb582690693404ace',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:04:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:04:53Z,use_quota=True,user_id='9f34540cb7234e97ae70b9a68247dc45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:04:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-7da0c98b-2bee-410c-a77e-3a62c68a3ac6 tempest-SnapshotDependencyTests-1605975403 None] Creating volume aba856dc-4c62-468a-a23e-16c1598ab9d3 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:04:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7da0c98b-2bee-410c-a77e-3a62c68a3ac6 tempest-SnapshotDependencyTests-1605975403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7da0c98b-2bee-410c-a77e-3a62c68a3ac6 tempest-SnapshotDependencyTests-1605975403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7da0c98b-2bee-410c-a77e-3a62c68a3ac6 tempest-SnapshotDependencyTests-1605975403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:04:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7da0c98b-2bee-410c-a77e-3a62c68a3ac6 tempest-SnapshotDependencyTests-1605975403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:04:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7da0c98b-2bee-410c-a77e-3a62c68a3ac6 tempest-SnapshotDependencyTests-1605975403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7da0c98b-2bee-410c-a77e-3a62c68a3ac6 tempest-SnapshotDependencyTests-1605975403 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:04:54 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-7da0c98b-2bee-410c-a77e-3a62c68a3ac6 tempest-SnapshotDependencyTests-1605975403 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:04:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7da0c98b-2bee-410c-a77e-3a62c68a3ac6 tempest-SnapshotDependencyTests-1605975403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-aba856dc-4c62-468a-a23e-16c1598ab9d3 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:54 devstack sudo[106293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-aba856dc-4c62-468a-a23e-16c1598ab9d3 1073741824 Nov 06 18:04:54 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:54 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-b8cde749-9241-4c95-8829-aabde2c1201a tempest-ProjectMemberTests-819176810 None] Create snapshot completed successfully Nov 06 18:04:54 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 18:04:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:04:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:04:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:54 devstack sudo[106299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:04:54 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:54 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7da0c98b-2bee-410c-a77e-3a62c68a3ac6 tempest-SnapshotDependencyTests-1605975403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-aba856dc-4c62-468a-a23e-16c1598ab9d3 1073741824" returned: 0 in 0.614s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7da0c98b-2bee-410c-a77e-3a62c68a3ac6 tempest-SnapshotDependencyTests-1605975403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-aba856dc-4c62-468a-a23e-16c1598ab9d3 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:54 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.334s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:54 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:04:54 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-19ef2b30-fa62-4ff0-8478-8c51915a9f61 tempest-ProjectMemberTests-819176810 None] Acquiring lock "cinder-10463a18-4cd3-4628-b2b4-ce571d1ce0e2-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:54 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running periodic task VolumeManager._thread_info {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 18:04:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] thread count: 28 {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 18:04:54 devstack sudo[106302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-aba856dc-4c62-468a-a23e-16c1598ab9d3 Nov 06 18:04:54 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] thread info: [<_MainThread(MainThread, started 133940619505792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 18:04:54 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-19ef2b30-fa62-4ff0-8478-8c51915a9f61 tempest-ProjectMemberTests-819176810 None] Lock "cinder-10463a18-4cd3-4628-b2b4-ce571d1ce0e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:54 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-19ef2b30-fa62-4ff0-8478-8c51915a9f61 tempest-ProjectMemberTests-819176810 None] Acquiring lock "cinder-quobyte-fdcbd29b-d6ad-421a-ad37-23501b3b69b6" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:54 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-19ef2b30-fa62-4ff0-8478-8c51915a9f61 tempest-ProjectMemberTests-819176810 None] Lock "cinder-quobyte-fdcbd29b-d6ad-421a-ad37-23501b3b69b6" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:54 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-19ef2b30-fa62-4ff0-8478-8c51915a9f61 tempest-ProjectMemberTests-819176810 None] Acquiring lock "cinder-quobyte-10463a18-4cd3-4628-b2b4-ce571d1ce0e2" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:54 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-19ef2b30-fa62-4ff0-8478-8c51915a9f61 tempest-ProjectMemberTests-819176810 None] Lock "cinder-quobyte-10463a18-4cd3-4628-b2b4-ce571d1ce0e2" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-19ef2b30-fa62-4ff0-8478-8c51915a9f61 tempest-ProjectMemberTests-819176810 None] Deleting offline snapshot 10463a18-4cd3-4628-b2b4-ce571d1ce0e2 of volume fdcbd29b-d6ad-421a-ad37-23501b3b69b6 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:04:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-19ef2b30-fa62-4ff0-8478-8c51915a9f61 tempest-ProjectMemberTests-819176810 None] snapshot_file for this snap is: volume-fdcbd29b-d6ad-421a-ad37-23501b3b69b6.10463a18-4cd3-4628-b2b4-ce571d1ce0e2 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:04:54 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f4192b-f640-4a3e-b207-97d93c06392e]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:04:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-19ef2b30-fa62-4ff0-8478-8c51915a9f61 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdcbd29b-d6ad-421a-ad37-23501b3b69b6.10463a18-4cd3-4628-b2b4-ce571d1ce0e2 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:55 devstack sudo[106304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdcbd29b-d6ad-421a-ad37-23501b3b69b6.10463a18-4cd3-4628-b2b4-ce571d1ce0e2 Nov 06 18:04:55 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:55 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7da0c98b-2bee-410c-a77e-3a62c68a3ac6 tempest-SnapshotDependencyTests-1605975403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-aba856dc-4c62-468a-a23e-16c1598ab9d3" returned: 0 in 0.344s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:55 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7da0c98b-2bee-410c-a77e-3a62c68a3ac6 tempest-SnapshotDependencyTests-1605975403 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:04:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7da0c98b-2bee-410c-a77e-3a62c68a3ac6 tempest-SnapshotDependencyTests-1605975403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7da0c98b-2bee-410c-a77e-3a62c68a3ac6 tempest-SnapshotDependencyTests-1605975403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eebcee6-d1d3-4487-aa5b-83d7fa4a17a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aba856dc-4c62-468a-a23e-16c1598ab9d3', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7da0c98b-2bee-410c-a77e-3a62c68a3ac6 tempest-SnapshotDependencyTests-1605975403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cafb74c-c447-481a-a864-5b82bcc733ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:55 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-7da0c98b-2bee-410c-a77e-3a62c68a3ac6 tempest-SnapshotDependencyTests-1605975403 None] Volume volume-aba856dc-4c62-468a-a23e-16c1598ab9d3 (aba856dc-4c62-468a-a23e-16c1598ab9d3): created successfully Nov 06 18:04:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7da0c98b-2bee-410c-a77e-3a62c68a3ac6 tempest-SnapshotDependencyTests-1605975403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cafb74c-c447-481a-a864-5b82bcc733ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7da0c98b-2bee-410c-a77e-3a62c68a3ac6 tempest-SnapshotDependencyTests-1605975403 None] Flow 'volume_create_manager' (856801c4-4832-4a12-b0b8-0e0bf3add080) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:04:55 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-7da0c98b-2bee-410c-a77e-3a62c68a3ac6 tempest-SnapshotDependencyTests-1605975403 None] Created volume successfully. Nov 06 18:04:55 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-19ef2b30-fa62-4ff0-8478-8c51915a9f61 tempest-ProjectMemberTests-819176810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdcbd29b-d6ad-421a-ad37-23501b3b69b6.10463a18-4cd3-4628-b2b4-ce571d1ce0e2" returned: 0 in 0.479s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:55 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-19ef2b30-fa62-4ff0-8478-8c51915a9f61 tempest-ProjectMemberTests-819176810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fdcbd29b-d6ad-421a-ad37-23501b3b69b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:04:55 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[75de8fbc-b50a-4d23-922b-1c93c2da85b0]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:04:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-19ef2b30-fa62-4ff0-8478-8c51915a9f61 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdcbd29b-d6ad-421a-ad37-23501b3b69b6 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:55 devstack sudo[106311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdcbd29b-d6ad-421a-ad37-23501b3b69b6 Nov 06 18:04:55 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:55 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-19ef2b30-fa62-4ff0-8478-8c51915a9f61 tempest-ProjectMemberTests-819176810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdcbd29b-d6ad-421a-ad37-23501b3b69b6" returned: 0 in 0.444s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-19ef2b30-fa62-4ff0-8478-8c51915a9f61 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdcbd29b-d6ad-421a-ad37-23501b3b69b6.10463a18-4cd3-4628-b2b4-ce571d1ce0e2 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:55 devstack sudo[106316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdcbd29b-d6ad-421a-ad37-23501b3b69b6.10463a18-4cd3-4628-b2b4-ce571d1ce0e2 Nov 06 18:04:55 devstack sudo[106316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:56 devstack sudo[106316]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-19ef2b30-fa62-4ff0-8478-8c51915a9f61 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdcbd29b-d6ad-421a-ad37-23501b3b69b6.10463a18-4cd3-4628-b2b4-ce571d1ce0e2" returned: 0 in 0.497s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-19ef2b30-fa62-4ff0-8478-8c51915a9f61 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdcbd29b-d6ad-421a-ad37-23501b3b69b6.10463a18-4cd3-4628-b2b4-ce571d1ce0e2 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:56 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdcbd29b-d6ad-421a-ad37-23501b3b69b6.10463a18-4cd3-4628-b2b4-ce571d1ce0e2 Nov 06 18:04:56 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-402c6d0d-cd35-4529-8db7-300889898a7c tempest-SnapshotDependencyTests-1605975403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-402c6d0d-cd35-4529-8db7-300889898a7c tempest-SnapshotDependencyTests-1605975403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:56 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-402c6d0d-cd35-4529-8db7-300889898a7c tempest-SnapshotDependencyTests-1605975403 None] Creating offline snapshot f53a4939-8199-45e5-8115-af806d104d8f of volume aba856dc-4c62-468a-a23e-16c1598ab9d3 {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:04:56 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-19ef2b30-fa62-4ff0-8478-8c51915a9f61 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdcbd29b-d6ad-421a-ad37-23501b3b69b6.10463a18-4cd3-4628-b2b4-ce571d1ce0e2" returned: 0 in 0.286s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:56 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[74566fe0-0c7a-4874-b35c-cbdc8e79271a]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:04:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-402c6d0d-cd35-4529-8db7-300889898a7c tempest-SnapshotDependencyTests-1605975403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-aba856dc-4c62-468a-a23e-16c1598ab9d3 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:56 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-19ef2b30-fa62-4ff0-8478-8c51915a9f61 tempest-ProjectMemberTests-819176810 None] Lock "cinder-quobyte-10463a18-4cd3-4628-b2b4-ce571d1ce0e2" released by "_delete_snapshot" :: held 1.844s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:56 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-19ef2b30-fa62-4ff0-8478-8c51915a9f61 tempest-ProjectMemberTests-819176810 None] Lock "cinder-quobyte-fdcbd29b-d6ad-421a-ad37-23501b3b69b6" released by "delete_snapshot" :: held 1.871s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:56 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-19ef2b30-fa62-4ff0-8478-8c51915a9f61 tempest-ProjectMemberTests-819176810 None] Created reservations ['b42f3b1d-78cf-44a2-9f55-1343706623da', '96f311d1-8aeb-4478-a1aa-1865a3a00d44', 'b305365b-14d5-4366-9f6a-4518647b763b', 'f3492f1f-9f13-4e5f-ad88-8ebfc952c266'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:04:56 devstack sudo[106324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-aba856dc-4c62-468a-a23e-16c1598ab9d3 Nov 06 18:04:56 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:56 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-19ef2b30-fa62-4ff0-8478-8c51915a9f61 tempest-ProjectMemberTests-819176810 None] Delete snapshot completed successfully. Nov 06 18:04:56 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-19ef2b30-fa62-4ff0-8478-8c51915a9f61 tempest-ProjectMemberTests-819176810 None] Lock "cinder-10463a18-4cd3-4628-b2b4-ce571d1ce0e2-delete_snapshot" released by "delete_snapshot" :: held 2.020s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9d3e0f90-76ab-4cf6-b362-1f6229cf0464 tempest-ProjectMemberTests-819176810 None] Acquiring lock "cinder-fdcbd29b-d6ad-421a-ad37-23501b3b69b6-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9d3e0f90-76ab-4cf6-b362-1f6229cf0464 tempest-ProjectMemberTests-819176810 None] Lock "cinder-fdcbd29b-d6ad-421a-ad37-23501b3b69b6-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9d3e0f90-76ab-4cf6-b362-1f6229cf0464 tempest-ProjectMemberTests-819176810 None] Acquiring lock "cinder-quobyte-fdcbd29b-d6ad-421a-ad37-23501b3b69b6" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:04:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9d3e0f90-76ab-4cf6-b362-1f6229cf0464 tempest-ProjectMemberTests-819176810 None] Lock "cinder-quobyte-fdcbd29b-d6ad-421a-ad37-23501b3b69b6" acquired by "delete_volume" :: waited 0.019s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:04:57 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-402c6d0d-cd35-4529-8db7-300889898a7c tempest-SnapshotDependencyTests-1605975403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-aba856dc-4c62-468a-a23e-16c1598ab9d3" returned: 0 in 0.410s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-402c6d0d-cd35-4529-8db7-300889898a7c tempest-SnapshotDependencyTests-1605975403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-aba856dc-4c62-468a-a23e-16c1598ab9d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-aba856dc-4c62-468a-a23e-16c1598ab9d3.f53a4939-8199-45e5-8115-af806d104d8f 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:57 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f4e015-e9d9-4727-9231-d9240361e4d8]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:04:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9d3e0f90-76ab-4cf6-b362-1f6229cf0464 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdcbd29b-d6ad-421a-ad37-23501b3b69b6 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:57 devstack sudo[106330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-aba856dc-4c62-468a-a23e-16c1598ab9d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-aba856dc-4c62-468a-a23e-16c1598ab9d3.f53a4939-8199-45e5-8115-af806d104d8f 1G Nov 06 18:04:57 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:57 devstack sudo[106331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdcbd29b-d6ad-421a-ad37-23501b3b69b6 Nov 06 18:04:57 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:57 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9d3e0f90-76ab-4cf6-b362-1f6229cf0464 tempest-ProjectMemberTests-819176810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdcbd29b-d6ad-421a-ad37-23501b3b69b6" returned: 0 in 0.383s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9d3e0f90-76ab-4cf6-b362-1f6229cf0464 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdcbd29b-d6ad-421a-ad37-23501b3b69b6 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:57 devstack sudo[106341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdcbd29b-d6ad-421a-ad37-23501b3b69b6 Nov 06 18:04:57 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:57 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-402c6d0d-cd35-4529-8db7-300889898a7c tempest-SnapshotDependencyTests-1605975403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-aba856dc-4c62-468a-a23e-16c1598ab9d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-aba856dc-4c62-468a-a23e-16c1598ab9d3.f53a4939-8199-45e5-8115-af806d104d8f 1G" returned: 0 in 0.506s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-402c6d0d-cd35-4529-8db7-300889898a7c tempest-SnapshotDependencyTests-1605975403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aba856dc-4c62-468a-a23e-16c1598ab9d3 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-aba856dc-4c62-468a-a23e-16c1598ab9d3.f53a4939-8199-45e5-8115-af806d104d8f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:57 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aba856dc-4c62-468a-a23e-16c1598ab9d3 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-aba856dc-4c62-468a-a23e-16c1598ab9d3.f53a4939-8199-45e5-8115-af806d104d8f Nov 06 18:04:57 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:57 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9d3e0f90-76ab-4cf6-b362-1f6229cf0464 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fdcbd29b-d6ad-421a-ad37-23501b3b69b6" returned: 0 in 0.350s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9d3e0f90-76ab-4cf6-b362-1f6229cf0464 tempest-ProjectMemberTests-819176810 None] Lock "cinder-quobyte-fdcbd29b-d6ad-421a-ad37-23501b3b69b6" released by "delete_volume" :: held 0.826s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:58 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-9d3e0f90-76ab-4cf6-b362-1f6229cf0464 tempest-ProjectMemberTests-819176810 None] Created reservations ['3bc6b3a6-a5ce-4c19-aa26-41cce4d81315', '69f93849-ead3-4eab-b0a4-4922377009fc', '3dfb1f4e-9c0e-45ce-94d5-8a21b31b1034', '09e24a7b-fc43-4d2b-866a-a91f2ca7975a'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:04:58 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-402c6d0d-cd35-4529-8db7-300889898a7c tempest-SnapshotDependencyTests-1605975403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aba856dc-4c62-468a-a23e-16c1598ab9d3 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-aba856dc-4c62-468a-a23e-16c1598ab9d3.f53a4939-8199-45e5-8115-af806d104d8f" returned: 0 in 0.453s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:58 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-402c6d0d-cd35-4529-8db7-300889898a7c tempest-SnapshotDependencyTests-1605975403 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-aba856dc-4c62-468a-a23e-16c1598ab9d3.f53a4939-8199-45e5-8115-af806d104d8f is being set with open permissions: ugo+rw Nov 06 18:04:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-402c6d0d-cd35-4529-8db7-300889898a7c tempest-SnapshotDependencyTests-1605975403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-aba856dc-4c62-468a-a23e-16c1598ab9d3.f53a4939-8199-45e5-8115-af806d104d8f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:58 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-aba856dc-4c62-468a-a23e-16c1598ab9d3.f53a4939-8199-45e5-8115-af806d104d8f Nov 06 18:04:58 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9d3e0f90-76ab-4cf6-b362-1f6229cf0464 tempest-ProjectMemberTests-819176810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9d3e0f90-76ab-4cf6-b362-1f6229cf0464 tempest-ProjectMemberTests-819176810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:58 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9d3e0f90-76ab-4cf6-b362-1f6229cf0464 tempest-ProjectMemberTests-819176810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:04:58 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9d3e0f90-76ab-4cf6-b362-1f6229cf0464 tempest-ProjectMemberTests-819176810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:04:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9d3e0f90-76ab-4cf6-b362-1f6229cf0464 tempest-ProjectMemberTests-819176810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9d3e0f90-76ab-4cf6-b362-1f6229cf0464 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:58 devstack sudo[106387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:04:58 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:58 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-402c6d0d-cd35-4529-8db7-300889898a7c tempest-SnapshotDependencyTests-1605975403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-aba856dc-4c62-468a-a23e-16c1598ab9d3.f53a4939-8199-45e5-8115-af806d104d8f" returned: 0 in 0.342s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-402c6d0d-cd35-4529-8db7-300889898a7c tempest-SnapshotDependencyTests-1605975403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-aba856dc-4c62-468a-a23e-16c1598ab9d3.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:58 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9d3e0f90-76ab-4cf6-b362-1f6229cf0464 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.306s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:58 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-9d3e0f90-76ab-4cf6-b362-1f6229cf0464 tempest-ProjectMemberTests-819176810 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:04:58 devstack sudo[106391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-aba856dc-4c62-468a-a23e-16c1598ab9d3.info Nov 06 18:04:58 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:58 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-9d3e0f90-76ab-4cf6-b362-1f6229cf0464 tempest-ProjectMemberTests-819176810 None] Deleted volume successfully. Nov 06 18:04:58 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9d3e0f90-76ab-4cf6-b362-1f6229cf0464 tempest-ProjectMemberTests-819176810 None] Lock "cinder-fdcbd29b-d6ad-421a-ad37-23501b3b69b6-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:04:58 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-402c6d0d-cd35-4529-8db7-300889898a7c tempest-SnapshotDependencyTests-1605975403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-aba856dc-4c62-468a-a23e-16c1598ab9d3.info" returned: 0 in 0.338s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:58 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-402c6d0d-cd35-4529-8db7-300889898a7c tempest-SnapshotDependencyTests-1605975403 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-aba856dc-4c62-468a-a23e-16c1598ab9d3.info is being set with open permissions: ugo+rw Nov 06 18:04:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-402c6d0d-cd35-4529-8db7-300889898a7c tempest-SnapshotDependencyTests-1605975403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-aba856dc-4c62-468a-a23e-16c1598ab9d3.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:58 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-aba856dc-4c62-468a-a23e-16c1598ab9d3.info Nov 06 18:04:58 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:58 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-73686b33-7bb5-4cac-9de8-b3cbfb611d62 tempest-ProjectMemberTests-819176810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:04:58 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-73686b33-7bb5-4cac-9de8-b3cbfb611d62 tempest-ProjectMemberTests-819176810 None] Flow 'volume_create_manager' (eb98822d-eb79-48a6-96a1-3eafcf51b5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:04:58 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-73686b33-7bb5-4cac-9de8-b3cbfb611d62 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53776248-d20a-4cbc-b4de-569092b04604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-73686b33-7bb5-4cac-9de8-b3cbfb611d62 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53776248-d20a-4cbc-b4de-569092b04604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:04:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2116877242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a34bdfa8-4415-4516-af9b-677c1234e763,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b97cd7ef94764995a9e8c62cda23171f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:04:59Z,use_quota=True,user_id='a34e6465a98c4c289547d49a900a6bde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-73686b33-7bb5-4cac-9de8-b3cbfb611d62 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2812de69-547c-4a9a-b0fa-a3335300e0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-73686b33-7bb5-4cac-9de8-b3cbfb611d62 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2812de69-547c-4a9a-b0fa-a3335300e0a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-73686b33-7bb5-4cac-9de8-b3cbfb611d62 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0620957e-0589-4d19-8405-20342ed10822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-73686b33-7bb5-4cac-9de8-b3cbfb611d62 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0620957e-0589-4d19-8405-20342ed10822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a34bdfa8-4415-4516-af9b-677c1234e763', 'volume_name': 'volume-a34bdfa8-4415-4516-af9b-677c1234e763', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-73686b33-7bb5-4cac-9de8-b3cbfb611d62 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33802401-d75b-469e-a7e5-5f4338814e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-73686b33-7bb5-4cac-9de8-b3cbfb611d62 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33802401-d75b-469e-a7e5-5f4338814e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-73686b33-7bb5-4cac-9de8-b3cbfb611d62 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4aeb920-fa62-4891-ad69-0bdc574b8106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:59 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-73686b33-7bb5-4cac-9de8-b3cbfb611d62 tempest-ProjectMemberTests-819176810 None] Volume a34bdfa8-4415-4516-af9b-677c1234e763: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a34bdfa8-4415-4516-af9b-677c1234e763', 'volume_size': 1} Nov 06 18:04:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-73686b33-7bb5-4cac-9de8-b3cbfb611d62 tempest-ProjectMemberTests-819176810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:59 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-402c6d0d-cd35-4529-8db7-300889898a7c tempest-SnapshotDependencyTests-1605975403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-aba856dc-4c62-468a-a23e-16c1598ab9d3.info" returned: 0 in 0.259s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-402c6d0d-cd35-4529-8db7-300889898a7c tempest-SnapshotDependencyTests-1605975403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.419s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-73686b33-7bb5-4cac-9de8-b3cbfb611d62 tempest-ProjectMemberTests-819176810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.095s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:59 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-73686b33-7bb5-4cac-9de8-b3cbfb611d62 tempest-ProjectMemberTests-819176810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:04:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2116877242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a34bdfa8-4415-4516-af9b-677c1234e763,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b97cd7ef94764995a9e8c62cda23171f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:04:59Z,use_quota=True,user_id='a34e6465a98c4c289547d49a900a6bde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:04:59 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-73686b33-7bb5-4cac-9de8-b3cbfb611d62 tempest-ProjectMemberTests-819176810 None] Creating volume a34bdfa8-4415-4516-af9b-677c1234e763 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:04:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-73686b33-7bb5-4cac-9de8-b3cbfb611d62 tempest-ProjectMemberTests-819176810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:04:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-73686b33-7bb5-4cac-9de8-b3cbfb611d62 tempest-ProjectMemberTests-819176810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:04:59 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-73686b33-7bb5-4cac-9de8-b3cbfb611d62 tempest-ProjectMemberTests-819176810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:04:59 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-73686b33-7bb5-4cac-9de8-b3cbfb611d62 tempest-ProjectMemberTests-819176810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:04:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-73686b33-7bb5-4cac-9de8-b3cbfb611d62 tempest-ProjectMemberTests-819176810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:59 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-73686b33-7bb5-4cac-9de8-b3cbfb611d62 tempest-ProjectMemberTests-819176810 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:04:59 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-73686b33-7bb5-4cac-9de8-b3cbfb611d62 tempest-ProjectMemberTests-819176810 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:04:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-73686b33-7bb5-4cac-9de8-b3cbfb611d62 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a34bdfa8-4415-4516-af9b-677c1234e763 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:59 devstack sudo[106397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a34bdfa8-4415-4516-af9b-677c1234e763 1073741824 Nov 06 18:04:59 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:59 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-402c6d0d-cd35-4529-8db7-300889898a7c tempest-SnapshotDependencyTests-1605975403 None] Create snapshot completed successfully Nov 06 18:04:59 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-73686b33-7bb5-4cac-9de8-b3cbfb611d62 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a34bdfa8-4415-4516-af9b-677c1234e763 1073741824" returned: 0 in 0.416s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-73686b33-7bb5-4cac-9de8-b3cbfb611d62 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a34bdfa8-4415-4516-af9b-677c1234e763 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:04:59 devstack sudo[106402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a34bdfa8-4415-4516-af9b-677c1234e763 Nov 06 18:04:59 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:04:59 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root Nov 06 18:04:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-73686b33-7bb5-4cac-9de8-b3cbfb611d62 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a34bdfa8-4415-4516-af9b-677c1234e763" returned: 0 in 0.270s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:04:59 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-73686b33-7bb5-4cac-9de8-b3cbfb611d62 tempest-ProjectMemberTests-819176810 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:04:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-73686b33-7bb5-4cac-9de8-b3cbfb611d62 tempest-ProjectMemberTests-819176810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:04:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-73686b33-7bb5-4cac-9de8-b3cbfb611d62 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4aeb920-fa62-4891-ad69-0bdc574b8106) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a34bdfa8-4415-4516-af9b-677c1234e763', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-73686b33-7bb5-4cac-9de8-b3cbfb611d62 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45d1eaff-5739-40c8-b3ab-955e38f8452b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:04:59 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-73686b33-7bb5-4cac-9de8-b3cbfb611d62 tempest-ProjectMemberTests-819176810 None] Volume volume-a34bdfa8-4415-4516-af9b-677c1234e763 (a34bdfa8-4415-4516-af9b-677c1234e763): created successfully Nov 06 18:04:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-73686b33-7bb5-4cac-9de8-b3cbfb611d62 tempest-ProjectMemberTests-819176810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45d1eaff-5739-40c8-b3ab-955e38f8452b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:04:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-73686b33-7bb5-4cac-9de8-b3cbfb611d62 tempest-ProjectMemberTests-819176810 None] Flow 'volume_create_manager' (eb98822d-eb79-48a6-96a1-3eafcf51b5f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:04:59 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-73686b33-7bb5-4cac-9de8-b3cbfb611d62 tempest-ProjectMemberTests-819176810 None] Created volume successfully. Nov 06 18:05:00 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-7db0ade0-5716-4f3d-a7ff-60756a75441b tempest-SnapshotDependencyTests-1605975403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:05:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7db0ade0-5716-4f3d-a7ff-60756a75441b tempest-SnapshotDependencyTests-1605975403 None] Flow 'volume_create_manager' (81544b27-a2a0-46fc-9bc0-6e16e4d0a8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:05:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7db0ade0-5716-4f3d-a7ff-60756a75441b tempest-SnapshotDependencyTests-1605975403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d7e4189-f172-4660-861d-68c81481620c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:05:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7db0ade0-5716-4f3d-a7ff-60756a75441b tempest-SnapshotDependencyTests-1605975403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d7e4189-f172-4660-861d-68c81481620c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:05:00Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11e4fa5e-283b-4827-9c15-62c8323ef7af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d95b815e6cf4bccb582690693404ace',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:05:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f53a4939-8199-45e5-8115-af806d104d8f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:05:00Z,use_quota=True,user_id='9f34540cb7234e97ae70b9a68247dc45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:05:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7db0ade0-5716-4f3d-a7ff-60756a75441b tempest-SnapshotDependencyTests-1605975403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7280e955-ae32-49b7-80aa-8891841bb1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:05:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7db0ade0-5716-4f3d-a7ff-60756a75441b tempest-SnapshotDependencyTests-1605975403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7280e955-ae32-49b7-80aa-8891841bb1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:05:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7db0ade0-5716-4f3d-a7ff-60756a75441b tempest-SnapshotDependencyTests-1605975403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9d112d0-d381-4e34-930c-cca3c63107fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:05:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7db0ade0-5716-4f3d-a7ff-60756a75441b tempest-SnapshotDependencyTests-1605975403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9d112d0-d381-4e34-930c-cca3c63107fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '11e4fa5e-283b-4827-9c15-62c8323ef7af', 'volume_name': 'volume-11e4fa5e-283b-4827-9c15-62c8323ef7af', 'volume_size': 1, 'snapshot_id': 'f53a4939-8199-45e5-8115-af806d104d8f'}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:05:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7db0ade0-5716-4f3d-a7ff-60756a75441b tempest-SnapshotDependencyTests-1605975403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5acf9ef-509e-4201-ae7e-2d5b3d492aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:05:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7db0ade0-5716-4f3d-a7ff-60756a75441b tempest-SnapshotDependencyTests-1605975403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5acf9ef-509e-4201-ae7e-2d5b3d492aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:05:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7db0ade0-5716-4f3d-a7ff-60756a75441b tempest-SnapshotDependencyTests-1605975403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cff8ddb-4829-4019-b46c-8056f8a89e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:05:00 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-7db0ade0-5716-4f3d-a7ff-60756a75441b tempest-SnapshotDependencyTests-1605975403 None] Volume 11e4fa5e-283b-4827-9c15-62c8323ef7af: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-11e4fa5e-283b-4827-9c15-62c8323ef7af', 'volume_size': 1, 'snapshot_id': 'f53a4939-8199-45e5-8115-af806d104d8f'} Nov 06 18:05:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7db0ade0-5716-4f3d-a7ff-60756a75441b tempest-SnapshotDependencyTests-1605975403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:05:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7db0ade0-5716-4f3d-a7ff-60756a75441b tempest-SnapshotDependencyTests-1605975403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:05:00 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-7db0ade0-5716-4f3d-a7ff-60756a75441b tempest-SnapshotDependencyTests-1605975403 None] Acquiring lock "cinder-quobyte-f53a4939-8199-45e5-8115-af806d104d8f-11e4fa5e-283b-4827-9c15-62c8323ef7af" by "_create_volume_from_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:05:00 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-7db0ade0-5716-4f3d-a7ff-60756a75441b tempest-SnapshotDependencyTests-1605975403 None] Lock "cinder-quobyte-f53a4939-8199-45e5-8115-af806d104d8f-11e4fa5e-283b-4827-9c15-62c8323ef7af" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:05:00 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7db0ade0-5716-4f3d-a7ff-60756a75441b tempest-SnapshotDependencyTests-1605975403 None] Creating volume 11e4fa5e-283b-4827-9c15-62c8323ef7af from snapshot f53a4939-8199-45e5-8115-af806d104d8f {{(pid=87068) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 18:05:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7db0ade0-5716-4f3d-a7ff-60756a75441b tempest-SnapshotDependencyTests-1605975403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:05:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7db0ade0-5716-4f3d-a7ff-60756a75441b tempest-SnapshotDependencyTests-1605975403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:05:00 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7db0ade0-5716-4f3d-a7ff-60756a75441b tempest-SnapshotDependencyTests-1605975403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:05:00 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7db0ade0-5716-4f3d-a7ff-60756a75441b tempest-SnapshotDependencyTests-1605975403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:05:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7db0ade0-5716-4f3d-a7ff-60756a75441b tempest-SnapshotDependencyTests-1605975403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:05:00 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7db0ade0-5716-4f3d-a7ff-60756a75441b tempest-SnapshotDependencyTests-1605975403 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:05:00 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-7db0ade0-5716-4f3d-a7ff-60756a75441b tempest-SnapshotDependencyTests-1605975403 None] Acquiring lock "cinder-quobyte-11e4fa5e-283b-4827-9c15-62c8323ef7af" by "_copy_volume_from_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:05:00 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-7db0ade0-5716-4f3d-a7ff-60756a75441b tempest-SnapshotDependencyTests-1605975403 None] Lock "cinder-quobyte-11e4fa5e-283b-4827-9c15-62c8323ef7af" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:05:00 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7db0ade0-5716-4f3d-a7ff-60756a75441b tempest-SnapshotDependencyTests-1605975403 None] snapshot: f53a4939-8199-45e5-8115-af806d104d8f, volume: 11e4fa5e-283b-4827-9c15-62c8323ef7af, {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 18:05:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7db0ade0-5716-4f3d-a7ff-60756a75441b tempest-SnapshotDependencyTests-1605975403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:05:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7db0ade0-5716-4f3d-a7ff-60756a75441b tempest-SnapshotDependencyTests-1605975403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:05:00 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7db0ade0-5716-4f3d-a7ff-60756a75441b tempest-SnapshotDependencyTests-1605975403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:05:00 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7db0ade0-5716-4f3d-a7ff-60756a75441b tempest-SnapshotDependencyTests-1605975403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:05:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7db0ade0-5716-4f3d-a7ff-60756a75441b tempest-SnapshotDependencyTests-1605975403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:05:00 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c3b5a8-fb84-452b-b7ff-8c1a3f66ec76]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:05:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7db0ade0-5716-4f3d-a7ff-60756a75441b tempest-SnapshotDependencyTests-1605975403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-aba856dc-4c62-468a-a23e-16c1598ab9d3.f53a4939-8199-45e5-8115-af806d104d8f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:05:00 devstack sudo[106405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-aba856dc-4c62-468a-a23e-16c1598ab9d3.f53a4939-8199-45e5-8115-af806d104d8f Nov 06 18:05:00 devstack sudo[106405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:05:01 devstack sudo[106405]: pam_unix(sudo:session): session closed for user root Nov 06 18:05:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7db0ade0-5716-4f3d-a7ff-60756a75441b tempest-SnapshotDependencyTests-1605975403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-aba856dc-4c62-468a-a23e-16c1598ab9d3.f53a4939-8199-45e5-8115-af806d104d8f" returned: 0 in 0.432s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:05:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-7db0ade0-5716-4f3d-a7ff-60756a75441b tempest-SnapshotDependencyTests-1605975403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aba856dc-4c62-468a-a23e-16c1598ab9d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:05:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d22780b6-4651-473d-ba70-ad2f4e8f0e92 tempest-ProjectMemberTests-819176810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:05:01 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[57fb23de-9ef6-4e67-a2cc-acd7abdaf4ff]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:05:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7db0ade0-5716-4f3d-a7ff-60756a75441b tempest-SnapshotDependencyTests-1605975403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-aba856dc-4c62-468a-a23e-16c1598ab9d3 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:05:01 devstack sudo[106411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-aba856dc-4c62-468a-a23e-16c1598ab9d3 Nov 06 18:05:01 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:05:01 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root Nov 06 18:05:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7db0ade0-5716-4f3d-a7ff-60756a75441b tempest-SnapshotDependencyTests-1605975403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-aba856dc-4c62-468a-a23e-16c1598ab9d3" returned: 0 in 0.426s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:05:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7db0ade0-5716-4f3d-a7ff-60756a75441b tempest-SnapshotDependencyTests-1605975403 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-aba856dc-4c62-468a-a23e-16c1598ab9d3 {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 18:05:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7db0ade0-5716-4f3d-a7ff-60756a75441b tempest-SnapshotDependencyTests-1605975403 None] Creating direct copy from snapshot {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 18:05:01 devstack cinder-volume[87068]: DEBUG cinder.utils [None req-7db0ade0-5716-4f3d-a7ff-60756a75441b tempest-SnapshotDependencyTests-1605975403 None] Path /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-11e4fa5e-283b-4827-9c15-62c8323ef7af not found in is_blk_device check {{(pid=87068) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 18:05:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7db0ade0-5716-4f3d-a7ff-60756a75441b tempest-SnapshotDependencyTests-1605975403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-aba856dc-4c62-468a-a23e-16c1598ab9d3 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-11e4fa5e-283b-4827-9c15-62c8323ef7af {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:05:01 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-aba856dc-4c62-468a-a23e-16c1598ab9d3 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-11e4fa5e-283b-4827-9c15-62c8323ef7af Nov 06 18:05:01 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:05:09 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Nov 06 18:05:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7db0ade0-5716-4f3d-a7ff-60756a75441b tempest-SnapshotDependencyTests-1605975403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-aba856dc-4c62-468a-a23e-16c1598ab9d3 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-11e4fa5e-283b-4827-9c15-62c8323ef7af" returned: 0 in 7.536s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:05:09 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-7db0ade0-5716-4f3d-a7ff-60756a75441b tempest-SnapshotDependencyTests-1605975403 None] Image conversion details: src /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-aba856dc-4c62-468a-a23e-16c1598ab9d3, size 1024.00 MB, duration 7.54 sec, destination /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-11e4fa5e-283b-4827-9c15-62c8323ef7af {{(pid=87068) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 18:05:09 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-7db0ade0-5716-4f3d-a7ff-60756a75441b tempest-SnapshotDependencyTests-1605975403 None] Converted 1024.00 MB image at 135.84 MB/s Nov 06 18:05:09 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-7db0ade0-5716-4f3d-a7ff-60756a75441b tempest-SnapshotDependencyTests-1605975403 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-11e4fa5e-283b-4827-9c15-62c8323ef7af is being set with open permissions: ugo+rw Nov 06 18:05:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7db0ade0-5716-4f3d-a7ff-60756a75441b tempest-SnapshotDependencyTests-1605975403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-11e4fa5e-283b-4827-9c15-62c8323ef7af {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:05:09 devstack sudo[106434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-11e4fa5e-283b-4827-9c15-62c8323ef7af Nov 06 18:05:09 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:05:09 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root Nov 06 18:05:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7db0ade0-5716-4f3d-a7ff-60756a75441b tempest-SnapshotDependencyTests-1605975403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-11e4fa5e-283b-4827-9c15-62c8323ef7af" returned: 0 in 0.267s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:05:09 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-7db0ade0-5716-4f3d-a7ff-60756a75441b tempest-SnapshotDependencyTests-1605975403 None] Lock "cinder-quobyte-11e4fa5e-283b-4827-9c15-62c8323ef7af" released by "_copy_volume_from_snapshot" :: held 8.756s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:05:09 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=170,cinder:INSERT=63,cinder:DELETE=26,cinder:UPDATE=259 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:05:09 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=206,cinder:UPDATE=244,cinder:INSERT=68,cinder:DELETE=18 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:05:09 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-7db0ade0-5716-4f3d-a7ff-60756a75441b tempest-SnapshotDependencyTests-1605975403 None] Lock "cinder-quobyte-f53a4939-8199-45e5-8115-af806d104d8f-11e4fa5e-283b-4827-9c15-62c8323ef7af" released by "_create_volume_from_snapshot" :: held 8.832s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:05:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7db0ade0-5716-4f3d-a7ff-60756a75441b tempest-SnapshotDependencyTests-1605975403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.848s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:05:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d22780b6-4651-473d-ba70-ad2f4e8f0e92 tempest-ProjectMemberTests-819176810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.320s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:05:09 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-d22780b6-4651-473d-ba70-ad2f4e8f0e92 tempest-ProjectMemberTests-819176810 None] Creating offline snapshot 74c52581-e6ca-43a5-94d3-0287cac620e8 of volume a34bdfa8-4415-4516-af9b-677c1234e763 {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 18:05:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7db0ade0-5716-4f3d-a7ff-60756a75441b tempest-SnapshotDependencyTests-1605975403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cff8ddb-4829-4019-b46c-8056f8a89e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11e4fa5e-283b-4827-9c15-62c8323ef7af', 'volume_size': 1, 'snapshot_id': 'f53a4939-8199-45e5-8115-af806d104d8f'}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:05:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7db0ade0-5716-4f3d-a7ff-60756a75441b tempest-SnapshotDependencyTests-1605975403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (541c8ec9-6a1b-43a7-a733-87e1abf11982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:05:09 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed22f62b-ba42-4b53-9cf8-1fe40c961eb2]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:05:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d22780b6-4651-473d-ba70-ad2f4e8f0e92 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a34bdfa8-4415-4516-af9b-677c1234e763 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:05:09 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-7db0ade0-5716-4f3d-a7ff-60756a75441b tempest-SnapshotDependencyTests-1605975403 None] Volume volume-11e4fa5e-283b-4827-9c15-62c8323ef7af (11e4fa5e-283b-4827-9c15-62c8323ef7af): created successfully Nov 06 18:05:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7db0ade0-5716-4f3d-a7ff-60756a75441b tempest-SnapshotDependencyTests-1605975403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (541c8ec9-6a1b-43a7-a733-87e1abf11982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:05:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7db0ade0-5716-4f3d-a7ff-60756a75441b tempest-SnapshotDependencyTests-1605975403 None] Flow 'volume_create_manager' (81544b27-a2a0-46fc-9bc0-6e16e4d0a8c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:05:09 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-7db0ade0-5716-4f3d-a7ff-60756a75441b tempest-SnapshotDependencyTests-1605975403 None] Created volume successfully. Nov 06 18:05:09 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a34bdfa8-4415-4516-af9b-677c1234e763 Nov 06 18:05:09 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:05:09 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Nov 06 18:05:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d22780b6-4651-473d-ba70-ad2f4e8f0e92 tempest-ProjectMemberTests-819176810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a34bdfa8-4415-4516-af9b-677c1234e763" returned: 0 in 0.375s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:05:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d22780b6-4651-473d-ba70-ad2f4e8f0e92 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a34bdfa8-4415-4516-af9b-677c1234e763,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a34bdfa8-4415-4516-af9b-677c1234e763.74c52581-e6ca-43a5-94d3-0287cac620e8 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:05:09 devstack sudo[106442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a34bdfa8-4415-4516-af9b-677c1234e763,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a34bdfa8-4415-4516-af9b-677c1234e763.74c52581-e6ca-43a5-94d3-0287cac620e8 1G Nov 06 18:05:09 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:05:10 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root Nov 06 18:05:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d22780b6-4651-473d-ba70-ad2f4e8f0e92 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a34bdfa8-4415-4516-af9b-677c1234e763,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a34bdfa8-4415-4516-af9b-677c1234e763.74c52581-e6ca-43a5-94d3-0287cac620e8 1G" returned: 0 in 0.417s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:05:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d22780b6-4651-473d-ba70-ad2f4e8f0e92 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a34bdfa8-4415-4516-af9b-677c1234e763 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a34bdfa8-4415-4516-af9b-677c1234e763.74c52581-e6ca-43a5-94d3-0287cac620e8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:05:10 devstack sudo[106448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a34bdfa8-4415-4516-af9b-677c1234e763 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a34bdfa8-4415-4516-af9b-677c1234e763.74c52581-e6ca-43a5-94d3-0287cac620e8 Nov 06 18:05:10 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:05:10 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-70740ecc-c338-42c4-9a0d-0e27d160380d tempest-SnapshotDependencyTests-1605975403 None] Acquiring lock "cinder-f53a4939-8199-45e5-8115-af806d104d8f-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:05:10 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-70740ecc-c338-42c4-9a0d-0e27d160380d tempest-SnapshotDependencyTests-1605975403 None] Lock "cinder-f53a4939-8199-45e5-8115-af806d104d8f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:05:10 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-70740ecc-c338-42c4-9a0d-0e27d160380d tempest-SnapshotDependencyTests-1605975403 None] Acquiring lock "cinder-quobyte-aba856dc-4c62-468a-a23e-16c1598ab9d3" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:05:10 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-70740ecc-c338-42c4-9a0d-0e27d160380d tempest-SnapshotDependencyTests-1605975403 None] Lock "cinder-quobyte-aba856dc-4c62-468a-a23e-16c1598ab9d3" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:05:10 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-70740ecc-c338-42c4-9a0d-0e27d160380d tempest-SnapshotDependencyTests-1605975403 None] Acquiring lock "cinder-quobyte-f53a4939-8199-45e5-8115-af806d104d8f" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:05:10 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-70740ecc-c338-42c4-9a0d-0e27d160380d tempest-SnapshotDependencyTests-1605975403 None] Lock "cinder-quobyte-f53a4939-8199-45e5-8115-af806d104d8f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:05:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-70740ecc-c338-42c4-9a0d-0e27d160380d tempest-SnapshotDependencyTests-1605975403 None] Deleting offline snapshot f53a4939-8199-45e5-8115-af806d104d8f of volume aba856dc-4c62-468a-a23e-16c1598ab9d3 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:05:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-70740ecc-c338-42c4-9a0d-0e27d160380d tempest-SnapshotDependencyTests-1605975403 None] snapshot_file for this snap is: volume-aba856dc-4c62-468a-a23e-16c1598ab9d3.f53a4939-8199-45e5-8115-af806d104d8f {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:05:10 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd73e9b-e963-4904-85fa-2c0a3df4ff36]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:05:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-70740ecc-c338-42c4-9a0d-0e27d160380d tempest-SnapshotDependencyTests-1605975403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-aba856dc-4c62-468a-a23e-16c1598ab9d3.f53a4939-8199-45e5-8115-af806d104d8f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:05:10 devstack sudo[106450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-aba856dc-4c62-468a-a23e-16c1598ab9d3.f53a4939-8199-45e5-8115-af806d104d8f Nov 06 18:05:10 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:05:10 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root Nov 06 18:05:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d22780b6-4651-473d-ba70-ad2f4e8f0e92 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a34bdfa8-4415-4516-af9b-677c1234e763 -F qcow2 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a34bdfa8-4415-4516-af9b-677c1234e763.74c52581-e6ca-43a5-94d3-0287cac620e8" returned: 0 in 0.335s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:05:10 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-d22780b6-4651-473d-ba70-ad2f4e8f0e92 tempest-ProjectMemberTests-819176810 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a34bdfa8-4415-4516-af9b-677c1234e763.74c52581-e6ca-43a5-94d3-0287cac620e8 is being set with open permissions: ugo+rw Nov 06 18:05:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d22780b6-4651-473d-ba70-ad2f4e8f0e92 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a34bdfa8-4415-4516-af9b-677c1234e763.74c52581-e6ca-43a5-94d3-0287cac620e8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:05:10 devstack sudo[106455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a34bdfa8-4415-4516-af9b-677c1234e763.74c52581-e6ca-43a5-94d3-0287cac620e8 Nov 06 18:05:10 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:05:10 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root Nov 06 18:05:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-70740ecc-c338-42c4-9a0d-0e27d160380d tempest-SnapshotDependencyTests-1605975403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-aba856dc-4c62-468a-a23e-16c1598ab9d3.f53a4939-8199-45e5-8115-af806d104d8f" returned: 0 in 0.377s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:05:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-70740ecc-c338-42c4-9a0d-0e27d160380d tempest-SnapshotDependencyTests-1605975403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aba856dc-4c62-468a-a23e-16c1598ab9d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:05:10 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f993ae-b2d0-4658-9a72-5ab5193c2389]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:05:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-70740ecc-c338-42c4-9a0d-0e27d160380d tempest-SnapshotDependencyTests-1605975403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-aba856dc-4c62-468a-a23e-16c1598ab9d3 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:05:10 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root Nov 06 18:05:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d22780b6-4651-473d-ba70-ad2f4e8f0e92 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a34bdfa8-4415-4516-af9b-677c1234e763.74c52581-e6ca-43a5-94d3-0287cac620e8" returned: 0 in 0.270s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:05:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d22780b6-4651-473d-ba70-ad2f4e8f0e92 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a34bdfa8-4415-4516-af9b-677c1234e763.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:05:10 devstack sudo[106462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a34bdfa8-4415-4516-af9b-677c1234e763.info Nov 06 18:05:10 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:05:10 devstack sudo[106461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-aba856dc-4c62-468a-a23e-16c1598ab9d3 Nov 06 18:05:10 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:05:11 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root Nov 06 18:05:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d22780b6-4651-473d-ba70-ad2f4e8f0e92 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a34bdfa8-4415-4516-af9b-677c1234e763.info" returned: 0 in 0.275s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:05:11 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-d22780b6-4651-473d-ba70-ad2f4e8f0e92 tempest-ProjectMemberTests-819176810 None] /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a34bdfa8-4415-4516-af9b-677c1234e763.info is being set with open permissions: ugo+rw Nov 06 18:05:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d22780b6-4651-473d-ba70-ad2f4e8f0e92 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a34bdfa8-4415-4516-af9b-677c1234e763.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:05:11 devstack sudo[106469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a34bdfa8-4415-4516-af9b-677c1234e763.info Nov 06 18:05:11 devstack sudo[106469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:05:11 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root Nov 06 18:05:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-70740ecc-c338-42c4-9a0d-0e27d160380d tempest-SnapshotDependencyTests-1605975403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-aba856dc-4c62-468a-a23e-16c1598ab9d3" returned: 0 in 0.553s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:05:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-70740ecc-c338-42c4-9a0d-0e27d160380d tempest-SnapshotDependencyTests-1605975403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-aba856dc-4c62-468a-a23e-16c1598ab9d3.f53a4939-8199-45e5-8115-af806d104d8f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:05:11 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-aba856dc-4c62-468a-a23e-16c1598ab9d3.f53a4939-8199-45e5-8115-af806d104d8f Nov 06 18:05:11 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:05:11 devstack sudo[106469]: pam_unix(sudo:session): session closed for user root Nov 06 18:05:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d22780b6-4651-473d-ba70-ad2f4e8f0e92 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a34bdfa8-4415-4516-af9b-677c1234e763.info" returned: 0 in 0.268s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:05:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d22780b6-4651-473d-ba70-ad2f4e8f0e92 tempest-ProjectMemberTests-819176810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.044s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:05:11 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-d22780b6-4651-473d-ba70-ad2f4e8f0e92 tempest-ProjectMemberTests-819176810 None] Create snapshot completed successfully Nov 06 18:05:11 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Nov 06 18:05:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-70740ecc-c338-42c4-9a0d-0e27d160380d tempest-SnapshotDependencyTests-1605975403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-aba856dc-4c62-468a-a23e-16c1598ab9d3.f53a4939-8199-45e5-8115-af806d104d8f" returned: 0 in 0.357s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:05:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-70740ecc-c338-42c4-9a0d-0e27d160380d tempest-SnapshotDependencyTests-1605975403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-aba856dc-4c62-468a-a23e-16c1598ab9d3.f53a4939-8199-45e5-8115-af806d104d8f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:05:11 devstack sudo[106478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-aba856dc-4c62-468a-a23e-16c1598ab9d3.f53a4939-8199-45e5-8115-af806d104d8f Nov 06 18:05:11 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:05:11 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f80a50af-15a3-4cbb-8d88-56f9f0168ede tempest-ProjectMemberTests-819176810 None] Acquiring lock "cinder-74c52581-e6ca-43a5-94d3-0287cac620e8-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:05:11 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f80a50af-15a3-4cbb-8d88-56f9f0168ede tempest-ProjectMemberTests-819176810 None] Lock "cinder-74c52581-e6ca-43a5-94d3-0287cac620e8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:05:11 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f80a50af-15a3-4cbb-8d88-56f9f0168ede tempest-ProjectMemberTests-819176810 None] Acquiring lock "cinder-quobyte-a34bdfa8-4415-4516-af9b-677c1234e763" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:05:11 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f80a50af-15a3-4cbb-8d88-56f9f0168ede tempest-ProjectMemberTests-819176810 None] Lock "cinder-quobyte-a34bdfa8-4415-4516-af9b-677c1234e763" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:05:11 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f80a50af-15a3-4cbb-8d88-56f9f0168ede tempest-ProjectMemberTests-819176810 None] Acquiring lock "cinder-quobyte-74c52581-e6ca-43a5-94d3-0287cac620e8" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:05:11 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f80a50af-15a3-4cbb-8d88-56f9f0168ede tempest-ProjectMemberTests-819176810 None] Lock "cinder-quobyte-74c52581-e6ca-43a5-94d3-0287cac620e8" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:05:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-f80a50af-15a3-4cbb-8d88-56f9f0168ede tempest-ProjectMemberTests-819176810 None] Deleting offline snapshot 74c52581-e6ca-43a5-94d3-0287cac620e8 of volume a34bdfa8-4415-4516-af9b-677c1234e763 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 18:05:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-f80a50af-15a3-4cbb-8d88-56f9f0168ede tempest-ProjectMemberTests-819176810 None] snapshot_file for this snap is: volume-a34bdfa8-4415-4516-af9b-677c1234e763.74c52581-e6ca-43a5-94d3-0287cac620e8 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 18:05:11 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d7161a-f845-4027-955e-55cdf0174444]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:05:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f80a50af-15a3-4cbb-8d88-56f9f0168ede tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a34bdfa8-4415-4516-af9b-677c1234e763.74c52581-e6ca-43a5-94d3-0287cac620e8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:05:11 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a34bdfa8-4415-4516-af9b-677c1234e763.74c52581-e6ca-43a5-94d3-0287cac620e8 Nov 06 18:05:11 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:05:12 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root Nov 06 18:05:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-70740ecc-c338-42c4-9a0d-0e27d160380d tempest-SnapshotDependencyTests-1605975403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-aba856dc-4c62-468a-a23e-16c1598ab9d3.f53a4939-8199-45e5-8115-af806d104d8f" returned: 0 in 0.274s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:05:12 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-70740ecc-c338-42c4-9a0d-0e27d160380d tempest-SnapshotDependencyTests-1605975403 None] Lock "cinder-quobyte-f53a4939-8199-45e5-8115-af806d104d8f" released by "_delete_snapshot" :: held 1.677s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:05:12 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-70740ecc-c338-42c4-9a0d-0e27d160380d tempest-SnapshotDependencyTests-1605975403 None] Lock "cinder-quobyte-aba856dc-4c62-468a-a23e-16c1598ab9d3" released by "delete_snapshot" :: held 1.705s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:05:12 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-70740ecc-c338-42c4-9a0d-0e27d160380d tempest-SnapshotDependencyTests-1605975403 None] Created reservations ['0d656714-f724-4ed3-b294-ffb898b28364', 'be00e914-f5bf-485a-89d2-f11ea01b9735', 'fea6516f-acee-41f9-b55a-b0260537eabf', '931169e7-bb91-4269-8d9a-6394d5ff07d7'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:05:12 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-70740ecc-c338-42c4-9a0d-0e27d160380d tempest-SnapshotDependencyTests-1605975403 None] Delete snapshot completed successfully. Nov 06 18:05:12 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-70740ecc-c338-42c4-9a0d-0e27d160380d tempest-SnapshotDependencyTests-1605975403 None] Lock "cinder-f53a4939-8199-45e5-8115-af806d104d8f-delete_snapshot" released by "delete_snapshot" :: held 1.853s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:05:12 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Nov 06 18:05:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f80a50af-15a3-4cbb-8d88-56f9f0168ede tempest-ProjectMemberTests-819176810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a34bdfa8-4415-4516-af9b-677c1234e763.74c52581-e6ca-43a5-94d3-0287cac620e8" returned: 0 in 0.403s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:05:12 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-f80a50af-15a3-4cbb-8d88-56f9f0168ede tempest-ProjectMemberTests-819176810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a34bdfa8-4415-4516-af9b-677c1234e763(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 18:05:12 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1f1038-83c7-4962-a2a0-a7738c4c4390]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:05:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f80a50af-15a3-4cbb-8d88-56f9f0168ede tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a34bdfa8-4415-4516-af9b-677c1234e763 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:05:12 devstack sudo[106486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a34bdfa8-4415-4516-af9b-677c1234e763 Nov 06 18:05:12 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:05:12 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6b2cd8c2-87e6-4c46-8b00-0eb7fb67e3db tempest-SnapshotDependencyTests-1605975403 None] Acquiring lock "cinder-aba856dc-4c62-468a-a23e-16c1598ab9d3-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:05:12 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6b2cd8c2-87e6-4c46-8b00-0eb7fb67e3db tempest-SnapshotDependencyTests-1605975403 None] Lock "cinder-aba856dc-4c62-468a-a23e-16c1598ab9d3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:05:12 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6b2cd8c2-87e6-4c46-8b00-0eb7fb67e3db tempest-SnapshotDependencyTests-1605975403 None] Acquiring lock "cinder-quobyte-aba856dc-4c62-468a-a23e-16c1598ab9d3" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:05:12 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6b2cd8c2-87e6-4c46-8b00-0eb7fb67e3db tempest-SnapshotDependencyTests-1605975403 None] Lock "cinder-quobyte-aba856dc-4c62-468a-a23e-16c1598ab9d3" acquired by "delete_volume" :: waited 0.019s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:05:12 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2330591-c3e2-4217-a3e3-5b1c8c533ed5]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:05:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6b2cd8c2-87e6-4c46-8b00-0eb7fb67e3db tempest-SnapshotDependencyTests-1605975403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-aba856dc-4c62-468a-a23e-16c1598ab9d3 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:05:12 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root Nov 06 18:05:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f80a50af-15a3-4cbb-8d88-56f9f0168ede tempest-ProjectMemberTests-819176810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a34bdfa8-4415-4516-af9b-677c1234e763" returned: 0 in 0.408s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:05:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f80a50af-15a3-4cbb-8d88-56f9f0168ede tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a34bdfa8-4415-4516-af9b-677c1234e763.74c52581-e6ca-43a5-94d3-0287cac620e8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:05:12 devstack sudo[106492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a34bdfa8-4415-4516-af9b-677c1234e763.74c52581-e6ca-43a5-94d3-0287cac620e8 Nov 06 18:05:12 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:05:12 devstack sudo[106491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-aba856dc-4c62-468a-a23e-16c1598ab9d3 Nov 06 18:05:12 devstack sudo[106491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:05:13 devstack sudo[106491]: pam_unix(sudo:session): session closed for user root Nov 06 18:05:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6b2cd8c2-87e6-4c46-8b00-0eb7fb67e3db tempest-SnapshotDependencyTests-1605975403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-aba856dc-4c62-468a-a23e-16c1598ab9d3" returned: 0 in 0.379s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:05:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6b2cd8c2-87e6-4c46-8b00-0eb7fb67e3db tempest-SnapshotDependencyTests-1605975403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-aba856dc-4c62-468a-a23e-16c1598ab9d3 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:05:13 devstack sudo[106502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-aba856dc-4c62-468a-a23e-16c1598ab9d3 Nov 06 18:05:13 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:05:13 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root Nov 06 18:05:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f80a50af-15a3-4cbb-8d88-56f9f0168ede tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a34bdfa8-4415-4516-af9b-677c1234e763.74c52581-e6ca-43a5-94d3-0287cac620e8" returned: 0 in 0.376s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:05:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f80a50af-15a3-4cbb-8d88-56f9f0168ede tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a34bdfa8-4415-4516-af9b-677c1234e763.74c52581-e6ca-43a5-94d3-0287cac620e8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:05:13 devstack sudo[106504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a34bdfa8-4415-4516-af9b-677c1234e763.74c52581-e6ca-43a5-94d3-0287cac620e8 Nov 06 18:05:13 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:05:13 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root Nov 06 18:05:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6b2cd8c2-87e6-4c46-8b00-0eb7fb67e3db tempest-SnapshotDependencyTests-1605975403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-aba856dc-4c62-468a-a23e-16c1598ab9d3" returned: 0 in 0.288s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:05:13 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6b2cd8c2-87e6-4c46-8b00-0eb7fb67e3db tempest-SnapshotDependencyTests-1605975403 None] Lock "cinder-quobyte-aba856dc-4c62-468a-a23e-16c1598ab9d3" released by "delete_volume" :: held 0.746s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:05:13 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root Nov 06 18:05:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f80a50af-15a3-4cbb-8d88-56f9f0168ede tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a34bdfa8-4415-4516-af9b-677c1234e763.74c52581-e6ca-43a5-94d3-0287cac620e8" returned: 0 in 0.269s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:05:13 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f80a50af-15a3-4cbb-8d88-56f9f0168ede tempest-ProjectMemberTests-819176810 None] Lock "cinder-quobyte-74c52581-e6ca-43a5-94d3-0287cac620e8" released by "_delete_snapshot" :: held 1.552s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:05:13 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f80a50af-15a3-4cbb-8d88-56f9f0168ede tempest-ProjectMemberTests-819176810 None] Lock "cinder-quobyte-a34bdfa8-4415-4516-af9b-677c1234e763" released by "delete_snapshot" :: held 1.575s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:05:13 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-6b2cd8c2-87e6-4c46-8b00-0eb7fb67e3db tempest-SnapshotDependencyTests-1605975403 None] Created reservations ['f3760581-c885-46e7-ae09-7ca969d30ebf', '99be706d-dab6-4cb6-9bb7-c7b5c96f27e6', '1c03313e-54ab-4839-8122-a8c0ead608e0', '285a6429-dd42-4177-aef9-a1b94362c916'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:05:13 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-f80a50af-15a3-4cbb-8d88-56f9f0168ede tempest-ProjectMemberTests-819176810 None] Created reservations ['91c1fd67-4e04-4b46-be50-22946654d69b', '4709af36-b9a5-473d-affa-67a24004f982', 'ff2f2672-1a6a-4683-92cb-577670e7fee5', 'b127fe1c-9103-4f13-8a5b-4431cd617764'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:05:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6b2cd8c2-87e6-4c46-8b00-0eb7fb67e3db tempest-SnapshotDependencyTests-1605975403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:05:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6b2cd8c2-87e6-4c46-8b00-0eb7fb67e3db tempest-SnapshotDependencyTests-1605975403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:05:13 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-6b2cd8c2-87e6-4c46-8b00-0eb7fb67e3db tempest-SnapshotDependencyTests-1605975403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:05:13 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-6b2cd8c2-87e6-4c46-8b00-0eb7fb67e3db tempest-SnapshotDependencyTests-1605975403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:05:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6b2cd8c2-87e6-4c46-8b00-0eb7fb67e3db tempest-SnapshotDependencyTests-1605975403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:05:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6b2cd8c2-87e6-4c46-8b00-0eb7fb67e3db tempest-SnapshotDependencyTests-1605975403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:05:13 devstack sudo[106508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:05:13 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:05:13 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-f80a50af-15a3-4cbb-8d88-56f9f0168ede tempest-ProjectMemberTests-819176810 None] Delete snapshot completed successfully. Nov 06 18:05:13 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f80a50af-15a3-4cbb-8d88-56f9f0168ede tempest-ProjectMemberTests-819176810 None] Lock "cinder-74c52581-e6ca-43a5-94d3-0287cac620e8-delete_snapshot" released by "delete_snapshot" :: held 1.772s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:05:13 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a006e454-6b20-4b83-bc8e-a2ee59512cdc tempest-SnapshotDependencyTests-1605975403 None] Acquiring lock "cinder-11e4fa5e-283b-4827-9c15-62c8323ef7af-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:05:13 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a006e454-6b20-4b83-bc8e-a2ee59512cdc tempest-SnapshotDependencyTests-1605975403 None] Lock "cinder-11e4fa5e-283b-4827-9c15-62c8323ef7af-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:05:13 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a006e454-6b20-4b83-bc8e-a2ee59512cdc tempest-SnapshotDependencyTests-1605975403 None] Acquiring lock "cinder-quobyte-11e4fa5e-283b-4827-9c15-62c8323ef7af" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:05:13 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a006e454-6b20-4b83-bc8e-a2ee59512cdc tempest-SnapshotDependencyTests-1605975403 None] Lock "cinder-quobyte-11e4fa5e-283b-4827-9c15-62c8323ef7af" acquired by "delete_volume" :: waited 0.018s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:05:13 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root Nov 06 18:05:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6b2cd8c2-87e6-4c46-8b00-0eb7fb67e3db tempest-SnapshotDependencyTests-1605975403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.284s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:05:13 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-6b2cd8c2-87e6-4c46-8b00-0eb7fb67e3db tempest-SnapshotDependencyTests-1605975403 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:05:13 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[31edbd8a-1b77-44ff-9c97-7fe85400e3cc]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:05:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a006e454-6b20-4b83-bc8e-a2ee59512cdc tempest-SnapshotDependencyTests-1605975403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-11e4fa5e-283b-4827-9c15-62c8323ef7af {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:05:13 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-6b2cd8c2-87e6-4c46-8b00-0eb7fb67e3db tempest-SnapshotDependencyTests-1605975403 None] Deleted volume successfully. Nov 06 18:05:13 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6b2cd8c2-87e6-4c46-8b00-0eb7fb67e3db tempest-SnapshotDependencyTests-1605975403 None] Lock "cinder-aba856dc-4c62-468a-a23e-16c1598ab9d3-delete_volume" released by "delete_volume" :: held 1.321s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:05:13 devstack sudo[106511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-11e4fa5e-283b-4827-9c15-62c8323ef7af Nov 06 18:05:13 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:05:13 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2f971de6-9cc1-4be8-b65c-d10748cfc251 tempest-ProjectMemberTests-819176810 None] Acquiring lock "cinder-a34bdfa8-4415-4516-af9b-677c1234e763-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:05:13 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2f971de6-9cc1-4be8-b65c-d10748cfc251 tempest-ProjectMemberTests-819176810 None] Lock "cinder-a34bdfa8-4415-4516-af9b-677c1234e763-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:05:14 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2f971de6-9cc1-4be8-b65c-d10748cfc251 tempest-ProjectMemberTests-819176810 None] Acquiring lock "cinder-quobyte-a34bdfa8-4415-4516-af9b-677c1234e763" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:05:14 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2f971de6-9cc1-4be8-b65c-d10748cfc251 tempest-ProjectMemberTests-819176810 None] Lock "cinder-quobyte-a34bdfa8-4415-4516-af9b-677c1234e763" acquired by "delete_volume" :: waited 0.022s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:05:14 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4132d30c-caa9-4145-a7aa-dbea35ad108f]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:05:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2f971de6-9cc1-4be8-b65c-d10748cfc251 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a34bdfa8-4415-4516-af9b-677c1234e763 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:05:14 devstack sudo[106513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a34bdfa8-4415-4516-af9b-677c1234e763 Nov 06 18:05:14 devstack sudo[106513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:05:14 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root Nov 06 18:05:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a006e454-6b20-4b83-bc8e-a2ee59512cdc tempest-SnapshotDependencyTests-1605975403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-11e4fa5e-283b-4827-9c15-62c8323ef7af" returned: 0 in 0.458s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:05:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a006e454-6b20-4b83-bc8e-a2ee59512cdc tempest-SnapshotDependencyTests-1605975403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-11e4fa5e-283b-4827-9c15-62c8323ef7af {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:05:14 devstack sudo[106518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-11e4fa5e-283b-4827-9c15-62c8323ef7af Nov 06 18:05:14 devstack sudo[106518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:05:14 devstack sudo[106513]: pam_unix(sudo:session): session closed for user root Nov 06 18:05:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2f971de6-9cc1-4be8-b65c-d10748cfc251 tempest-ProjectMemberTests-819176810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a34bdfa8-4415-4516-af9b-677c1234e763" returned: 0 in 0.395s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:05:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2f971de6-9cc1-4be8-b65c-d10748cfc251 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a34bdfa8-4415-4516-af9b-677c1234e763 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:05:14 devstack sudo[106518]: pam_unix(sudo:session): session closed for user root Nov 06 18:05:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a006e454-6b20-4b83-bc8e-a2ee59512cdc tempest-SnapshotDependencyTests-1605975403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-11e4fa5e-283b-4827-9c15-62c8323ef7af" returned: 0 in 0.272s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:05:14 devstack sudo[106524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a34bdfa8-4415-4516-af9b-677c1234e763 Nov 06 18:05:14 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a006e454-6b20-4b83-bc8e-a2ee59512cdc tempest-SnapshotDependencyTests-1605975403 None] Lock "cinder-quobyte-11e4fa5e-283b-4827-9c15-62c8323ef7af" released by "delete_volume" :: held 0.779s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:05:14 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:05:14 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-a006e454-6b20-4b83-bc8e-a2ee59512cdc tempest-SnapshotDependencyTests-1605975403 None] Created reservations ['c8dfad89-bd7b-44d1-b010-892bcbc7cc8e', 'efcf1794-d1df-4c74-81ec-4185cc1e429f', '755afeda-ca56-4369-8d16-901160f86791', '6de46c4a-865f-4534-976f-6c57d481213b'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:05:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a006e454-6b20-4b83-bc8e-a2ee59512cdc tempest-SnapshotDependencyTests-1605975403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:05:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a006e454-6b20-4b83-bc8e-a2ee59512cdc tempest-SnapshotDependencyTests-1605975403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:05:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a006e454-6b20-4b83-bc8e-a2ee59512cdc tempest-SnapshotDependencyTests-1605975403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:05:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a006e454-6b20-4b83-bc8e-a2ee59512cdc tempest-SnapshotDependencyTests-1605975403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:05:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a006e454-6b20-4b83-bc8e-a2ee59512cdc tempest-SnapshotDependencyTests-1605975403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:05:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a006e454-6b20-4b83-bc8e-a2ee59512cdc tempest-SnapshotDependencyTests-1605975403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:05:14 devstack sudo[106526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:05:14 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:05:14 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root Nov 06 18:05:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2f971de6-9cc1-4be8-b65c-d10748cfc251 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-a34bdfa8-4415-4516-af9b-677c1234e763" returned: 0 in 0.295s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:05:14 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2f971de6-9cc1-4be8-b65c-d10748cfc251 tempest-ProjectMemberTests-819176810 None] Lock "cinder-quobyte-a34bdfa8-4415-4516-af9b-677c1234e763" released by "delete_volume" :: held 0.780s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:05:14 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-2f971de6-9cc1-4be8-b65c-d10748cfc251 tempest-ProjectMemberTests-819176810 None] Created reservations ['22b72bd3-cbdb-4b1a-a38d-6d018a8d81bf', '0633ed55-03d5-478a-9314-f9d55ec56b12', '981b9dd4-563e-45fa-a174-afb828bed9f1', 'bcfa857a-1189-44c2-8d3a-e23a0c65e0a9'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:05:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2f971de6-9cc1-4be8-b65c-d10748cfc251 tempest-ProjectMemberTests-819176810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:05:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2f971de6-9cc1-4be8-b65c-d10748cfc251 tempest-ProjectMemberTests-819176810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:05:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2f971de6-9cc1-4be8-b65c-d10748cfc251 tempest-ProjectMemberTests-819176810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:05:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2f971de6-9cc1-4be8-b65c-d10748cfc251 tempest-ProjectMemberTests-819176810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:05:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2f971de6-9cc1-4be8-b65c-d10748cfc251 tempest-ProjectMemberTests-819176810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:05:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2f971de6-9cc1-4be8-b65c-d10748cfc251 tempest-ProjectMemberTests-819176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:05:14 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root Nov 06 18:05:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a006e454-6b20-4b83-bc8e-a2ee59512cdc tempest-SnapshotDependencyTests-1605975403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.304s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:05:15 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-a006e454-6b20-4b83-bc8e-a2ee59512cdc tempest-SnapshotDependencyTests-1605975403 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:05:15 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-a006e454-6b20-4b83-bc8e-a2ee59512cdc tempest-SnapshotDependencyTests-1605975403 None] Deleted volume successfully. Nov 06 18:05:15 devstack sudo[106530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:05:15 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:05:15 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a006e454-6b20-4b83-bc8e-a2ee59512cdc tempest-SnapshotDependencyTests-1605975403 None] Lock "cinder-11e4fa5e-283b-4827-9c15-62c8323ef7af-delete_volume" released by "delete_volume" :: held 1.341s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:05:15 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root Nov 06 18:05:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2f971de6-9cc1-4be8-b65c-d10748cfc251 tempest-ProjectMemberTests-819176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.274s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:05:15 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-2f971de6-9cc1-4be8-b65c-d10748cfc251 tempest-ProjectMemberTests-819176810 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:05:15 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-2f971de6-9cc1-4be8-b65c-d10748cfc251 tempest-ProjectMemberTests-819176810 None] Deleted volume successfully. Nov 06 18:05:15 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2f971de6-9cc1-4be8-b65c-d10748cfc251 tempest-ProjectMemberTests-819176810 None] Lock "cinder-a34bdfa8-4415-4516-af9b-677c1234e763-delete_volume" released by "delete_volume" :: held 1.319s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:05:24 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=31,cinder:INSERT=11,cinder:UPDATE=38,cinder:DELETE=2 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:05:25 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=25,cinder:UPDATE=38,cinder:DELETE=3,cinder:INSERT=11 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:05:27 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3d08a1b-c7e9-4b0c-a41a-9f6111610d2e tempest-ProjectReaderTests-1515381406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:05:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a3d08a1b-c7e9-4b0c-a41a-9f6111610d2e tempest-ProjectReaderTests-1515381406 None] Flow 'volume_create_manager' (c5222efc-2ce4-4c3b-8d0c-22809eb9f23a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:05:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a3d08a1b-c7e9-4b0c-a41a-9f6111610d2e tempest-ProjectReaderTests-1515381406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1d17320-dbf8-40bd-8801-bffd87686e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:05:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a3d08a1b-c7e9-4b0c-a41a-9f6111610d2e tempest-ProjectReaderTests-1515381406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1d17320-dbf8-40bd-8801-bffd87686e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-472829421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce7997a8-b44f-4d6c-b4f7-eac643149bf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27d74312a73f47b587b1bf89677fa926',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:05:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:05:28Z,use_quota=True,user_id='1b0780ed46304e75858281cf61e202af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:05:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a3d08a1b-c7e9-4b0c-a41a-9f6111610d2e tempest-ProjectReaderTests-1515381406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e941fc7-6e77-4de5-aa07-f1826dcc84ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:05:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a3d08a1b-c7e9-4b0c-a41a-9f6111610d2e tempest-ProjectReaderTests-1515381406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e941fc7-6e77-4de5-aa07-f1826dcc84ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:05:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a3d08a1b-c7e9-4b0c-a41a-9f6111610d2e tempest-ProjectReaderTests-1515381406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f46bcdae-adf2-48d2-8e0b-c0eaea9b59c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:05:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a3d08a1b-c7e9-4b0c-a41a-9f6111610d2e tempest-ProjectReaderTests-1515381406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f46bcdae-adf2-48d2-8e0b-c0eaea9b59c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce7997a8-b44f-4d6c-b4f7-eac643149bf1', 'volume_name': 'volume-ce7997a8-b44f-4d6c-b4f7-eac643149bf1', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:05:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a3d08a1b-c7e9-4b0c-a41a-9f6111610d2e tempest-ProjectReaderTests-1515381406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdc82071-a5c3-4ab7-8819-e7aa8f3c9ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:05:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a3d08a1b-c7e9-4b0c-a41a-9f6111610d2e tempest-ProjectReaderTests-1515381406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdc82071-a5c3-4ab7-8819-e7aa8f3c9ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:05:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a3d08a1b-c7e9-4b0c-a41a-9f6111610d2e tempest-ProjectReaderTests-1515381406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3582964d-6fec-492b-8302-dfbd4298abe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:05:27 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-a3d08a1b-c7e9-4b0c-a41a-9f6111610d2e tempest-ProjectReaderTests-1515381406 None] Volume ce7997a8-b44f-4d6c-b4f7-eac643149bf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce7997a8-b44f-4d6c-b4f7-eac643149bf1', 'volume_size': 1} Nov 06 18:05:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a3d08a1b-c7e9-4b0c-a41a-9f6111610d2e tempest-ProjectReaderTests-1515381406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:05:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a3d08a1b-c7e9-4b0c-a41a-9f6111610d2e tempest-ProjectReaderTests-1515381406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:05:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a3d08a1b-c7e9-4b0c-a41a-9f6111610d2e tempest-ProjectReaderTests-1515381406 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-472829421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce7997a8-b44f-4d6c-b4f7-eac643149bf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27d74312a73f47b587b1bf89677fa926',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:05:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:05:28Z,use_quota=True,user_id='1b0780ed46304e75858281cf61e202af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:05:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-a3d08a1b-c7e9-4b0c-a41a-9f6111610d2e tempest-ProjectReaderTests-1515381406 None] Creating volume ce7997a8-b44f-4d6c-b4f7-eac643149bf1 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:05:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a3d08a1b-c7e9-4b0c-a41a-9f6111610d2e tempest-ProjectReaderTests-1515381406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:05:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a3d08a1b-c7e9-4b0c-a41a-9f6111610d2e tempest-ProjectReaderTests-1515381406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:05:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a3d08a1b-c7e9-4b0c-a41a-9f6111610d2e tempest-ProjectReaderTests-1515381406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:05:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a3d08a1b-c7e9-4b0c-a41a-9f6111610d2e tempest-ProjectReaderTests-1515381406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:05:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a3d08a1b-c7e9-4b0c-a41a-9f6111610d2e tempest-ProjectReaderTests-1515381406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:05:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a3d08a1b-c7e9-4b0c-a41a-9f6111610d2e tempest-ProjectReaderTests-1515381406 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:05:27 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-a3d08a1b-c7e9-4b0c-a41a-9f6111610d2e tempest-ProjectReaderTests-1515381406 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:05:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a3d08a1b-c7e9-4b0c-a41a-9f6111610d2e tempest-ProjectReaderTests-1515381406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ce7997a8-b44f-4d6c-b4f7-eac643149bf1 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:05:27 devstack sudo[106538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ce7997a8-b44f-4d6c-b4f7-eac643149bf1 1073741824 Nov 06 18:05:27 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:05:28 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root Nov 06 18:05:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a3d08a1b-c7e9-4b0c-a41a-9f6111610d2e tempest-ProjectReaderTests-1515381406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ce7997a8-b44f-4d6c-b4f7-eac643149bf1 1073741824" returned: 0 in 0.419s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:05:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a3d08a1b-c7e9-4b0c-a41a-9f6111610d2e tempest-ProjectReaderTests-1515381406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ce7997a8-b44f-4d6c-b4f7-eac643149bf1 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:05:28 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ce7997a8-b44f-4d6c-b4f7-eac643149bf1 Nov 06 18:05:28 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:05:28 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Nov 06 18:05:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a3d08a1b-c7e9-4b0c-a41a-9f6111610d2e tempest-ProjectReaderTests-1515381406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ce7997a8-b44f-4d6c-b4f7-eac643149bf1" returned: 0 in 0.249s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:05:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a3d08a1b-c7e9-4b0c-a41a-9f6111610d2e tempest-ProjectReaderTests-1515381406 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:05:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a3d08a1b-c7e9-4b0c-a41a-9f6111610d2e tempest-ProjectReaderTests-1515381406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:05:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a3d08a1b-c7e9-4b0c-a41a-9f6111610d2e tempest-ProjectReaderTests-1515381406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3582964d-6fec-492b-8302-dfbd4298abe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce7997a8-b44f-4d6c-b4f7-eac643149bf1', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:05:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a3d08a1b-c7e9-4b0c-a41a-9f6111610d2e tempest-ProjectReaderTests-1515381406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7066fa22-8cff-423b-a239-7c30b1ace61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:05:28 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-a3d08a1b-c7e9-4b0c-a41a-9f6111610d2e tempest-ProjectReaderTests-1515381406 None] Volume volume-ce7997a8-b44f-4d6c-b4f7-eac643149bf1 (ce7997a8-b44f-4d6c-b4f7-eac643149bf1): created successfully Nov 06 18:05:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a3d08a1b-c7e9-4b0c-a41a-9f6111610d2e tempest-ProjectReaderTests-1515381406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7066fa22-8cff-423b-a239-7c30b1ace61b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:05:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a3d08a1b-c7e9-4b0c-a41a-9f6111610d2e tempest-ProjectReaderTests-1515381406 None] Flow 'volume_create_manager' (c5222efc-2ce4-4c3b-8d0c-22809eb9f23a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:05:28 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-a3d08a1b-c7e9-4b0c-a41a-9f6111610d2e tempest-ProjectReaderTests-1515381406 None] Created volume successfully. Nov 06 18:05:28 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-923f555a-d83d-42eb-86a5-2f748361911c tempest-ProjectReaderTests-1515381406 None] Acquiring lock "cinder-ce7997a8-b44f-4d6c-b4f7-eac643149bf1-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:05:28 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-923f555a-d83d-42eb-86a5-2f748361911c tempest-ProjectReaderTests-1515381406 None] Lock "cinder-ce7997a8-b44f-4d6c-b4f7-eac643149bf1-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:05:28 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-923f555a-d83d-42eb-86a5-2f748361911c tempest-ProjectReaderTests-1515381406 None] Acquiring lock "cinder-quobyte-ce7997a8-b44f-4d6c-b4f7-eac643149bf1" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:05:28 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-923f555a-d83d-42eb-86a5-2f748361911c tempest-ProjectReaderTests-1515381406 None] Lock "cinder-quobyte-ce7997a8-b44f-4d6c-b4f7-eac643149bf1" acquired by "delete_volume" :: waited 0.014s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:05:28 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[47597397-ed6f-4aab-9095-b726b43e7989]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:05:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-923f555a-d83d-42eb-86a5-2f748361911c tempest-ProjectReaderTests-1515381406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ce7997a8-b44f-4d6c-b4f7-eac643149bf1 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:05:29 devstack sudo[106547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ce7997a8-b44f-4d6c-b4f7-eac643149bf1 Nov 06 18:05:29 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:05:29 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root Nov 06 18:05:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-923f555a-d83d-42eb-86a5-2f748361911c tempest-ProjectReaderTests-1515381406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ce7997a8-b44f-4d6c-b4f7-eac643149bf1" returned: 0 in 0.380s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:05:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-923f555a-d83d-42eb-86a5-2f748361911c tempest-ProjectReaderTests-1515381406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ce7997a8-b44f-4d6c-b4f7-eac643149bf1 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:05:29 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ce7997a8-b44f-4d6c-b4f7-eac643149bf1 Nov 06 18:05:29 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:05:29 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Nov 06 18:05:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-923f555a-d83d-42eb-86a5-2f748361911c tempest-ProjectReaderTests-1515381406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-ce7997a8-b44f-4d6c-b4f7-eac643149bf1" returned: 0 in 0.243s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:05:29 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-923f555a-d83d-42eb-86a5-2f748361911c tempest-ProjectReaderTests-1515381406 None] Lock "cinder-quobyte-ce7997a8-b44f-4d6c-b4f7-eac643149bf1" released by "delete_volume" :: held 0.662s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:05:29 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-923f555a-d83d-42eb-86a5-2f748361911c tempest-ProjectReaderTests-1515381406 None] Created reservations ['555bfeab-1533-4cf4-b115-71b505687c21', '6c359741-991d-4b6e-9742-0355aee4ee57', '418e3ca1-f2ef-4447-b23d-e130764ad608', '6cbb34ed-957e-470c-9924-eb23656000ea'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:05:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-923f555a-d83d-42eb-86a5-2f748361911c tempest-ProjectReaderTests-1515381406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:05:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-923f555a-d83d-42eb-86a5-2f748361911c tempest-ProjectReaderTests-1515381406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:05:29 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-923f555a-d83d-42eb-86a5-2f748361911c tempest-ProjectReaderTests-1515381406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:05:29 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-923f555a-d83d-42eb-86a5-2f748361911c tempest-ProjectReaderTests-1515381406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:05:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-923f555a-d83d-42eb-86a5-2f748361911c tempest-ProjectReaderTests-1515381406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:05:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-923f555a-d83d-42eb-86a5-2f748361911c tempest-ProjectReaderTests-1515381406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:05:29 devstack sudo[106555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:05:29 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:05:29 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root Nov 06 18:05:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-923f555a-d83d-42eb-86a5-2f748361911c tempest-ProjectReaderTests-1515381406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.251s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:05:29 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-923f555a-d83d-42eb-86a5-2f748361911c tempest-ProjectReaderTests-1515381406 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:05:29 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-923f555a-d83d-42eb-86a5-2f748361911c tempest-ProjectReaderTests-1515381406 None] Deleted volume successfully. Nov 06 18:05:29 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-923f555a-d83d-42eb-86a5-2f748361911c tempest-ProjectReaderTests-1515381406 None] Lock "cinder-ce7997a8-b44f-4d6c-b4f7-eac643149bf1-delete_volume" released by "delete_volume" :: held 1.100s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:05:30 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-eaae5abc-b11d-40c4-a6f9-b9eb8a4edac6 tempest-ProjectReaderTests-1515381406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:05:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-eaae5abc-b11d-40c4-a6f9-b9eb8a4edac6 tempest-ProjectReaderTests-1515381406 None] Flow 'volume_create_manager' (02d617e5-0557-4762-8ac9-5bc8605c0670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:05:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-eaae5abc-b11d-40c4-a6f9-b9eb8a4edac6 tempest-ProjectReaderTests-1515381406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (042577cb-cda2-4553-98f7-cefffc3727b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:05:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-eaae5abc-b11d-40c4-a6f9-b9eb8a4edac6 tempest-ProjectReaderTests-1515381406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (042577cb-cda2-4553-98f7-cefffc3727b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:05:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-511247112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73c92d95-bb5a-42c5-80dc-e06efb026393,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27d74312a73f47b587b1bf89677fa926',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:05:30Z,use_quota=True,user_id='1b0780ed46304e75858281cf61e202af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:05:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-eaae5abc-b11d-40c4-a6f9-b9eb8a4edac6 tempest-ProjectReaderTests-1515381406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9f1da9f-bf9b-4f29-833b-e553d21bf228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:05:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-eaae5abc-b11d-40c4-a6f9-b9eb8a4edac6 tempest-ProjectReaderTests-1515381406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9f1da9f-bf9b-4f29-833b-e553d21bf228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:05:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-eaae5abc-b11d-40c4-a6f9-b9eb8a4edac6 tempest-ProjectReaderTests-1515381406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (041cbef0-9b4d-4ab4-b62c-f49779e0a5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:05:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-eaae5abc-b11d-40c4-a6f9-b9eb8a4edac6 tempest-ProjectReaderTests-1515381406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (041cbef0-9b4d-4ab4-b62c-f49779e0a5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73c92d95-bb5a-42c5-80dc-e06efb026393', 'volume_name': 'volume-73c92d95-bb5a-42c5-80dc-e06efb026393', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:05:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-eaae5abc-b11d-40c4-a6f9-b9eb8a4edac6 tempest-ProjectReaderTests-1515381406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d3d4a44-6e10-42d1-8ac2-ab83969adb5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:05:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-eaae5abc-b11d-40c4-a6f9-b9eb8a4edac6 tempest-ProjectReaderTests-1515381406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d3d4a44-6e10-42d1-8ac2-ab83969adb5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:05:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-eaae5abc-b11d-40c4-a6f9-b9eb8a4edac6 tempest-ProjectReaderTests-1515381406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ebcb7d9-14b8-42c6-88de-507f573c8d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:05:30 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-eaae5abc-b11d-40c4-a6f9-b9eb8a4edac6 tempest-ProjectReaderTests-1515381406 None] Volume 73c92d95-bb5a-42c5-80dc-e06efb026393: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73c92d95-bb5a-42c5-80dc-e06efb026393', 'volume_size': 1} Nov 06 18:05:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-eaae5abc-b11d-40c4-a6f9-b9eb8a4edac6 tempest-ProjectReaderTests-1515381406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:05:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-eaae5abc-b11d-40c4-a6f9-b9eb8a4edac6 tempest-ProjectReaderTests-1515381406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:05:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-eaae5abc-b11d-40c4-a6f9-b9eb8a4edac6 tempest-ProjectReaderTests-1515381406 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:05:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-511247112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73c92d95-bb5a-42c5-80dc-e06efb026393,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27d74312a73f47b587b1bf89677fa926',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:05:30Z,use_quota=True,user_id='1b0780ed46304e75858281cf61e202af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:05:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-eaae5abc-b11d-40c4-a6f9-b9eb8a4edac6 tempest-ProjectReaderTests-1515381406 None] Creating volume 73c92d95-bb5a-42c5-80dc-e06efb026393 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:05:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-eaae5abc-b11d-40c4-a6f9-b9eb8a4edac6 tempest-ProjectReaderTests-1515381406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:05:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-eaae5abc-b11d-40c4-a6f9-b9eb8a4edac6 tempest-ProjectReaderTests-1515381406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:05:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-eaae5abc-b11d-40c4-a6f9-b9eb8a4edac6 tempest-ProjectReaderTests-1515381406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:05:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-eaae5abc-b11d-40c4-a6f9-b9eb8a4edac6 tempest-ProjectReaderTests-1515381406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:05:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-eaae5abc-b11d-40c4-a6f9-b9eb8a4edac6 tempest-ProjectReaderTests-1515381406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:05:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-eaae5abc-b11d-40c4-a6f9-b9eb8a4edac6 tempest-ProjectReaderTests-1515381406 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:05:30 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-eaae5abc-b11d-40c4-a6f9-b9eb8a4edac6 tempest-ProjectReaderTests-1515381406 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:05:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-eaae5abc-b11d-40c4-a6f9-b9eb8a4edac6 tempest-ProjectReaderTests-1515381406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-73c92d95-bb5a-42c5-80dc-e06efb026393 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:05:30 devstack sudo[106558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-73c92d95-bb5a-42c5-80dc-e06efb026393 1073741824 Nov 06 18:05:30 devstack sudo[106558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:05:30 devstack sudo[106558]: pam_unix(sudo:session): session closed for user root Nov 06 18:05:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-eaae5abc-b11d-40c4-a6f9-b9eb8a4edac6 tempest-ProjectReaderTests-1515381406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-73c92d95-bb5a-42c5-80dc-e06efb026393 1073741824" returned: 0 in 0.433s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:05:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-eaae5abc-b11d-40c4-a6f9-b9eb8a4edac6 tempest-ProjectReaderTests-1515381406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-73c92d95-bb5a-42c5-80dc-e06efb026393 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:05:31 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-73c92d95-bb5a-42c5-80dc-e06efb026393 Nov 06 18:05:31 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:05:31 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Nov 06 18:05:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-eaae5abc-b11d-40c4-a6f9-b9eb8a4edac6 tempest-ProjectReaderTests-1515381406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-73c92d95-bb5a-42c5-80dc-e06efb026393" returned: 0 in 0.240s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:05:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-eaae5abc-b11d-40c4-a6f9-b9eb8a4edac6 tempest-ProjectReaderTests-1515381406 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:05:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-eaae5abc-b11d-40c4-a6f9-b9eb8a4edac6 tempest-ProjectReaderTests-1515381406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:05:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-eaae5abc-b11d-40c4-a6f9-b9eb8a4edac6 tempest-ProjectReaderTests-1515381406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ebcb7d9-14b8-42c6-88de-507f573c8d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73c92d95-bb5a-42c5-80dc-e06efb026393', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:05:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-eaae5abc-b11d-40c4-a6f9-b9eb8a4edac6 tempest-ProjectReaderTests-1515381406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (711ab649-7022-486a-8578-c94b04940a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:05:31 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-eaae5abc-b11d-40c4-a6f9-b9eb8a4edac6 tempest-ProjectReaderTests-1515381406 None] Volume volume-73c92d95-bb5a-42c5-80dc-e06efb026393 (73c92d95-bb5a-42c5-80dc-e06efb026393): created successfully Nov 06 18:05:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-eaae5abc-b11d-40c4-a6f9-b9eb8a4edac6 tempest-ProjectReaderTests-1515381406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (711ab649-7022-486a-8578-c94b04940a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:05:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-eaae5abc-b11d-40c4-a6f9-b9eb8a4edac6 tempest-ProjectReaderTests-1515381406 None] Flow 'volume_create_manager' (02d617e5-0557-4762-8ac9-5bc8605c0670) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:05:31 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-eaae5abc-b11d-40c4-a6f9-b9eb8a4edac6 tempest-ProjectReaderTests-1515381406 None] Created volume successfully. Nov 06 18:05:31 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a0dfc72e-081c-42e5-b989-e0605d7355d7 tempest-ProjectReaderTests-1515381406 None] Acquiring lock "cinder-73c92d95-bb5a-42c5-80dc-e06efb026393-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:05:31 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a0dfc72e-081c-42e5-b989-e0605d7355d7 tempest-ProjectReaderTests-1515381406 None] Lock "cinder-73c92d95-bb5a-42c5-80dc-e06efb026393-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:05:31 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a0dfc72e-081c-42e5-b989-e0605d7355d7 tempest-ProjectReaderTests-1515381406 None] Acquiring lock "cinder-quobyte-73c92d95-bb5a-42c5-80dc-e06efb026393" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:05:31 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a0dfc72e-081c-42e5-b989-e0605d7355d7 tempest-ProjectReaderTests-1515381406 None] Lock "cinder-quobyte-73c92d95-bb5a-42c5-80dc-e06efb026393" acquired by "delete_volume" :: waited 0.013s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:05:31 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[83627e74-3705-412e-862a-ffb64cc4186a]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:05:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a0dfc72e-081c-42e5-b989-e0605d7355d7 tempest-ProjectReaderTests-1515381406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-73c92d95-bb5a-42c5-80dc-e06efb026393 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:05:31 devstack sudo[106567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-73c92d95-bb5a-42c5-80dc-e06efb026393 Nov 06 18:05:31 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:05:31 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root Nov 06 18:05:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a0dfc72e-081c-42e5-b989-e0605d7355d7 tempest-ProjectReaderTests-1515381406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-73c92d95-bb5a-42c5-80dc-e06efb026393" returned: 0 in 0.356s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:05:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a0dfc72e-081c-42e5-b989-e0605d7355d7 tempest-ProjectReaderTests-1515381406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-73c92d95-bb5a-42c5-80dc-e06efb026393 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:05:32 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-73c92d95-bb5a-42c5-80dc-e06efb026393 Nov 06 18:05:32 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:05:32 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Nov 06 18:05:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a0dfc72e-081c-42e5-b989-e0605d7355d7 tempest-ProjectReaderTests-1515381406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-73c92d95-bb5a-42c5-80dc-e06efb026393" returned: 0 in 0.239s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:05:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a0dfc72e-081c-42e5-b989-e0605d7355d7 tempest-ProjectReaderTests-1515381406 None] Lock "cinder-quobyte-73c92d95-bb5a-42c5-80dc-e06efb026393" released by "delete_volume" :: held 0.635s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:05:32 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-a0dfc72e-081c-42e5-b989-e0605d7355d7 tempest-ProjectReaderTests-1515381406 None] Created reservations ['4bc5607c-2868-4375-ae49-e53edb5f592b', '65b2fdd2-7e2a-4f57-a34e-ab8ae09bcfd8', 'f2ffaf64-e0be-4345-923a-6d340a1d0f58', '3c856418-2f2d-418d-a21d-588e87779a37'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:05:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a0dfc72e-081c-42e5-b989-e0605d7355d7 tempest-ProjectReaderTests-1515381406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:05:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a0dfc72e-081c-42e5-b989-e0605d7355d7 tempest-ProjectReaderTests-1515381406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:05:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a0dfc72e-081c-42e5-b989-e0605d7355d7 tempest-ProjectReaderTests-1515381406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:05:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a0dfc72e-081c-42e5-b989-e0605d7355d7 tempest-ProjectReaderTests-1515381406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:05:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a0dfc72e-081c-42e5-b989-e0605d7355d7 tempest-ProjectReaderTests-1515381406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:05:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a0dfc72e-081c-42e5-b989-e0605d7355d7 tempest-ProjectReaderTests-1515381406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:05:32 devstack sudo[106575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:05:32 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:05:32 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root Nov 06 18:05:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a0dfc72e-081c-42e5-b989-e0605d7355d7 tempest-ProjectReaderTests-1515381406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.244s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:05:32 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-a0dfc72e-081c-42e5-b989-e0605d7355d7 tempest-ProjectReaderTests-1515381406 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:05:32 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-a0dfc72e-081c-42e5-b989-e0605d7355d7 tempest-ProjectReaderTests-1515381406 None] Deleted volume successfully. Nov 06 18:05:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a0dfc72e-081c-42e5-b989-e0605d7355d7 tempest-ProjectReaderTests-1515381406 None] Lock "cinder-73c92d95-bb5a-42c5-80dc-e06efb026393-delete_volume" released by "delete_volume" :: held 1.070s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:05:33 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-2137af96-225e-4822-a1b7-f27c351eeb16 tempest-ProjectReaderTests-1515381406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:05:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2137af96-225e-4822-a1b7-f27c351eeb16 tempest-ProjectReaderTests-1515381406 None] Flow 'volume_create_manager' (ec252934-8f35-4f98-8f50-4c78cf684256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:05:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2137af96-225e-4822-a1b7-f27c351eeb16 tempest-ProjectReaderTests-1515381406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d47abed5-1187-4041-94db-f160a364aa27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:05:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2137af96-225e-4822-a1b7-f27c351eeb16 tempest-ProjectReaderTests-1515381406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d47abed5-1187-4041-94db-f160a364aa27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-330458874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97d1de9c-cd22-4f34-8c46-463a7caa44dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27d74312a73f47b587b1bf89677fa926',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:05:33Z,use_quota=True,user_id='1b0780ed46304e75858281cf61e202af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:05:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2137af96-225e-4822-a1b7-f27c351eeb16 tempest-ProjectReaderTests-1515381406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08987472-9e62-42b4-828b-2882107a3655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:05:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2137af96-225e-4822-a1b7-f27c351eeb16 tempest-ProjectReaderTests-1515381406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08987472-9e62-42b4-828b-2882107a3655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:05:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2137af96-225e-4822-a1b7-f27c351eeb16 tempest-ProjectReaderTests-1515381406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad5a67be-a1c6-4190-8291-1604d06d4ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:05:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2137af96-225e-4822-a1b7-f27c351eeb16 tempest-ProjectReaderTests-1515381406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad5a67be-a1c6-4190-8291-1604d06d4ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97d1de9c-cd22-4f34-8c46-463a7caa44dc', 'volume_name': 'volume-97d1de9c-cd22-4f34-8c46-463a7caa44dc', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:05:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2137af96-225e-4822-a1b7-f27c351eeb16 tempest-ProjectReaderTests-1515381406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f9473fc-eefa-48f9-a32f-20c1e496d177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:05:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2137af96-225e-4822-a1b7-f27c351eeb16 tempest-ProjectReaderTests-1515381406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f9473fc-eefa-48f9-a32f-20c1e496d177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:05:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2137af96-225e-4822-a1b7-f27c351eeb16 tempest-ProjectReaderTests-1515381406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a8adf26-3c71-42dd-9ed0-3d9676474bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:05:33 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-2137af96-225e-4822-a1b7-f27c351eeb16 tempest-ProjectReaderTests-1515381406 None] Volume 97d1de9c-cd22-4f34-8c46-463a7caa44dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97d1de9c-cd22-4f34-8c46-463a7caa44dc', 'volume_size': 1} Nov 06 18:05:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2137af96-225e-4822-a1b7-f27c351eeb16 tempest-ProjectReaderTests-1515381406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:05:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2137af96-225e-4822-a1b7-f27c351eeb16 tempest-ProjectReaderTests-1515381406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:05:33 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2137af96-225e-4822-a1b7-f27c351eeb16 tempest-ProjectReaderTests-1515381406 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-330458874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97d1de9c-cd22-4f34-8c46-463a7caa44dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27d74312a73f47b587b1bf89677fa926',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:05:33Z,use_quota=True,user_id='1b0780ed46304e75858281cf61e202af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:05:33 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-2137af96-225e-4822-a1b7-f27c351eeb16 tempest-ProjectReaderTests-1515381406 None] Creating volume 97d1de9c-cd22-4f34-8c46-463a7caa44dc {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:05:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2137af96-225e-4822-a1b7-f27c351eeb16 tempest-ProjectReaderTests-1515381406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:05:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2137af96-225e-4822-a1b7-f27c351eeb16 tempest-ProjectReaderTests-1515381406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:05:33 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2137af96-225e-4822-a1b7-f27c351eeb16 tempest-ProjectReaderTests-1515381406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:05:33 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2137af96-225e-4822-a1b7-f27c351eeb16 tempest-ProjectReaderTests-1515381406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:05:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2137af96-225e-4822-a1b7-f27c351eeb16 tempest-ProjectReaderTests-1515381406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:05:33 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2137af96-225e-4822-a1b7-f27c351eeb16 tempest-ProjectReaderTests-1515381406 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:05:33 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-2137af96-225e-4822-a1b7-f27c351eeb16 tempest-ProjectReaderTests-1515381406 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:05:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2137af96-225e-4822-a1b7-f27c351eeb16 tempest-ProjectReaderTests-1515381406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-97d1de9c-cd22-4f34-8c46-463a7caa44dc 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:05:33 devstack sudo[106578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-97d1de9c-cd22-4f34-8c46-463a7caa44dc 1073741824 Nov 06 18:05:33 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:05:33 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root Nov 06 18:05:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2137af96-225e-4822-a1b7-f27c351eeb16 tempest-ProjectReaderTests-1515381406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-97d1de9c-cd22-4f34-8c46-463a7caa44dc 1073741824" returned: 0 in 0.420s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:05:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2137af96-225e-4822-a1b7-f27c351eeb16 tempest-ProjectReaderTests-1515381406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-97d1de9c-cd22-4f34-8c46-463a7caa44dc {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:05:33 devstack sudo[106584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-97d1de9c-cd22-4f34-8c46-463a7caa44dc Nov 06 18:05:33 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:05:33 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root Nov 06 18:05:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2137af96-225e-4822-a1b7-f27c351eeb16 tempest-ProjectReaderTests-1515381406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-97d1de9c-cd22-4f34-8c46-463a7caa44dc" returned: 0 in 0.254s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:05:33 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2137af96-225e-4822-a1b7-f27c351eeb16 tempest-ProjectReaderTests-1515381406 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:05:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2137af96-225e-4822-a1b7-f27c351eeb16 tempest-ProjectReaderTests-1515381406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:05:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2137af96-225e-4822-a1b7-f27c351eeb16 tempest-ProjectReaderTests-1515381406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a8adf26-3c71-42dd-9ed0-3d9676474bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97d1de9c-cd22-4f34-8c46-463a7caa44dc', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:05:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2137af96-225e-4822-a1b7-f27c351eeb16 tempest-ProjectReaderTests-1515381406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d305190-6f18-42a3-baea-fd8b17473e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:05:33 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-2137af96-225e-4822-a1b7-f27c351eeb16 tempest-ProjectReaderTests-1515381406 None] Volume volume-97d1de9c-cd22-4f34-8c46-463a7caa44dc (97d1de9c-cd22-4f34-8c46-463a7caa44dc): created successfully Nov 06 18:05:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2137af96-225e-4822-a1b7-f27c351eeb16 tempest-ProjectReaderTests-1515381406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d305190-6f18-42a3-baea-fd8b17473e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:05:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2137af96-225e-4822-a1b7-f27c351eeb16 tempest-ProjectReaderTests-1515381406 None] Flow 'volume_create_manager' (ec252934-8f35-4f98-8f50-4c78cf684256) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:05:33 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-2137af96-225e-4822-a1b7-f27c351eeb16 tempest-ProjectReaderTests-1515381406 None] Created volume successfully. Nov 06 18:05:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ec263db5-e4eb-46da-8008-5e019c8c5e59 tempest-ProjectReaderTests-1515381406 None] Acquiring lock "cinder-97d1de9c-cd22-4f34-8c46-463a7caa44dc-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:05:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ec263db5-e4eb-46da-8008-5e019c8c5e59 tempest-ProjectReaderTests-1515381406 None] Lock "cinder-97d1de9c-cd22-4f34-8c46-463a7caa44dc-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:05:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ec263db5-e4eb-46da-8008-5e019c8c5e59 tempest-ProjectReaderTests-1515381406 None] Acquiring lock "cinder-quobyte-97d1de9c-cd22-4f34-8c46-463a7caa44dc" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:05:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ec263db5-e4eb-46da-8008-5e019c8c5e59 tempest-ProjectReaderTests-1515381406 None] Lock "cinder-quobyte-97d1de9c-cd22-4f34-8c46-463a7caa44dc" acquired by "delete_volume" :: waited 0.012s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:05:34 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a36d2e7-820f-4d34-9720-b065f233abdf]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:05:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ec263db5-e4eb-46da-8008-5e019c8c5e59 tempest-ProjectReaderTests-1515381406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-97d1de9c-cd22-4f34-8c46-463a7caa44dc {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:05:34 devstack sudo[106587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-97d1de9c-cd22-4f34-8c46-463a7caa44dc Nov 06 18:05:34 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:05:34 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root Nov 06 18:05:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ec263db5-e4eb-46da-8008-5e019c8c5e59 tempest-ProjectReaderTests-1515381406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-97d1de9c-cd22-4f34-8c46-463a7caa44dc" returned: 0 in 0.362s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:05:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ec263db5-e4eb-46da-8008-5e019c8c5e59 tempest-ProjectReaderTests-1515381406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-97d1de9c-cd22-4f34-8c46-463a7caa44dc {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:05:34 devstack sudo[106592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-97d1de9c-cd22-4f34-8c46-463a7caa44dc Nov 06 18:05:34 devstack sudo[106592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:05:34 devstack sudo[106592]: pam_unix(sudo:session): session closed for user root Nov 06 18:05:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ec263db5-e4eb-46da-8008-5e019c8c5e59 tempest-ProjectReaderTests-1515381406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-97d1de9c-cd22-4f34-8c46-463a7caa44dc" returned: 0 in 0.264s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:05:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ec263db5-e4eb-46da-8008-5e019c8c5e59 tempest-ProjectReaderTests-1515381406 None] Lock "cinder-quobyte-97d1de9c-cd22-4f34-8c46-463a7caa44dc" released by "delete_volume" :: held 0.666s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:05:34 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-ec263db5-e4eb-46da-8008-5e019c8c5e59 tempest-ProjectReaderTests-1515381406 None] Created reservations ['5dedae77-6ead-49eb-866e-553b9aca83f7', '2713b389-fa7f-4aca-90d5-d4b8226be98b', '3f7010d7-5982-4f07-89b7-e1465ccb6cd3', 'b85b54d9-ac51-42d7-bf71-c97a64f22b72'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:05:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ec263db5-e4eb-46da-8008-5e019c8c5e59 tempest-ProjectReaderTests-1515381406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:05:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ec263db5-e4eb-46da-8008-5e019c8c5e59 tempest-ProjectReaderTests-1515381406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:05:35 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ec263db5-e4eb-46da-8008-5e019c8c5e59 tempest-ProjectReaderTests-1515381406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:05:35 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ec263db5-e4eb-46da-8008-5e019c8c5e59 tempest-ProjectReaderTests-1515381406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:05:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ec263db5-e4eb-46da-8008-5e019c8c5e59 tempest-ProjectReaderTests-1515381406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:05:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ec263db5-e4eb-46da-8008-5e019c8c5e59 tempest-ProjectReaderTests-1515381406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:05:35 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:05:35 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:05:35 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Nov 06 18:05:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ec263db5-e4eb-46da-8008-5e019c8c5e59 tempest-ProjectReaderTests-1515381406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.255s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:05:35 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-ec263db5-e4eb-46da-8008-5e019c8c5e59 tempest-ProjectReaderTests-1515381406 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:05:35 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-ec263db5-e4eb-46da-8008-5e019c8c5e59 tempest-ProjectReaderTests-1515381406 None] Deleted volume successfully. Nov 06 18:05:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ec263db5-e4eb-46da-8008-5e019c8c5e59 tempest-ProjectReaderTests-1515381406 None] Lock "cinder-97d1de9c-cd22-4f34-8c46-463a7caa44dc-delete_volume" released by "delete_volume" :: held 1.128s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:05:35 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-638d146c-d250-484b-a135-4ff3131d8406 tempest-ProjectReaderTests-1515381406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 18:05:35 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-638d146c-d250-484b-a135-4ff3131d8406 tempest-ProjectReaderTests-1515381406 None] Flow 'volume_create_manager' (5a74ea54-e9aa-4ea1-9026-c07ac28d5cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:05:35 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-638d146c-d250-484b-a135-4ff3131d8406 tempest-ProjectReaderTests-1515381406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9172f02b-edd9-44e5-b6f1-29e2277f47de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:05:35 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-638d146c-d250-484b-a135-4ff3131d8406 tempest-ProjectReaderTests-1515381406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9172f02b-edd9-44e5-b6f1-29e2277f47de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:05:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1642011632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc6a18ed-7e2f-4d62-a35b-90df50414c65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27d74312a73f47b587b1bf89677fa926',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:05:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:05:36Z,use_quota=True,user_id='1b0780ed46304e75858281cf61e202af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:05:35 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-638d146c-d250-484b-a135-4ff3131d8406 tempest-ProjectReaderTests-1515381406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (007c44cd-a059-43ec-8f01-d8f515a84db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:05:35 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-638d146c-d250-484b-a135-4ff3131d8406 tempest-ProjectReaderTests-1515381406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (007c44cd-a059-43ec-8f01-d8f515a84db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:05:35 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-638d146c-d250-484b-a135-4ff3131d8406 tempest-ProjectReaderTests-1515381406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca02604c-737f-437f-b6d9-ef01751e83ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:05:35 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-638d146c-d250-484b-a135-4ff3131d8406 tempest-ProjectReaderTests-1515381406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca02604c-737f-437f-b6d9-ef01751e83ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc6a18ed-7e2f-4d62-a35b-90df50414c65', 'volume_name': 'volume-fc6a18ed-7e2f-4d62-a35b-90df50414c65', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:05:35 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-638d146c-d250-484b-a135-4ff3131d8406 tempest-ProjectReaderTests-1515381406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aba83b36-13e7-43cc-8e74-b54b0dcc8892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:05:35 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-638d146c-d250-484b-a135-4ff3131d8406 tempest-ProjectReaderTests-1515381406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aba83b36-13e7-43cc-8e74-b54b0dcc8892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:05:35 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-638d146c-d250-484b-a135-4ff3131d8406 tempest-ProjectReaderTests-1515381406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fd22984-e233-4524-b9b1-4f5f545a574b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:05:35 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-638d146c-d250-484b-a135-4ff3131d8406 tempest-ProjectReaderTests-1515381406 None] Volume fc6a18ed-7e2f-4d62-a35b-90df50414c65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc6a18ed-7e2f-4d62-a35b-90df50414c65', 'volume_size': 1} Nov 06 18:05:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-638d146c-d250-484b-a135-4ff3131d8406 tempest-ProjectReaderTests-1515381406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:05:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-638d146c-d250-484b-a135-4ff3131d8406 tempest-ProjectReaderTests-1515381406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:05:35 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-638d146c-d250-484b-a135-4ff3131d8406 tempest-ProjectReaderTests-1515381406 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T17:05:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1642011632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc6a18ed-7e2f-4d62-a35b-90df50414c65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27d74312a73f47b587b1bf89677fa926',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T17:05:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T17:05:36Z,use_quota=True,user_id='1b0780ed46304e75858281cf61e202af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a238b099-13f7-4598-a03a-95c485d8b101),volume_type_id=a238b099-13f7-4598-a03a-95c485d8b101)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 18:05:35 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-638d146c-d250-484b-a135-4ff3131d8406 tempest-ProjectReaderTests-1515381406 None] Creating volume fc6a18ed-7e2f-4d62-a35b-90df50414c65 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 18:05:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-638d146c-d250-484b-a135-4ff3131d8406 tempest-ProjectReaderTests-1515381406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:05:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-638d146c-d250-484b-a135-4ff3131d8406 tempest-ProjectReaderTests-1515381406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:05:35 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-638d146c-d250-484b-a135-4ff3131d8406 tempest-ProjectReaderTests-1515381406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:05:35 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-638d146c-d250-484b-a135-4ff3131d8406 tempest-ProjectReaderTests-1515381406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:05:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-638d146c-d250-484b-a135-4ff3131d8406 tempest-ProjectReaderTests-1515381406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:05:35 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-638d146c-d250-484b-a135-4ff3131d8406 tempest-ProjectReaderTests-1515381406 None] Selected osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 18:05:35 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-638d146c-d250-484b-a135-4ff3131d8406 tempest-ProjectReaderTests-1515381406 None] casted to osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072 Nov 06 18:05:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-638d146c-d250-484b-a135-4ff3131d8406 tempest-ProjectReaderTests-1515381406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fc6a18ed-7e2f-4d62-a35b-90df50414c65 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:05:35 devstack sudo[106598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fc6a18ed-7e2f-4d62-a35b-90df50414c65 1073741824 Nov 06 18:05:35 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:05:36 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root Nov 06 18:05:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-638d146c-d250-484b-a135-4ff3131d8406 tempest-ProjectReaderTests-1515381406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fc6a18ed-7e2f-4d62-a35b-90df50414c65 1073741824" returned: 0 in 0.430s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:05:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-638d146c-d250-484b-a135-4ff3131d8406 tempest-ProjectReaderTests-1515381406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fc6a18ed-7e2f-4d62-a35b-90df50414c65 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:05:36 devstack sudo[106603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fc6a18ed-7e2f-4d62-a35b-90df50414c65 Nov 06 18:05:36 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:05:36 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root Nov 06 18:05:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-638d146c-d250-484b-a135-4ff3131d8406 tempest-ProjectReaderTests-1515381406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fc6a18ed-7e2f-4d62-a35b-90df50414c65" returned: 0 in 0.246s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:05:36 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-638d146c-d250-484b-a135-4ff3131d8406 tempest-ProjectReaderTests-1515381406 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 18:05:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-638d146c-d250-484b-a135-4ff3131d8406 tempest-ProjectReaderTests-1515381406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:05:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-638d146c-d250-484b-a135-4ff3131d8406 tempest-ProjectReaderTests-1515381406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fd22984-e233-4524-b9b1-4f5f545a574b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc6a18ed-7e2f-4d62-a35b-90df50414c65', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:05:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-638d146c-d250-484b-a135-4ff3131d8406 tempest-ProjectReaderTests-1515381406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9fee577-bd81-49b6-883f-306f4f97d659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 18:05:36 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-638d146c-d250-484b-a135-4ff3131d8406 tempest-ProjectReaderTests-1515381406 None] Volume volume-fc6a18ed-7e2f-4d62-a35b-90df50414c65 (fc6a18ed-7e2f-4d62-a35b-90df50414c65): created successfully Nov 06 18:05:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-638d146c-d250-484b-a135-4ff3131d8406 tempest-ProjectReaderTests-1515381406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9fee577-bd81-49b6-883f-306f4f97d659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 18:05:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-638d146c-d250-484b-a135-4ff3131d8406 tempest-ProjectReaderTests-1515381406 None] Flow 'volume_create_manager' (5a74ea54-e9aa-4ea1-9026-c07ac28d5cd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 18:05:36 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-638d146c-d250-484b-a135-4ff3131d8406 tempest-ProjectReaderTests-1515381406 None] Created volume successfully. Nov 06 18:05:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e2c1a049-309e-4cda-ac6f-61984231f497 tempest-ProjectReaderTests-1515381406 None] Acquiring lock "cinder-fc6a18ed-7e2f-4d62-a35b-90df50414c65-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:05:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e2c1a049-309e-4cda-ac6f-61984231f497 tempest-ProjectReaderTests-1515381406 None] Lock "cinder-fc6a18ed-7e2f-4d62-a35b-90df50414c65-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:05:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e2c1a049-309e-4cda-ac6f-61984231f497 tempest-ProjectReaderTests-1515381406 None] Acquiring lock "cinder-quobyte-fc6a18ed-7e2f-4d62-a35b-90df50414c65" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 18:05:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e2c1a049-309e-4cda-ac6f-61984231f497 tempest-ProjectReaderTests-1515381406 None] Lock "cinder-quobyte-fc6a18ed-7e2f-4d62-a35b-90df50414c65" acquired by "delete_volume" :: waited 0.017s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 18:05:36 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0d5999-b33f-41c2-a1ed-e8cdf26b29e1]: (4, 'qcow2') {{(pid=88268) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 18:05:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e2c1a049-309e-4cda-ac6f-61984231f497 tempest-ProjectReaderTests-1515381406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fc6a18ed-7e2f-4d62-a35b-90df50414c65 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:05:37 devstack sudo[106607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fc6a18ed-7e2f-4d62-a35b-90df50414c65 Nov 06 18:05:37 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:05:37 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root Nov 06 18:05:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e2c1a049-309e-4cda-ac6f-61984231f497 tempest-ProjectReaderTests-1515381406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fc6a18ed-7e2f-4d62-a35b-90df50414c65" returned: 0 in 0.358s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:05:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e2c1a049-309e-4cda-ac6f-61984231f497 tempest-ProjectReaderTests-1515381406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fc6a18ed-7e2f-4d62-a35b-90df50414c65 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:05:37 devstack sudo[106612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fc6a18ed-7e2f-4d62-a35b-90df50414c65 Nov 06 18:05:37 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:05:37 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root Nov 06 18:05:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e2c1a049-309e-4cda-ac6f-61984231f497 tempest-ProjectReaderTests-1515381406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8/volume-fc6a18ed-7e2f-4d62-a35b-90df50414c65" returned: 0 in 0.235s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:05:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e2c1a049-309e-4cda-ac6f-61984231f497 tempest-ProjectReaderTests-1515381406 None] Lock "cinder-quobyte-fc6a18ed-7e2f-4d62-a35b-90df50414c65" released by "delete_volume" :: held 0.632s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:05:37 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-e2c1a049-309e-4cda-ac6f-61984231f497 tempest-ProjectReaderTests-1515381406 None] Created reservations ['3ff11f77-651d-4249-b688-e0a243cdf2bf', 'c0ef4832-c78f-490e-bfeb-baa96bda6d28', 'bd9666ec-f46c-4747-9592-bcb3139026bd', '98ec7921-9310-4038-8596-8db02e8976f2'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 18:05:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e2c1a049-309e-4cda-ac6f-61984231f497 tempest-ProjectReaderTests-1515381406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:05:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e2c1a049-309e-4cda-ac6f-61984231f497 tempest-ProjectReaderTests-1515381406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:05:37 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e2c1a049-309e-4cda-ac6f-61984231f497 tempest-ProjectReaderTests-1515381406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:05:37 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e2c1a049-309e-4cda-ac6f-61984231f497 tempest-ProjectReaderTests-1515381406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:05:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e2c1a049-309e-4cda-ac6f-61984231f497 tempest-ProjectReaderTests-1515381406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:05:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e2c1a049-309e-4cda-ac6f-61984231f497 tempest-ProjectReaderTests-1515381406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:05:37 devstack sudo[106615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:05:37 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:05:37 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root Nov 06 18:05:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e2c1a049-309e-4cda-ac6f-61984231f497 tempest-ProjectReaderTests-1515381406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.256s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:05:37 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-e2c1a049-309e-4cda-ac6f-61984231f497 tempest-ProjectReaderTests-1515381406 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:05:37 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-e2c1a049-309e-4cda-ac6f-61984231f497 tempest-ProjectReaderTests-1515381406 None] Deleted volume successfully. Nov 06 18:05:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e2c1a049-309e-4cda-ac6f-61984231f497 tempest-ProjectReaderTests-1515381406 None] Lock "cinder-fc6a18ed-7e2f-4d62-a35b-90df50414c65-delete_volume" released by "delete_volume" :: held 1.089s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 18:05:47 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=27,cinder:UPDATE=37,cinder:DELETE=4,cinder:INSERT=8 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:05:47 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:UPDATE=51,cinder:SELECT=29,cinder:INSERT=12,cinder:DELETE=4 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 18:05:54 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 18:05:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 18:05:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 18:05:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 18:05:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-072bd9f7-fadf-4e49-9f77-dc471a7fc072'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 18:05:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 18:05:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 18:05:54 devstack sudo[106881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8 Nov 06 18:05:54 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 18:05:54 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root Nov 06 18:05:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b93519cabac1a48d46bb243ec25d3af8" returned: 0 in 0.254s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 18:05:54 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 18:05:54 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] Running periodic task VolumeManager._thread_info {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 18:05:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] thread count: 28 {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 18:05:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7169c82f-4dbd-478e-8d1e-bffdae886a58 None None] thread info: [<_MainThread(MainThread, started 133940619505792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}